account arrow-down-linearrow-down-small arrow-downarrow-download arrow-left-small arrow-leftarrow-link arrow-rightarrow-upawarded bluesky books calendar close-modal closedate delete document education emailevent facebookhamburger impact instagramjustice linkedin location-outline location opinion page phonepinterestplay plusplyr-pause plyr-play post preview projectpublication reports resourcesearch-bigsearch series share star-full star-open startime twitterwelfare youtube zoom-in zoom-out

Families using AI for legal advice have no protection when help is wrong, as justice system ‘delegates by default’ to private technology

Separating parents who turn to tools like ChatGPT for legal advice have no route to effective redress if the information they are given is wrong, according to a new report by Dr Natalie Byrom. The report makes urgent recommendations for government to address the risks of digital tools head-on, in order to both strengthen protections for families and the justice system and to harness the benefits AI could bring.

Today Nuffield Family Justice Observatory convened a discussion on the use of AI and digital tools in the family justice system with MP Jake Richards, Minister for Sentencing, Human Rights and Technology for the Ministry of Justice; Dr Natalie Byrom, an independent researcher and policy adviser whose work focuses on how data and technology are reshaping access to justice; Lisa Harker, Director of Nuffield Family Justice Observatory; Olive Craig from Rights of Women, and Gaia Marcus, Director of the Ada Lovelace Institute.

Government and the court service are increasingly reliant on technology that is built, owned and managed by the private sector – a significant departure from previous approaches to digitising the justice system, which championed publicly built, publicly owned technology as an active design choice. There is concern that regulation and governance is failing to keep pace, resulting in inadequate protection for families or the justice system.

Delegated by default? Privately owned technology in the family justice system by Dr Natalie Byrom and published today by Nuffield Family Justice Observatory warns that in family justice this ‘delegation by default’ approach creates risks that are notably acute due to both the nature of disputes and the vulnerability of the people coming to court.

The growing use of GenAI tools like ChatGPT and Claude for search, risks disrupting decades of investment aimed at improving access to authoritative, accessible dispute resolution advice online. In family justice as elsewhere, there is emerging evidence that litigants are turning to these tools directly for advice and document preparation, despite the fact that GenAI tools frequently get the law wrong. These tools are also prone to affirming users’ beliefs even where they are incorrect, often discouraging behavioural repair and undermining ongoing attempts by policymakers and professionals to de-escalate conflict and divert parents towards conciliation.

The report is clear that the risks aren’t an argument against digital or AI-mediated justice, or against a role for the private sector in delivering it, but that a deliberate approach is needed which manages the opportunities and risks.

“The current model of ‘delegation by default’ is a policy choice rather than a neutral consequence of technological change. Evidence suggests that parents in family disputes are increasingly turning to tools such as ChatGPT for legal advice. These tools are designed to agree with their users. New research shows that a single conversation with such a tool leaves people more convinced they are right (even when they are wrong) and less willing to repair relationships. This is not an argument against AI but an argument against inertia. If government fails to act now, it will not simply forgo the benefits AI and digital technology could bring to access to justice; it risks generating new and avoidable costs, undermining already fragile public trust in the justice system, and compounding the very problems that the shift to digital justice was meant to solve.” Dr Natalie Byrom, the report’s author, said:
“The change AI is bringing gives us a greater opportunity to consider how we keep the child at the heart of every case and how we ensure victims get justice. We should be asking how we can regulate AI to serve children and families while keeping trust at the core of the justice system. We are already seeing a shift. For some families, AI is giving them access information and support in ways they never could before. But we need to make sure that support is always of the highest quality. The question now is how we harness the power of AI to build a justice system that benefits children and families, and with the care that the nature of justice demands.” Jake Richards, Minister for Sentencing, Human Rights and Technology, said:

The report makes 26 recommendations across four areas.

Firstly, the Ministry of Justice (MoJ) should act urgently to close two distinct regulatory gaps that leave AI tools performing legal-advice functions outside regulation.
Secondly, the MoJ should address market failure in consumer-facing tools including developing a government response to the impact of Google’s AI Overview on access to high-quality legal information and monitoring how litigants in person use GenAI tools, and the impact of this use on dispute resolution strategy.

Thirdly, the MoJ should urgently act to build the assurance, evaluation and transparency infrastructure that does not currently exist. Fourthly, the MoJ, HM Courts &
Tribunals Service and the judiciary must strengthen the governance of AI use in courts to ensure that both litigants and the system are protected and agree an approach to ongoing monitoring of GenAI’s impact on court capacity, rates of legal representation, case outcomes, and public trust and confidence, starting in the family courts.

“It’s vital that the family justice system is on the front foot when it comes to the opportunities and challenges of AI. Decisions on its use should be made purposefully and based on evidence, and we need to ensure that the impact of digital technology on how families experience justice – for both better and worse – is central in the debate.” Lisa Harker, director of Nuffield Family Justice Observatory, said:

Profile