A machine played a role in a decision that affects them
In Rio de Janeiro, a labor court judge inadvertently left an AI system prompt visible in a published legal ruling, offering a rare and unintended window into how machine intelligence has quietly entered the architecture of judicial decision-making. The slip was small — a forgotten instruction, a failure to clean up — but what it revealed was large: that legally binding decisions shaping human lives were being drafted, at least in part, by algorithms operating without public acknowledgment. Like a palimpsest where the original text bleeds through, the error exposed not just a technical oversight, but a deeper question about who — or what — speaks when the law speaks.
- A Brazilian labor judge published an official court ruling with the AI prompt still embedded in the document, turning an internal drafting tool into an accidental public confession.
- The exposure ignited immediate concern: if no one caught the prompt before publication, what other safeguards were being skipped in AI-assisted rulings affecting workers' rights and livelihoods?
- Critics and legal observers are pressing hard on the accountability gap — when a machine helps write a binding decision, the chain of responsibility becomes dangerously blurry.
- Brazil's courts have no established framework governing AI use in judicial drafting, meaning this incident landed in a regulatory vacuum with no clear protocol to invoke.
- The pressure to clear massive caseloads makes abandoning AI tools unlikely, but the public nature of this slip may force courts to finally codify what has until now been an informal, undisclosed practice.
A judge at Rio de Janeiro's Regional Labor Court — TRT1 — published an official ruling with something it was never meant to contain: the AI system prompt used to help draft it. The instruction, the kind a human types into an AI tool to shape its output, remained embedded in the final document, visible to anyone who read it. A small technical failure had turned a private workflow into a public record.
The mistake itself was unremarkable. What it revealed was not. Brazil's judiciary had been using machine learning to assist in composing legally binding decisions — rulings that determine people's rights, jobs, and futures — without any public acknowledgment and, apparently, without consistent procedures for cleaning up the evidence before publication. The casualness of the oversight was as striking as the oversight itself.
The incident touched a live wire running through courts worldwide. AI tools have become attractive for managing crushing caseloads and drafting preliminary documents, but their use raises unresolved questions: Who bears responsibility for a machine-assisted ruling? Has the tool been examined for bias? Does the public have a right to know a machine played a role? Brazil's courts had not answered these questions before putting AI to work.
The exposure is unlikely to end AI use in Brazilian courtrooms — the caseload pressure is too intense and the convenience too great. But it has cracked open a conversation that was previously happening only in the background. Courts may now be compelled to establish real rules: when AI can be used, how its role must be disclosed, and what becomes of the prompts and outputs that currently vanish without a trace. One forgotten line of text has made the invisible visible, and that may be difficult to walk back.
A judge in Rio de Janeiro's labor court left behind the digital equivalent of a handwritten note in the margins of an official ruling. When the decision was published, the AI system prompt—the hidden instruction that had guided the artificial intelligence tool used to draft the opinion—remained visible to anyone who read it. The oversight exposed what many suspected but few had seen documented: that Brazil's judicial system was using machine learning to help write legally binding decisions.
The incident occurred at TRT1, the Regional Labor Court for Rio de Janeiro, one of Brazil's major judicial bodies. A magistrate had apparently used an AI system to assist in composing a court ruling, then failed to scrub the prompt from the final document before it went public. The prompt, the kind of instruction a human operator types into an AI tool to shape its output, remained embedded in the published decision—a technical mistake that turned an internal process into a public record.
What makes the error significant is not the use of AI itself, which has become routine in many institutions worldwide. It is the revelation of how casually the tool was deployed, and how little thought appears to have gone into cleaning up after it. A court decision carries the weight of law. It affects people's livelihoods, their rights, their futures. The discovery that such a decision had been drafted with machine assistance, and that no one had bothered to remove the evidence before publishing it, raised immediate questions about oversight, accountability, and whether Brazil's courts had developed any real protocols for this kind of work.
The exposure also highlighted a broader tension in modern judiciaries. Courts around the world have begun experimenting with AI to manage caseloads, draft preliminary documents, and assist in legal research. The technology can be useful. It can also be opaque. When a judge uses an AI tool, who is responsible for the output? Has the tool been tested for bias? Does the public have a right to know that a machine played a role in a decision that affects them? These questions have no easy answers, and Brazil's courts had apparently not settled on them before putting AI to work.
The incident is unlikely to stop judges from using AI. The pressure to move cases through the system is too great, and the tools are too convenient. But it may force a reckoning. Brazilian courts may now feel compelled to establish clearer rules: when AI can be used, how it must be documented, what happens to the prompts and outputs, and how decisions assisted by machines should be labeled or disclosed. The accidental exposure of a single prompt has created an opening for that conversation to happen in the open, rather than in the background where such decisions are usually made.
A Conversa do Hearth Outra perspectiva sobre a história
Why does it matter that the prompt was left in the document? Couldn't a judge just say they used AI and move on?
Because the prompt is the thing that shaped the decision. It's the instruction that told the AI what to do, what tone to use, what to emphasize. If you don't see it, you don't know what the machine was actually asked to produce.
So the prompt is like the judge's hidden reasoning?
Closer to that than anything else. It's the judge's instructions to the machine, which means it's part of how the decision was made. Hiding it is like hiding part of the reasoning.
Do you think judges will stop using AI now?
No. The pressure to move cases is too real. But they'll probably start being more careful about cleaning up after themselves, or maybe they'll start disclosing it upfront instead.
What would proper disclosure look like?
A note in the decision saying an AI tool was used, what it was asked to do, maybe even what the prompt was. Transparency instead of accident.
And if they don't do that?
Then we're back to the same problem—decisions that affect people's lives being made with tools nobody can see or question.