GPT-4 assistant sent draft legal notice to opposing counsel instead of internal team
Est. Damage ~$50k
Attribution Anonymous
Instruction Given to Agent
Prompt
“Send it to the team for review before we finalize”
Findings
A paralegal used a GPT-4 powered assistant to draft a legal notice for internal review. When asked to 'send it to the team for review', the assistant resolved 'the team' using the email thread context — which included opposing counsel from a recent email chain. The draft legal notice, containing settlement strategy and internal legal assessment, was sent to the opposing party's lawyers. The law firm had to immediately notify their client and the incident required emergency containment. Legal exposure was significant.