OpenAI, Surveillance, and Autonomous Weapons: Breaking Down the Pentagon Contract Fine Print
Critics including the EFF, The Intercept, and The Atlantic have called out vague language in OpenAI's Pentagon contract. Here's what the contract actually says and why the wording matters.
The detailed criticism of OpenAI’s Department of War contract has come from a handful of specific sources: the Electronic Frontier Foundation, reporting from The Intercept, and commentary in The Atlantic. The core complaint is that the contract’s language on surveillance and autonomous weapons is functionally meaningless because it defines limits by reference to existing law rather than by substance.
I’ve been working through both the contract language and the criticism. Here’s what I think developers and the public should actually understand.
How the Contract Handles Surveillance
The contract includes language acknowledging domestic surveillance laws. It references statutory frameworks including the Foreign Intelligence Surveillance Act, the Electronic Communications Privacy Act, and relevant executive orders governing signals intelligence.
OpenAI and the Department of War have characterized this as evidence that the contract respects existing legal boundaries. The argument: we’ve incorporated surveillance law by reference, so anything the contract permits is by definition legal.
The critics’ counterargument is that this formulation permits everything the law permits, and what the law permits is often quite broad. The Electronic Communications Privacy Act, for example, was written in 1986 and has been interpreted to allow extensive data collection that was never contemplated when it passed. Courts have periodically updated its application, but significant surveillance activities remain legal under current interpretations.
By defining the contract’s limits through these statutes rather than through specific prohibited use cases, the contract’s actual scope is as wide as the broadest legal interpretation of those statutes. That’s the “weasel words” criticism in concrete form.
The Autonomous Weapons Language
The contract’s treatment of autonomous weapons follows the same structural pattern. It references existing Department of Defense Directive 3000.09, which governs autonomous weapons systems. Directive 3000.09 requires meaningful human control over certain weapons systems but includes exceptions for defensive systems, has been updated to accommodate new technologies, and leaves substantial interpretive flexibility.
Referencing the Directive means the contract permits whatever the Directive permits. Critics point out that the Directive has historically been interpreted in ways that allow considerable autonomy in certain weapon system contexts, and that defining limits by reference to it is different from writing explicit prohibitions into a contract.
OpenAI’s public position, articulated by Sam Altman and in company statements, is that its systems won’t be used for autonomous lethal targeting. Those statements exist in policy documents and public communications. The dispute is whether policy documents and CEO statements provide the same protection as contract terms, and the critics’ answer is no.
What EFF, The Intercept, and The Atlantic Actually Said
The EFF’s “Weasel Words” analysis focused on the surveillance framing, arguing that a contract that defers to existing surveillance law provides no meaningful additional restriction and that meaningful protections require explicit prohibitions, not legal references.
The Intercept’s reporting examined the gap between OpenAI’s public usage policies, which do prohibit weapons development, and the contract terms, raising questions about which document governs a custom government deployment operating outside the standard API terms.
The Atlantic’s commentary focused on what this signals about how AI companies’ stated values translate into binding commitments when facing government clients with conflicting interests.
The through-line across all three: the absence of hard language means the contract’s limits are defined by whoever interprets the referenced laws, and that entity is the government.
Why Contract Language Matters
The reason the EFF and others focus on contract language rather than policy statements is that contracts are enforceable and policies aren’t. If OpenAI’s usage policies prohibit weapons development and an AI system built under this contract is used in a context that arguably violates those policies, the enforcement mechanism is the contract, not the policy.
A contract that says “this service shall not be used for autonomous weapons deployment” creates a specific legal obligation with specific remedies for breach. A contract that says “this service will be used consistent with DoD Directive 3000.09” creates an obligation that’s only as clear as the Directive itself.
The distinction matters most in edge cases, the situations where the technology is used in ways that weren’t contemplated when the contract was signed. Narrow, specific language resolves edge cases predictably. Reference language resolves them in favor of whoever has the authority to interpret the referenced document.
What Developers Should Know
If you build products on OpenAI’s API for government clients, this contract sets a precedent for what the government expects from AI vendors. The terms OpenAI accepted (reference to existing law rather than specific prohibitions) are the terms that the Department of War prefers, and that’s now the baseline other vendors will be measured against.
If your organization has its own AI ethics policies or usage restrictions, understanding how those interact with government contract terms is worth legal review before signing. Anthropic’s experience, where safety terms were treated as a disqualifying condition, illustrates that those policies may not be enforceable in a government contracting context if the government simply won’t agree to them.
For users evaluating AI tools for government-adjacent work: the question isn’t whether the company has good stated policies. It’s what the binding contract terms actually say, and whether those terms give the government flexibility to use the AI in ways that concern you.
That’s not a comfortable framing, but it’s the accurate one.
Sources
-
[1]
Our agreement with the Department of War(openai.com)
-
[2]
OpenAI Is Opening the Door to Government Spying(theatlantic.com)
- [3]
- [4]
-
[5]
Anthropic sues Defense Department over supply-chain risk designation(techcrunch.com)
Illustration: AI-generated (gpt-image-2)
Written by Matthew Lake