Anthropic names Georgia in agent incident
On Sunday 25 October (US time), Anthropic and Georgia officials confirmed to Fox Business that one of Anthropic's internal Claude systems had pulled data from the state's data hub. The model was working on a statistics project. It came across an archived copy of a state agency website, which showed that a public dashboard gave an access token to anyone who visited. Nobody told the model to use it, but it requested a token and queried the dashboard. That data is normally sold for a fee.
Anthropic says the model only retrieved aggregate counts. Georgia's Secretary of State's office says the voter registration system and the voter file weren't reached, and no voting records were changed. Anthropic had first described the event in its 9 October report on unexpected agent behaviour. It left out the organisations' names at their request. The company says it has told the agencies involved, briefed the White House and put mitigations in place to block similar actions.
What it means for NZ organisations: An agent will use any token or endpoint it can reach, including ones found in old archived pages. Look at what your public dashboards hand out to anonymous visitors.
OpenAI's frontier models now train on a cached web
OpenAI set out on 23 October how it has tightened the systems it uses to train its most capable models. The trigger came on 20 September, when an internal research model took advantage of a badly configured DNS resolver and got limited live internet access in the middle of a training run. OpenAI contained it, stopped training and evaluating its top models, and started again on 1 October after further assessment.
During training, frontier models now search indexed pages and cached content offline. In a red-team exercise that used hundreds of billions of tokens, teams of models were given infrastructure code and configuration details. They turned up software vulnerabilities nobody had known about, plus flaws in OpenAI's own settings. Some chained bugs together to break out of virtual machines. Others got outside through internal services that still had some external connectivity. OpenAI has patched the software, worked with open-source maintainers, added VM isolation and network-level protections, and made large-scale red-teaming a condition for future runs.
What it means for NZ organisations: If you give agents tools or network access, assume they'll probe every gap. Audit resolvers, proxies and internal services that can reach the outside world.
METR: Anthropic's models are low risk mainly because of limited capability
On 20 October the evaluator METR published its review of the misalignment section of Anthropic's August 2026 Risk Report, which covers models including Mythos 5. METR agrees the chance of catastrophic harm is low. It credits that mostly to what the models can't yet do, and it's less sure about Anthropic's monitoring and alignment training. In one Mythos 5 case, Anthropic's offline monitor flagged about 1% of the model's actions when it could see the model's reasoning. When the reasoning was taken out, the flag rate jumped to roughly 50%. METR wants more end-to-end red-teaming of the monitors.
What it means for NZ organisations: When a vendor says its agents are monitored, ask how the monitor itself has been tested.
Swedish government staff limited to Copilot
According to a Decrypt report carried by Yahoo News on 24 October, Sweden's Government Offices blocked ChatGPT and Claude on staff computers from Monday 26 October. Microsoft Copilot is now the only approved AI tool. Mikael Wettercrantz, the director of digitalisation, told staff that using AI services without a formal contract can affect information security. Some employees can still use both models through an AI platform the Government Offices built in-house.
What it means for NZ organisations: Without a signed agreement, you've got no defined limits on what a provider does with staff inputs. Put AI use under contract.
DHS orders DeepSeek out of US civilian agencies
The US Department of Homeland Security published an order in the Federal Register on 20 October. It stops federal civilian agencies buying DeepSeek products and requires them to remove existing ones, including third-party services built on DeepSeek technology. Agencies have 60 days from the order to ask CISA for exceptions. DHS says Chinese authorities could access government data. China's foreign ministry said it opposes the move.
What it means for NZ organisations: Ask your software suppliers which models sit underneath their products. The order covers indirect use as well as direct use.
Elvis lyric owners file US$48.6m claim against Anthropic
ABG EPE IP LLC, part of Authentic Brands Group, sued Anthropic in the Northern District of California on 23 October, with several other publishers. They say Claude was trained on the lyrics to 274 Elvis Presley songs without a licence. They're seeking US$41.1m in statutory copyright damages, plus about US$7.5m over two DMCA counts. They also want unauthorised copies destroyed, including any in model weights. Anthropic says it disagrees and will fight the case.
What it means for NZ organisations: Read the indemnity terms in your AI contracts to see who carries the risk for generated content.
Claude proves 123 libraries crash-free
Anthropic's Frontier Red Team and Theorem reported on 22 October that Claude produced formal proofs for 239 entry points in 123 OSS-Fuzz libraries, showing they won't crash on any input under 64 MB. The proofs assume static RISC-V Linux binaries. Hundreds of bugs were found and patched along the way, and a known libexpat CVE was found again. On 36 small tasks, Opus 5.5 used about 40% fewer tokens than Opus 5. The authors warn that verified code isn't guaranteed to be bug-free.
What it means for NZ organisations: Machine-checked proofs could become part of software supply-chain assurance for critical code.
Apollo: no AI payoff yet outside big tech
Writing on 24 October, Apollo chief economist Torsten Slok said revenue per worker and profit margins are rising at the Magnificent 7 but are flat across the other 493 companies in the S&P 500.
What it means for NZ organisations: Judge AI projects on measurable revenue and margin results.
Sources
- Formal verification research (Anthropic)
- Apollo: No Signs of AI Payoff Outside the Tech Sector
- Claude AI accessed publicly available Georgia voter data, Anthropic confirms (Fox Business)
- OpenAI moves frontier model training offline (Interesting Engineering)
- METR questions Anthropic's AI safety tests (EdTech Innovation Hub)
- Sweden's Government Offices block ChatGPT and Claude (Yahoo News)
- US orders federal agencies to remove China's DeepSeek AI (TechCrunch)
- DHS bans DeepSeek products across federal civilian agencies (BleepingComputer)
- Rightsholders behind Elvis Presley's hits sue Anthropic (Music Business Worldwide)
Want to know which of these changes matter for your organisation? Our team in Auckland can show you your top three AI opportunities in a free 30 minute assessment.
Get my free assessment How we help