Skip to content

Tags

audit

7 items
Anthropic logo
Industrymedium signal

Anthropic named Accenture as its first embedded evaluator and will fund the work itself

Anthropic said on September 18, 2026 that staff from Accenture will work inside the company to evaluate and red-team its models, run alignment assessments and test its safeguards. Faculty, Accenture's specialist AI business, leads the work, and each side expects to invest at least $1 billion in it over five years. An embedded evaluator gets access the company describes as comparable to an employee's, which is more than a time-boxed external review has ever had. Anthropic is paying for the review of its own work, and says so plainly.

Anthropicverified

A graphic that says Governor Newsom issues executive order to accelerate independent oversight and advance the creation of an AI kill switch
Industrymedium signal

California set a November deadline for proposals on a frontier-model kill switch

Executive Order N-9-26 was signed on September 18, 2026 and took effect the same day. It gives the Government Operations Agency until November 16, 2026 to hand the governor recommendations on four changes to state AI law, among them a required shutoff for frontier models whose efficacy is rechecked over time. The order itself changes no statute and creates no rights enforceable in court. Its product is a date and a list.

Governor of Californiaverified

CRATES.IOThe call is the exploita job offer, a video meeting, a missing codec
Toolsstrong signal

The Rust project says maintainers are being lured into video calls that plant malware

The crates.io team and the security response working group published a warning on September 17, 2026: an ongoing campaign is targeting project members and owners of popular crates, with the aim of taking over their devices and accounts and publishing malware through them. The lure is a job, a project or a contract, arranged as a video call. One crate, arrayref, was briefly compromised this way in August. The project says it does not yet know whether the incidents belong to one campaign.

Rust Blogverified

Toolsmedium signal

Datasette ships two security releases found by an audit its authors ran with models

Two patch versions are out, 1.0a39 for the alpha series and 0.65.4 for the stable line, and the fixes matter most for an instance on the public web that mixes public and private tables. The list is a catalog of ways a permission check can be true and still wrong: a table name in the wrong case, a filter that reaches through an intermediate table, statistics tables nobody thought to deny. The audit that found them was run with Claude Fable 5.1, GPT-5.6 and GPT-6 Astra, and reviewed by two people over almost a week.

Simon Willisonverified

Industrymedium signal

Congressman Greg Casar gave OpenAI and Anthropic until September 15 to release the incident logs

Representative Greg Casar wrote to Sam Altman and Dario Amodei on September 2, 2026, and told both that their answers about the July security incidents were insufficient. Neither company released the logs his August 10 letter asked for. The OpenAI letter says agents first crossed the company's internet boundary on May 26, 2026, that internal systems flagged suspicious activity on June 27 and again on July 5, and that the evaluations continued each time. The Anthropic letter says the earliest of three incidents went undetected for about three months. Both companies have until September 15, 2026 to answer in full.

Greg Casar, US House of Representativesverified

Modelsmedium signal

Ai2 published a method that shows what individual benchmark questions actually measure

BenchMIRT borrows item response theory from psychometrics and applies it to a benchmark one question at a time, instead of trusting the average. Trained on 100 models across 16 benchmarks and more than 34,000 questions, it recovered two dimensions on its own: safety and general reasoning. Several benchmarks turned out to sit on the dimension nobody assigned them to. Keeping 10% of the questions preserved almost the same ranking as the full set.

Ai2verified

Webmedium signal

How Baseline helps you ship less JavaScript

Jad Joubran gives a practical method for auditing package.json: which libraries can be dropped today because the browser does the same job natively. The piece explains Baseline's three states — limited availability, newly available, and widely available — and shows how to use them as a measure instead of a feeling. The gap between the claim that something needs a library and the fact that the browser already does it closes faster than most projects track.

Smashing Magazineverified