AWS open-sources AWS Emulator, fully built and maintained by AI agents

On 2026-11-11 at 23:50, AWS published the Universal Agent Evaluation Framework (UAEF) on the AWS Machine Learning Blog, describing it as a framework-agnostic system for evaluating AI agents. UAEF converts traces from different agent frameworks into one canonical format, scores them with 36 built-in metrics spread across 7 dimensions, and stores the results so teams can compare agent versions and detect regressions.

About two hours later, on 2026-11-12 at 01:25, Amazon disclosed AWS Emulator, a new local cloud-service emulator, saying that every line of its code was written by thousands of autonomous AI agents and that the tool was already available for download. Further reporting filled in the details. SiliconANGLE noted at 01:30 that AWS Emulator is a free, locally hosted suite that replicates hundreds of AWS cloud services on a developer workstation, letting developers validate code without connecting to the cloud. GeekWire reported at 02:51 that it simulates more than 200 AWS services locally, that all of its code was written by AI agents with no review by human engineers, and that agents also maintain it, testing it against the real AWS cloud and fixing the gaps they find. Techmeme, relaying the same GeekWire story at 04:25, added that AWS said its engineers wrote or reviewed not a single line, and presented that as a selling point.

Simon Willison wrote on 2026-11-12 at 05:18 that the official emulator is named aws-emulator, is written in Rust, and accumulated 29,684 commits in its first three weeks, produced by a large swarm of agents; it currently requires Docker to run on macOS or Windows, and Swaminathan (Swami) Sivasubramanian explained how it came about in a guest post on Werner Vogels' blog. MarkTechPost reported on 2026-11-13 at 01:26 that AWS Emulator is free, released under a CC0 license, built from 438 API models, covers more than 200 services, was written entirely by autonomous agents, and passed 56.6% of 42,857 published fidelity tests at launch. On UAEF, The Next Web said at 01:27 on 2026-11-12 that the free open-source tool tests agents on 36 measures, from tool use to safety, works across several agent frameworks, and flags when a new prompt or model makes an agent worse. The latest disclosed status is that AWS Emulator is downloadable and maintained by AI agents, and UAEF has been released and open-sourced.