METR
Research updates and other news from METR, a research nonprofit developing the science of autonomous AI evaluations.
| Platform |  | Pricing | Only free issues | Publishes | Weekly |
|---|---|---|---|---|---|
| Issues | 59 | Founded | 2 years ago | Last Issue | 4 months ago |
| Active | |||||
Read this Newsletter
metr.substack.comLatest Issues
Analyzing coding agent transcripts to upper bound productivity gains from AI agents
Introduction
Human uplift studies like the one we did in 2025 are becoming more expensive as working without AI becomes increasingly costly. In this post, I investigate whether coding agent transcripts could serve as a cheaper alternati...
Frontier AI safety regulations: A reference for lab staff
Frontier AI developers such as OpenAI, Google, Anthropic, xAI, and others are governed by safety and security regulations under California and EU law. These regulations establish incident reporting requirements, model evaluation standards,...
Time Horizon 1.1
We’re releasing a new version of our time horizon estimates (TH1.1), using more tasks and a new eval infrastructure.
Our estimates of time horizons for many models have been updated. The new estimates generally fall within our existing con...
Early work on monitorability evaluations
Future AI systems may be capable enough to carry out sabotage, either via malicious real-world actions or via intentionally tampering with evaluations. We want to track the sabotage capabilities of AI systems and be confident that we can de...
MALT: A Dataset of Natural and Prompted Behaviors That Threaten Eval Integrity
Access the dataset on Hugging Face:
Transcript Graph Ordered Messages
Summary
- We’re introducing MALT (Manually-reviewed Agentic Labeled Transcripts), a dataset of natural and prompted examples of behaviors that threaten evaluation...
Key Facts
Audience Metrics
Subscribers, engagement, traffic and sponsorship for METR.
| Subscribers | Engagement | 0 | Monthly Web Visits | ||
|---|---|---|---|---|---|
| Accepts Sponsors | Estimated Cost per Ad | ||||
Explore More
Authors
The writers behind this newsletter.
METR researches, develops and runs cutting-edge tests of AI capabilities, including broad autonomous capabilities and the ability of AI systems to conduct AI R&D.
Frequently Asked Questions
How can I access the email archive for METR?
You can find recent issues that have been published by METR on Reletter by scrolling up to where it says Latest Issues. Tap on the link for any of the most recent emails or hit More Issues to see older ones.
How many subscribers does METR have?
To see how many people subscribe to METR, simply upgrade your Reletter account. We provide readership numbers and lots of other stats for this newsletter so you can decide if it's worth reaching out to.
How can I advertise in METR?
Newsletter advertising can be extremely effective when it's done right. Before you pitch METR as a potential sponsor or partner, make sure that you've done your research and checked its newsletter stats with Reletter.
Then, personalize one of our winning pitching templates and send it to the right person using the contact info provided.
How much does it cost to sponsor a publication like METR?
Newsletter ad rates (or CPM) vary depending on many factors, including industry, number of subscribers, open rate, ad placement and more.
To find out how much an ad will cost, contact METR using the contact information provided and ask for a copy of their media kit.
How can I find newsletters related to METR?
Scroll up to where it says Related Newsletters to see other publications like METR. You can also search our email newsletter directory to discover other newsletters that cover the topics you're interested in.
How do I contact METR?
Reletter provides this newsletter's website URL above, where you will often find their contact information. We also provide links to associated social media accounts and pitching templates so you can reach out fast.