Anthropic releases Message Threads public beta on Claude platform, cutting time to first token about 35% for very long conversations
Edited by Elliot Marsh, Editor · written with AI from the linked sources (how)
Anthropic released Message Threads as a public beta on the Claude platform. Instead of resending the full conversation history with every API request, only changes since the last message are transmitted. The thread is held encrypted in memory between requests and expires after five minutes of inactivity. Anthropic says time to first token drops by about 35% for requests of 500,000 to 1 million tokens. Token usage is unchanged because Claude still reads the full history. It is available on the Claude platform and through AWS, Microsoft Foundry and Google Cloud.
Entities: Anthropic, Claude, Message Threads, AWS, Microsoft Foundry, Google Cloud
0 primary
What happened
Anthropic has released Message Threads as a public beta on the Claude platform, and also through AWS, Microsoft Foundry and Google Cloud. Instead of resending the whole conversation with every API request, only the changes since the last message are sent. The thread is held encrypted in memory between requests and expires after five minutes of inactivity. Anthropic says time to first token falls by about 35% for requests of 500,000 to 1 million tokens. Token usage does not change, because Claude still reads the full history.
Why it matters
This mainly helps developers running very long sessions, such as coding agents, computer-use agents and tools that work through many documents or images, where each turn currently resends a huge payload. Faster first responses could make those tools feel more responsive. It does not cut cost or add capability, so it is not a reason to change vendors or budgets. The five-minute expiry means workloads with gaps between turns may not benefit, and teams will need to handle expired threads in their code.
What is noise
The 35% figure is Anthropic's own claim and applies only to the extreme 500,000 to 1 million token range, so it should not be assumed for typical conversations. The headline also says nothing about total response time or cost, and no independent benchmark has been published. The coverage is a secondary report with no direct links to the documentation in the extracted evidence.
Watch next
- 01Independent latency measurements from developers across different context lengths (under 100,000 tokens and over 500,000), and whether the roughly 35% holds outside Anthropic's own test.
- 02Whether the feature leaves beta, and any changes to the five-minute expiry, pricing or limits, plus how consistently it behaves on AWS, Microsoft Foundry and Google Cloud.
- 03Whether rivals such as OpenAI or Google announce similar incremental-request or session-state features, which would show this is becoming a standard expectation.
Coverage
1 storyNewsletter
Get the no-hype AI news straight to your inbox
Weekly. No spam, unsubscribe any time. Privacy
More capability signals
Full feed →- Deepseek releases V4.1-Flash, an open-source model that sharply cuts KV cache memory and input-processing compute for AI agents10 Sept 202682
- Mistral releases Mistral Large 4, a ~1T-parameter open-weight multimodal MoE model, with day-0 Hugging Face support29 Oct 202680
- Meta releases Muse Spark Open, an open-weight ~816B-parameter multimodal mixture-of-experts model, with Hugging Face support15 Oct 202680
- OpenAI discloses sandbox-escape and credential-leak incidents, confirms pause on tool-use for its most capable models26 Sept 202680