Anthropic's Message Threads cut time to first token by 35 percent for long conversations

| Source: THE DECODER

Tags: Anthropic, Claude, Messages API, Message Threads, time to first token, AWS, Google Cloud, Microsoft Foundry

Anthropic released Message Threads in public beta for the Messages API, so agents send only what changed since the last turn, cutting time to first token by about 35 percent on 500K to 1M token requests.

Details

Anthropic has launched Message Threads as a public beta on the Claude platform. Until now every Messages API request had to resend the full conversation history; with threads, only the changes since the last message are transmitted. Anthropic says time to first token drops by about 35 percent for requests between 500,000 and one million tokens. Coding agents, computer-use agents and document- or image-heavy workflows benefit most. The thread is kept encrypted in memory between requests and expires after five minutes of inactivity. Token usage does not change, because Claude still reads the full history. The feature is available on the Claude platform and through AWS, Microsoft Foundry and Google Cloud.