Home/Glossary/Time to First Token (TTFT)

Performance

What is Time to First Token (TTFT)?

The latency between sending a prompt and receiving the first generated token. TTFT depends on prompt processing speed and prompt length. On Apple Silicon, TTFT for a 1,000-token prompt ranges from ~0.5 seconds (M5 Max, 8B model) to ~5 seconds (M3 Pro, 70B model). The M5 Max's Neural Accelerators significantly reduce TTFT for long-context prompts.

Where Time to First Token (TTFT) comes up on LLMCheck

Look up tok/s for your exact chip and model →

Related terms

All 37 terms in the LLMCheck glossary →