LLM token

A token is the basic unit a large language model, or LLM, reads and writes. A token is typically a word fragment, not a whole word. Both input and output tokens count toward usage. The prompt, any retrieved knowledge-base content, and the model’s reply all add up to the total. Usage-based AI pricing is commonly tied to token volume, so conversation length, system prompts, and retrieved context all affect cost. Example: passing a long call transcript to a model for quality scoring consumes far more input tokens than a short chat exchange does. A ten-minute call transcript might use thousands of tokens before the model even produces a response. Every model also has a fixed context window, which is the maximum number of tokens it can process at once. That limit controls how much transcript or history the model can consider, and it factors directly into latency.

A token is the basic unit a large language model, or LLM, reads and writes. A token is typically a word fragment, not a whole word. Both input and output tokens count toward usage. The prompt, any retrieved knowledge-base content, and the model’s reply all add up to the total. Usage-based AI pricing is commonly tied to token volume, so conversation length, system prompts, and retrieved context all affect cost. Example: passing a long call transcript to a model for quality scoring consumes far more input tokens than a short chat exchange does. A ten-minute call transcript might use thousands of tokens before the model even produces a response. Every model also has a fixed context window, which is the maximum number of tokens it can process at once. That limit controls how much transcript or history the model can consider, and it factors directly into latency.

OnClarity

5,000 free AI support resolutions for startups

Startups in the US, UK and Europe with under 200 staff get 5,000 free resolutions from OnClarity’s AI support agent as their trial.

Apply for the Startup Program

Open until 31 March 2027 or until 50 startups are approved.

OnClarity

5,000 free AI support resolutions for startups

Startups in the US, UK and Europe with under 200 staff get 5,000 free resolutions from OnClarity’s AI support agent as their trial.

Apply for the Startup Program

Open until 31 March 2027 or until 50 startups are approved.

OnClarity

5,000 free AI support resolutions for startups

Startups in the US, UK and Europe with under 200 staff get 5,000 free resolutions from OnClarity’s AI support agent as their trial.

Apply for the Startup Program

Open until 31 March 2027 or until 50 startups are approved.