Context Window (Llms)

The context window is akin to a short-term memory that determines how much text the model can consider for generating responses.

Context Window (Llms)

Areas of application

  • Natural Language Processing
  • Speech Recognition
  • Text Analytics
  • Computer Vision
  • Data Mining
  • Information Retrieval
  • Deep Learning Models

Example

For instance, GPT-3 can manage a context of 2,000 tokens, while GPT-4 Turbo extends to 128,000 tokens.

Resources