Analytically Inclined

Tag: RAG

  • LLM Context Windows: What Actually Matters

    LLM Context Windows: What Actually Matters

    ·

    by

    scott
    in

    The Context Window Arms Race Recently the LLM world has turned into a context window arms race. Google announces 2 million tokens. Anthropic pushes to 200K. OpenAI ups the ante. And everyone’s acting like bigger is automatically better. Here’s the thing though; most of us don’t actually need a 2 million token context window. And…