in

Anthropic Expands the Contextual Input Window for Its Claude Chatbot to 75,000 Words

Anthropic Unveils Claude

Anthropic, a startup founded by former OpenAI engineers, has made a significant breakthrough in chatbot technology. The company has expanded the contextual input window for its Claude chatbot to 75,000 words, a big improvement over current models. According to Anthropic, this expansion has allowed the chatbot to process an entire fictional novel in less than a minute.

Anthropic has tested the system by editing one sentence in The Great Gatsby and asking the AI to notice the change. It happened in just 22 seconds.

One of the major limitations of chatbots is memory, as the amount these systems can process during use is quite limited. While AI language models that underpin these systems learn from terabytes of text, their ability to process during use is still limited to a few thousand words. For example, ChatGPT can only process up to 3,000 words during use.

The new Claude features are only available to Anthropic’s business partners who connect to the chatbot via the company’s API. The price for the new features is currently unknown, but it is expected to have increased significantly due to the increased computational overhead required to process more text.

AI language models measure information not by the number of characters or words but by tokens — a semantic unit that does not always correlate with the number of characters. This advantage for the Claude context window is that it can handle up to 100,000 tokens compared to 9,000 previously. The fully functional GPT-4c model can only handle up to 32,000 tokens.

Anthropic’s breakthrough is significant for the chatbot industry, as it opens up new possibilities for more complex conversations with chatbots. The company’s success in expanding the contextual input window could lead to even more advancements in chatbot technology. However, it remains to be seen how this will affect the future pricing and availability of chatbots.

What do you think?

Vishak

Written by Vishak

Vishak is a skilled Editor-in-chief at Code and Hack with a passion for AI and coding. He has a deep understanding of the latest trends and advancements in the fields of AI and Coding. He creates engaging and informative content on various topics related to AI, including machine learning, natural language processing, and coding. He stays up to date with the latest news and breakthroughs in these areas and delivers insightful articles and blog posts that help his readers stay informed and engaged.

Leave a Reply

Avatar

Your email address will not be published. Required fields are marked *

Google Codey

Codey: Google Launched AI-Based Developer Assistance to Compete with GitHub Copilot

Employees Criticize Bard

Google Bard is Unavailable in Some Countries Due to Strict Data Protection Laws