November 4th, 2024

Claude 3.5 Haiku Released

Claude 3.5 Haiku, Anthropic's latest AI model, enhances coding and reasoning, available on major platforms with competitive pricing. It shows significant improvements in performance and prioritizes safety in development.

Read original articleLink Icon
Claude 3.5 Haiku Released

Claude 3.5 Haiku is the latest iteration of Anthropic's AI models, designed to enhance coding, tool use, and reasoning capabilities while maintaining an accessible pricing structure. It outperforms its predecessor, Claude 3 Opus, across various intelligence benchmarks and is available through multiple platforms, including Amazon Bedrock and Google Cloud’s Vertex AI. The pricing starts at $1 per million input tokens and $5 per million output tokens, with potential savings through prompt caching and the Message Batches API. The model is particularly effective for applications such as code completions, interactive chatbots, data extraction, and real-time content moderation. Early testing has shown significant improvements in reasoning tasks and code generation, with users reporting enhanced performance in generating natural-sounding sales emails and reducing code errors. Anthropic emphasizes safety in its AI development, ensuring that Claude 3.5 Haiku adheres to rigorous safety standards while delivering advanced capabilities. Overall, Claude 3.5 Haiku represents a substantial leap in AI performance, making it suitable for critical applications requiring low latency.

- Claude 3.5 Haiku is the fastest model from Anthropic, improving on previous versions.

- It is available on major platforms with competitive pricing and cost-saving options.

- The model excels in various applications, including coding, chatbots, and content moderation.

- Early user feedback highlights significant improvements in reasoning and code generation.

- Anthropic prioritizes safety in the development of Claude 3.5 Haiku.

Link Icon 3 comments
By @minimaxir - 5 months
Increasing pricing "due to its increased intelligence" (which is getting backlash: https://x.com/AnthropicAI/status/1853498270724542658 ) is a fun way of creeping price markup gradually.
By @pietz - 5 months
The pricing isn't absurd, but I also think this one will stay on the shelf. Their Claude 3.0 lineup was so good:

Haiku as a very cheap and fast option for low complexity stuff. Sonnet for most people and their fairly advanced problems. Opus as a very expensive, slow but very capable model. Haiku 3 was 12x cheaper and Opus 5x more expensive than Sonnet. This made a lot of sense to me and I used every single for for different tasks.

With 3.5, that's a different story. They're clearly running into GPU limits and dropping Opus for now is a reasonable thing to do. Sonnet has improved so much and OpenAI is behind them anyway. But this move on Haiku is stupid on so many levels.

Their lineup is down to two models, which are closer than ever in performance and price. It's like "Sonnet" and "Almost Sonnet" and at a 3x price difference, I'll stick with the OG. For a lower cost model, I'm going to stick with GPT-4o-mini.

Also, people make connections to products through names and not benchmark results. It's great that Haiku has improved so much, but it's still Haiku. We know models get better, but increasing prices 4x for a new version of an existing one doesn't feel nice.