WhatsApp Android beta reveals Llama 3 405B option
WhatsApp is updating to version 2.24.14.7 on Google Play Beta, introducing the Meta AI Llama model for enhanced user interactions. Users can choose between different Llama models for tailored AI experiences.
Read original articleWhatsApp is releasing a new update, version 2.24.14.7, through the Google Play Beta Program. The update introduces a feature allowing users to choose the Meta AI Llama model for future use. This feature is still under development and not yet available to beta testers. The Meta AI Llama model aims to enhance user interactions with advanced AI models, offering options like the default Llama 3-70B for quick prompts and the upcoming Llama 3-405B for more complex queries. Users will have the flexibility to select the model that best suits their needs, balancing faster responses with advanced capabilities. This feature is expected to provide users with more control over their AI interactions, tailoring their experience based on specific requirements. Stay tuned for further updates on the release of this feature.
Related
Optimizing AI Inference at Character.ai
Character.AI optimizes AI inference for LLMs, handling 20,000+ queries/sec globally. Innovations like Multi-Query Attention and int8 quantization reduced serving costs by 33x since late 2022, aiming to enhance AI capabilities worldwide.
Run the strongest open-source LLM model: Llama3 70B with just a single 4GB GPU
The article discusses the release of open-source Llama3 70B model, highlighting its performance compared to GPT-4 and Claude3 Opus. It emphasizes training enhancements, data quality, and the competition between open and closed-source models.
Llama.ttf: A font which is also an LLM
The llama.ttf font file acts as a language model and inference engine for text generation in Wasm-enabled HarfBuzz-based applications. Users can download and integrate the font for local text generation.
Apple Wasn't Interested in AI Partnership with Meta Due to Privacy Concerns
Apple declined an AI partnership with Meta due to privacy concerns, opting for OpenAI's ChatGPT integration into iOS. Apple emphasizes user choice and privacy in AI partnerships, exploring collaborations with Google and Anthropic for diverse AI models.
Meta starts testing user-created AI chatbots on Instagram
Meta CEO Mark Zuckerberg announced testing user-created AI chatbots on Instagram via Meta AI studio. Creators will label AI characters clearly. Initial U.S. tests involve 50 creators, aiming for wider use by August. Meta promotes AI for engaging interactions.
So much of everyone's life is happening in messaging apps, and it's a perfect surface for "AI" to actually help. Yet every big player keeps pushing their "generate AI art from a prompt" feature front and center as if anyone really cares.
8b would be feasible though given enough ram but probably a bit too slow for most users' liking. I guess this is why they don't even offer a local option. And when you go cloud the bigger models will be better of course.
I wonder if meta will use this to finally monetise WhatsApp.
Related
Optimizing AI Inference at Character.ai
Character.AI optimizes AI inference for LLMs, handling 20,000+ queries/sec globally. Innovations like Multi-Query Attention and int8 quantization reduced serving costs by 33x since late 2022, aiming to enhance AI capabilities worldwide.
Run the strongest open-source LLM model: Llama3 70B with just a single 4GB GPU
The article discusses the release of open-source Llama3 70B model, highlighting its performance compared to GPT-4 and Claude3 Opus. It emphasizes training enhancements, data quality, and the competition between open and closed-source models.
Llama.ttf: A font which is also an LLM
The llama.ttf font file acts as a language model and inference engine for text generation in Wasm-enabled HarfBuzz-based applications. Users can download and integrate the font for local text generation.
Apple Wasn't Interested in AI Partnership with Meta Due to Privacy Concerns
Apple declined an AI partnership with Meta due to privacy concerns, opting for OpenAI's ChatGPT integration into iOS. Apple emphasizes user choice and privacy in AI partnerships, exploring collaborations with Google and Anthropic for diverse AI models.
Meta starts testing user-created AI chatbots on Instagram
Meta CEO Mark Zuckerberg announced testing user-created AI chatbots on Instagram via Meta AI studio. Creators will label AI characters clearly. Initial U.S. tests involve 50 creators, aiming for wider use by August. Meta promotes AI for engaging interactions.