Red Hat Reveals Major Enhancements to Red Hat Enterprise Linux AI
Red Hat released RHEL AI 1.2, enhancing LLM development with features like Retrieval-Augmented Generation and Periodic Checkpointing, while supporting more hardware and major cloud platforms, urging upgrades from version 1.1.
Read original articleRed Hat has announced the release of Red Hat Enterprise Linux AI (RHEL AI) 1.2, just weeks after the initial version 1.0. This update introduces significant enhancements aimed at improving the development, testing, and deployment of large language models (LLMs). RHEL AI is designed to facilitate generative AI model processes while making LLM training more cost-effective. The new version integrates IBM Research's Granite LLM family and the InstructLab alignment tools, promoting collaborative model development through the open-source InstructLab AI project. Key features include Retrieval-Augmented Generation (RAG) for better access to external knowledge, expanded hardware support for Lenovo servers, and a technology preview for AMD Instinct Accelerators. RHEL AI 1.2 also supports deployment on major cloud platforms like Azure and Google Cloud, alongside existing support for AWS and IBM Cloud. New functionalities such as "Periodic Checkpointing" allow users to save training progress, while the PyTorch Fully Sharded Data Parallel (FSDP) feature significantly reduces training times. Red Hat aims to make LLM training accessible to a broader range of users, not just data scientists. With this rapid release cycle, Red Hat is reinforcing its commitment to the enterprise AI market, urging users to upgrade from the deprecated version 1.1 within 30 days.
- Red Hat released RHEL AI 1.2, enhancing LLM development and deployment.
- The update includes new features like Retrieval-Augmented Generation and Periodic Checkpointing.
- RHEL AI 1.2 supports additional hardware and major cloud platforms.
- The software aims to make AI model training accessible to non-data scientists.
- Users are encouraged to upgrade from the deprecated version 1.1 within 30 days.
Related
Llama 3.1: Our most capable models to date
Meta has launched Llama 3.1 405B, an advanced open-source AI model supporting diverse languages and extended context length. It introduces new features like Llama Guard 3 and aims to enhance AI applications with improved models and partnerships.
Why Llama 3.1 is Important
Meta's new Llama 3.1 405B model prioritizes data sovereignty, open-source accessibility, cost savings, independence, and advanced customization. It aims to boost AI innovation by empowering companies with control and flexibility.
LM Studio 0.3.0
LM Studio version 0.3.0 enhances its desktop application with document chat, Retrieval Augmented Generation, a Structured Output API, multiple UI themes, improved regeneration, and simplified migration of previous chats.
Llama 3.2 released: Multimodal, 1B to 90B sizes
Llama 3.2 has been released as an open-source AI model in various sizes for text and image processing, enhancing application development and gaining significant traction with over 350 million downloads.
IBM Granite 3.0: open enterprise models
IBM launched Granite 3.0, an open-source suite of advanced language models for enterprise applications, emphasizing performance, safety, and cost-efficiency, with features like Mixture of Experts and Granite Guardian for risk management.
Related
Llama 3.1: Our most capable models to date
Meta has launched Llama 3.1 405B, an advanced open-source AI model supporting diverse languages and extended context length. It introduces new features like Llama Guard 3 and aims to enhance AI applications with improved models and partnerships.
Why Llama 3.1 is Important
Meta's new Llama 3.1 405B model prioritizes data sovereignty, open-source accessibility, cost savings, independence, and advanced customization. It aims to boost AI innovation by empowering companies with control and flexibility.
LM Studio 0.3.0
LM Studio version 0.3.0 enhances its desktop application with document chat, Retrieval Augmented Generation, a Structured Output API, multiple UI themes, improved regeneration, and simplified migration of previous chats.
Llama 3.2 released: Multimodal, 1B to 90B sizes
Llama 3.2 has been released as an open-source AI model in various sizes for text and image processing, enhancing application development and gaining significant traction with over 350 million downloads.
IBM Granite 3.0: open enterprise models
IBM launched Granite 3.0, an open-source suite of advanced language models for enterprise applications, emphasizing performance, safety, and cost-efficiency, with features like Mixture of Experts and Granite Guardian for risk management.