Oasis: A Universe in a Transformer
Decart will launch Oasis, a real-time AI model for interactive gaming, on October 31, 2024. It generates gameplay based on user inputs, simulating physics and graphics with advanced techniques.
Read original articleDecart has announced the release of Oasis, an innovative real-time, open-world AI model designed for interactive video gaming. Set to launch on October 31, 2024, Oasis utilizes a transformer-based architecture to generate gameplay in real-time based on user inputs, simulating physics and graphics dynamically. The model employs advanced diffusion training techniques, allowing it to produce video frame-by-frame while maintaining low latency. Decart's proprietary inference framework optimizes performance on NVIDIA H100 GPUs, with future enhancements expected when the Sohu chip is released, potentially enabling 4K resolution gameplay. Oasis represents a significant step towards more complex AI-driven interactive environments, aiming to revolutionize user experiences in gaming and entertainment by allowing real-time content generation tailored to user preferences. Despite its promising capabilities, the model still faces challenges, such as producing hazy outputs and memory limitations. Ongoing research aims to address these issues through model scaling and optimization techniques.
- Oasis is the first playable, real-time AI model for interactive gaming.
- The model generates video based on user inputs, simulating physics and graphics.
- It utilizes advanced diffusion training and transformer architecture for real-time performance.
- Future enhancements with the Sohu chip could enable 4K resolution gameplay.
- Ongoing research focuses on improving model memory and output clarity.
Related
Sohu AI chip claimed to run models 20x faster and cheaper than Nvidia H100 GPUs
Etched startup introduces Sohu AI chip, specialized for transformer models, outperforming Nvidia's H100 GPUs in AI LLM inference. Sohu aims to revolutionize AI processing efficiency, potentially reshaping the industry.
New AI model can hallucinate a game of 1993's Doom in real time
Researchers from Google and Tel Aviv University developed GameNGen, an AI model that simulates Doom in real time, generating over 20 frames per second, but faces challenges with graphical glitches and visual consistency.
Counter-Strike's Dust II runs purely within a neural network on an RTX 3090
The "DIAMOND" diffusion model simulates CS:GO on Dust II with an RTX 3090, achieving only 10 FPS and exhibiting glitches, highlighting challenges in AI game simulation. Counter-Strike 2 offers a better experience.
Sam Altman says lack of compute is delaying the company's products
OpenAI CEO Sam Altman stated that product development is hindered by limited compute capacity, delaying features for ChatGPT and DALL-E, while collaborating with Broadcom on an AI chip expected by 2026.
Oasis: An interactive, explorable world model
Oasis is an AI model for interactive open-world game generation, optimized for high-definition video and real-time user control, anticipating a future dominated by AI-generated internet content.
There's just so many questions: Will videogames eventually just be a single prompt (or a series of prompts / a general script) into a transformer model?
Would services like stadia be making a comeback if the value prop is that even though you have some latency, the possibilities for videogames will be endless?
Would microsoft want a piece of the $$ if the transformer was trained on Minecraft clips?
We really are in an acceleration phase
Related
Sohu AI chip claimed to run models 20x faster and cheaper than Nvidia H100 GPUs
Etched startup introduces Sohu AI chip, specialized for transformer models, outperforming Nvidia's H100 GPUs in AI LLM inference. Sohu aims to revolutionize AI processing efficiency, potentially reshaping the industry.
New AI model can hallucinate a game of 1993's Doom in real time
Researchers from Google and Tel Aviv University developed GameNGen, an AI model that simulates Doom in real time, generating over 20 frames per second, but faces challenges with graphical glitches and visual consistency.
Counter-Strike's Dust II runs purely within a neural network on an RTX 3090
The "DIAMOND" diffusion model simulates CS:GO on Dust II with an RTX 3090, achieving only 10 FPS and exhibiting glitches, highlighting challenges in AI game simulation. Counter-Strike 2 offers a better experience.
Sam Altman says lack of compute is delaying the company's products
OpenAI CEO Sam Altman stated that product development is hindered by limited compute capacity, delaying features for ChatGPT and DALL-E, while collaborating with Broadcom on an AI chip expected by 2026.
Oasis: An interactive, explorable world model
Oasis is an AI model for interactive open-world game generation, optimized for high-definition video and real-time user control, anticipating a future dominated by AI-generated internet content.