This open-source AI video model can generate videos in real time

Lightricks, a software company focused on image and video editing, released an open-source artificial intelligence (AI) video model in preview last week. The AI ​​model, called LTX Video, can generate medium resolution videos in real time. While real-time video generation capabilities exist in a number of major language models (LLMs), this is the first model to be open source. The company also stated that once the full version is released, it will be free for both personal and commercial use and can be integrated into the LTX Studio.

Lightricks introduces open-source AI video model

In a series of to inform At X (formerly known as Twitter), Lightricks detailed his open-source AI model. The LTX Video accepts both text and images as input and can generate five-second videos at 768 x 512p resolution. Although the preview model limits video quality at medium resolution, it offers near real-time generation with a four-second latency. However, this generation time is possible on devices equipped with the Nvidia H100 chip.

The company claims that the AI ​​model can generate dynamic videos with high compliance and does not require high-quality resources. To run the LTX Video locally, users will need a GPU comparable to the level of RTX 4090. Lightricks also highlighted that the model architecture is based on the Diffusion Transformer, but uses only two billion parameters to keep the size small.

LTX Video is currently available on GitHub, Hugging Face and ComfyUI for download. To test the model’s capabilities before downloading it from the hosting websites, users can visit the model’s page on Fal.ai here.

The AI ​​model also integrates with a wide range of external editing tools to further refine the generated videos. The company also plans to release the full version of the video model and make it open source for both personal and commercial use. The full version of the tool will also integrate with the LTX Studio, the company’s AI-powered storyboarding platform.