Gigabyte AI Top lets you train AI locally on your desktop
Gigabyte unveiled its end-to-end artificial intelligence (AI) solution for training large language models (LLMs) locally on a device at AMD’s Computex 2024 event. The full-stack AI solution includes AI Top Utilities, AI Top Hardware, and AI Top Tutor, covering different aspects of training open-source AI models. AI Top Utilities is a training software with support for multiple open-source AI models, while AI Top Hardware offers the company’s AI-focused products. The AI Top Tutor is for those who need help understanding how to get the most out of this solution.
Gigabyte AI Top offers solutions to train AI on the device
The announcement was made during the company’s Computex 2024 event, with the company unveiling AI Top as an all-encompassing solution aimed at “Training your own AI on your desk.” In a press release, the company detailed the various aspects of the offering, which spans three divisions: software support, hardware support, and consultation and technical support. Notably, the announcement comes after the Gigabyte AI PC was introduced at the Consumer Electronics Show (CES) 2024.
Gigabyte AI Top Utility
Photo Credit: Gigabyte
The AI Top Utility is a digital interface that enables local AI model training using new workflows. The company claims that the software offers a user-friendly interface and real-time progress monitoring. It supports multiple open-source AI models with up to 236 billion parameters. The company claims that the platform is more cost-effective and shows faster results compared to its cloud counterpart. It can also offload data to system memory and SSDs to overcome VRAM size limitations.
Next up is the AI Top Hardware, which is basically the company’s hardware offerings. It includes a range of AI-optimized products that are power-efficient and can handle AI training workloads. These hardware solutions also feature upgradeable components. One of the primary hardware in this series includes AI Top Motherboard (TRX50) with configurable form factor, memory type and slots, graphics interface, and more. AI Top Graphics Card, SSD, and PSU are also included.
The final offering in this solution is the AI Top Tutor. Positioned as “on-desk AI coaching,” this is essentially the company’s AI-powered consultation and technical support system that provides insights, installation guidance, and troubleshooting assistance. The company claims that the coaching system will enable both beginners and professionals to start on-device AI projects.
The company has not yet announced pricing or availability of the Gigabyte AI Top solutions.
