Prerequisites
The following section describes the hardware configurations and operating system requirements for installing and correctly running GenAI Studio.
x86_64 Architecture Host
Currently, GenAI Studio only supports hosts with the x86_64 architecture.
NVIDIA GPU Graphics Cards
GenAI Studio primarily supports NVIDIA GPU graphics cards, including the following products:
| Product Model | Architecture Code |
|---|---|
| H200 | Hopper |
| H100 | Hopper |
| RTX PRO 6000 | Blackwell |
| RTX 50 Series (e.g., 5090) | Blackwell |
| RTX 6000 Ada Generation | Ada Lovelace |
| RTX 5000 Ada Generation | Ada Lovelace |
| RTX 4000 Ada Generation | Ada Lovelace |
| RTX 4000 SFF Ada Generation | Ada Lovelace |
| L40/L40S | Ada Lovelace |
| RTX 40 Series (incl. 4090/4090 D) | Ada Lovelace |
| RTX A6000 | Ampere |
| RTX A5000 | Ampere |
SQ Flash AI SSD (M.2)
Optional. However, it is an indispensable hardware setup if you intend to perform Full Parameter Fine-tuning. The following table lists the recommended AI SSD capacity and system DRAM configurations for Full Parameter Fine-tuning.
| Model Parameters | AI SSD (capacity x count) | System DRAM |
|---|---|---|
| < 13B | 1TB * 1 | 128 GiB |
| 34B | 1TB * 2 | 128 GiB |
| 70B | 2TB * 2 | 128 GiB |
| 180B | 2TB * 4 | 128 GiB |
Storage Space
The storage space required for GenAI Studio depends on several factors, such as which base models are downloaded from Hugging Face and the size of the datasets to be trained. Therefore, it is impossible to provide an exact or ideal recommended value, but "the larger, the better" remains a constant truth. Nevertheless, the table below lists the minimum space requirements for a clean installation of GenAI Studio for reference:
| Item | Capacity / Storage Space | Description |
|---|---|---|
| Installer (.run) | ~ 45 GiB | Space required to store the installation file |
| Install Directory | ~ 78 GiB | Space required for the installation directory |
| Container Images | ~ 63 GiB | Loading space required for container images |
According to the table above, to simply install GenAI Studio and run it normally after installation, at least 186 GiB of free disk space must be available.
Operating System
Since GenAI Studio encapsulates all functions within containers, any Ubuntu version 22.04.3 or higher should be compatible for installing GenAI Studio 1.3. However, we recommend installing the 24.04.3 LTS Desktop version.