260505-NvidiaDriver-CUDA-cuDNN-下载 | HF-SOTA模型对比 | Kimi+ MiMo
·
1 NVIDIA Driver
-
版本1: Linux 64-bit RHEL 9 (支持CUDA 12.2 ~ 13.2)

-
版本2: Linux 64-bit (支持CUDA 12.2 ~ 12.4)

2 CUDA
2.1 导航地址
- CUDA Toolkit Archive | NVIDIA Developer
- 选择下载非最新的稳定版

2.2 选择rpm下载

wget https://developer.download.nvidia.com/compute/cuda/13.2.0/local_installers/cuda-repo-rhel9-13-2-local-13.2.0_595.45.04-1.x86_64.rpm
sudo rpm -i cuda-repo-rhel9-13-2-local-13.2.0_595.45.04-1.x86_64.rpm
sudo dnf clean all
sudo dnf -y install cuda-toolkit-13-2
2.3 选择run下载

wget https://developer.download.nvidia.com/compute/cuda/13.2.0/local_installers/cuda_13.2.0_595.45.04_linux.run
sudo sh cuda_13.2.0_595.45.04_linux.run
3 cuDNN
3.1 导航地址
- cuDNN Archive | NVIDIA Developer
- 当前截图为cuDNN-9系
- 最后一个链接为cuDNN-8系及之前

3.2 选择Full下载

wget https://developer.download.nvidia.com/compute/cudnn/9.21.0/local_installers/cudnn-local-repo-rhel9-9.21.0-1.0-1.x86_64.rpm
sudo rpm -i cudnn-local-repo-rhel9-9.21.0-1.0-1.x86_64.rpm
sudo dnf clean all
sudo dnf -y install cudnn
3.3 选择JIT下载

wget https://developer.download.nvidia.com/compute/cudnn/9.21.0/local_installers/cudnn-local-repo-rhel9-9.21.0-1.0-1.x86_64.rpm
sudo rpm -i cudnn-local-repo-rhel9-9.21.0-1.0-1.x86_64.rpm
sudo dnf clean all
sudo dnf -y install cudnn-jit
4. SOTA模型
4.1 Kimi

- moonshotai/Kimi-K2.6 · Hugging Face
- Kimi-K2.6的
int4模型为Kimi-K2-Thinking - 该模型为
Text Generation模型, 而原模型为Image | Text to Text模型
- Kimi-K2.6的
4. 2 MiMo


更多推荐



所有评论(0)