安装ollama：curl -fsSL https://ollama.com/install.sh | sh

（离线安装）：https://objects.githubusercontent.com/github-production-release-asset-2e65be/658928958/9babb704-0e2b-47f1-8522-10b5ba4fffe8?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=releaseassetproduction%2F20250220%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20250220T095715Z&X-Amz-Expires=300&X-Amz-Signature=328fc0d0403fae482d9182e312e04b965773888bb3372bb306d106534e8be79a&X-Amz-SignedHeaders=host&response-content-disposition=attachment%3B%20filename%3Dollama-linux-amd64.tgz&response-content-type=application%2Foctet-stream

将ollama serve服务写入etc下的配置文件ollama.service中

启动ollama serve

安装大模型：ollama run deepseek-r1:32b

Nvidia cuda安装：sudo sh <run文件>,在安装中将驱动选上。

安装docker：官网下载地址：Index of linux/static/stable/

tar -xvzf docker-24.0.2.tgz

移动解压出来的二进制文件到 /usr/bin 目录中

mv docker/* /usr/bin/

编辑docker的系统服务文件

vi /usr/lib/systemd/system/docker.service

[Unit]

Description=Docker Application Container Engine

Documentation=https://docs.docker.com

After=network-online.target firewalld.service

Wants=network-online.target

[Service]

Type=notify

ExecStart=/usr/bin/dockerd

ExecReload=/bin/kill -s HUP $MAINPID

LimitNOFILE=infinity

LimitNPROC=infinity

TimeoutStartSec=0

Delegate=yes

KillMode=process

Restart=on-failure

StartLimitBurst=3

StartLimitInterval=60s

[Install]

WantedBy=multi-user.target

加载后重启dpcker：

systemctl daemon-reload

systemctl restart docker

Docker下载maxkb：

docker pull registry.fit2cloud.com/maxkb/maxkb

参考文章：

麒麟系统在线安装docker（x86/arm）_麒麟安装docker-CSDN博客