Docker搭建vicuna
项目地址:llama-cpp-python
镜像地址:hub-mirror
模型地址:ggml-vic13b-q5_1.bin
前端UI地址(目前仍不兼容):BetterChatGPT
部署Docker镜像
1 |
|
- mkdir -p ~/app/llama && cd ~/app/llama && nano docker-compose.yml
- mkdir models && cd models
- wget https://huggingface.co/eachadea/ggml-vicuna-13b-1.1/resolve/main/ggml-vic13b-q5\_1.bin
- cd ~/app/llama
- sudo docker-compose up -d
- sudo docker-compose logs
测试是否成功
1 |
|
Docker搭建vicuna
https://occdn.limour.top/2723.html