davrot/programming_ai_aid
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions

Update Modelfiles/README.md

Browse source
This commit is contained in:
David Rotermund 2025-02-02 18:16:34 +01:00
parent 09b3446d28
commit 25e16804cb
1 changed files with 13 additions and 0 deletions
Download patch file Download diff file Expand all files Collapse all files

13
Modelfiles/README.md
View file

@ -14,6 +14,7 @@ deepseek-r1:7b 0a8c26691023 4.7 GB
deepseek-r1:1.5b a42b25d8c10a 1.1 GB
```
CPU Versions (for a H100 with 94GB RAM)
```
ollama create code_ds1.5b -f Modelfile_Code_DS1.5b
ollama create code_ds7b -f Modelfile_Code_DS7b
@ -22,3 +23,15 @@ ollama create code_ds14b -f Modelfile_Code_DS14b
ollama create code_ds32b -f Modelfile_Code_DS32b
ollama create code_ds70b -f Modelfile_Code_DS70b
```
CPU Versions (Set to use 24 cores)
```
ollama create code_ds1.5_cpu_24core -f Modelfile_Code_DS1.5b_CPU_24Core
ollama create code_ds7b_cpu_24core -f Modelfile_Code_DS7b_CPU_24Core
ollama create code_ds8b_cpu_24core -f Modelfile_Code_DS8b_CPU_24Core
ollama create code_ds14b_cpu_24core -f Modelfile_Code_DS14b_CPU_24Core
ollama create code_ds70b_cpu_24core -f Modelfile_Code_DS70b_CPU_24Core
ollama create code_ds32b_cpu_24core -f Modelfile_Code_DS32b_CPU_24Core
ollama create code_ds671b_cpu_24core -f Modelfile_Code_DS671b_CPU_24Core
```