davrot/programming_ai_aid
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions

Add Modelfiles/README.md

Browse source
This commit is contained in:
David Rotermund 2025-02-02 17:47:15 +01:00
parent e24c6f1987
commit 4be7e97a21
1 changed files with 24 additions and 0 deletions
Download patch file Download diff file Expand all files Collapse all files

24
Modelfiles/README.md Normal file
View file

@ -0,0 +1,24 @@
Mind the size of your GPU! Otherwise go for smaller model or a no GPU setting.
```
ollama list | grep deepseek
```
```
deepseek-r1:671b 739e1b229ad7 404 GB
deepseek-r1:70b 0c1615a8ca32 42 GB
deepseek-r1:32b 38056bbcbb2d 19 GB
deepseek-r1:14b ea35dfe18182 9.0 GB
deepseek-r1:8b 28f8fd6cdc67 4.9 GB
deepseek-r1:7b 0a8c26691023 4.7 GB
deepseek-r1:1.5b a42b25d8c10a 1.1 GB
```
```
ollama create code_ds1.5b -f Modelfile_Code_DS1.5b
ollama create code_ds7b -f Modelfile_Code_DS7b
ollama create code_ds8b -f Modelfile_Code_DS8b
ollama create code_ds14b -f Modelfile_Code_DS14b
ollama create code_ds32b -f Modelfile_Code_DS32b
ollama create code_ds70b -f Modelfile_Code_DS70b
```