Instructions to use Kebob/DeepSeek-TNG-R1T2-Chimera-IK_GGUF with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- llama.cpp
How to use Kebob/DeepSeek-TNG-R1T2-Chimera-IK_GGUF with llama.cpp:
Install (macOS, Linux)
curl -LsSf https://llama.app/install.sh | sh # Start a local OpenAI-compatible server with a web UI: llama serve -hf Kebob/DeepSeek-TNG-R1T2-Chimera-IK_GGUF:IQ4_XS_R # Run inference directly in the terminal: llama cli -hf Kebob/DeepSeek-TNG-R1T2-Chimera-IK_GGUF:IQ4_XS_R
Install from WinGet (Windows)
winget install llama.cpp # Start a local OpenAI-compatible server with a web UI: llama serve -hf Kebob/DeepSeek-TNG-R1T2-Chimera-IK_GGUF:IQ4_XS_R # Run inference directly in the terminal: llama cli -hf Kebob/DeepSeek-TNG-R1T2-Chimera-IK_GGUF:IQ4_XS_R
Build from source code
git clone https://github.com/ggml-org/llama.cpp.git cd llama.cpp cmake -B build cmake --build build -j --target llama-app # Start a local OpenAI-compatible server with a web UI: ./build/bin/llama serve -hf Kebob/DeepSeek-TNG-R1T2-Chimera-IK_GGUF:IQ4_XS_R # Run inference directly in the terminal: ./build/bin/llama cli -hf Kebob/DeepSeek-TNG-R1T2-Chimera-IK_GGUF:IQ4_XS_R
Use Docker
docker model run hf.co/Kebob/DeepSeek-TNG-R1T2-Chimera-IK_GGUF:IQ4_XS_R
- Llama new
- LM Studio
- Jan
- Ollama
How to use Kebob/DeepSeek-TNG-R1T2-Chimera-IK_GGUF with Ollama:
ollama run hf.co/Kebob/DeepSeek-TNG-R1T2-Chimera-IK_GGUF:IQ4_XS_R
- Unsloth Desktop
- Docker Model Runner
How to use Kebob/DeepSeek-TNG-R1T2-Chimera-IK_GGUF with Docker Model Runner:
docker model run hf.co/Kebob/DeepSeek-TNG-R1T2-Chimera-IK_GGUF:IQ4_XS_R
- Lemonade
How to use Kebob/DeepSeek-TNG-R1T2-Chimera-IK_GGUF with Lemonade:
Pull the model
# Download Lemonade from https://lemonade-server.ai/ lemonade pull Kebob/DeepSeek-TNG-R1T2-Chimera-IK_GGUF:IQ4_XS_R
Run and chat with the model
lemonade run user.DeepSeek-TNG-R1T2-Chimera-IK_GGUF-IQ4_XS_R
List all available models
lemonade list
- Atomic Chat
Upload folder using huggingface_hub
Browse files- .gitattributes +10 -0
- IQ4_XS_R8/DeepSeek-TNG-R1T2-Chimera-IQ4_XS_R8-00001-of-00008.gguf +3 -0
- IQ4_XS_R8/DeepSeek-TNG-R1T2-Chimera-IQ4_XS_R8-00001-of-00008.gguf.Kebob +3 -0
- IQ4_XS_R8/DeepSeek-TNG-R1T2-Chimera-IQ4_XS_R8-00001-of-00008.gguf.orig +3 -0
- IQ4_XS_R8/DeepSeek-TNG-R1T2-Chimera-IQ4_XS_R8-00002-of-00008.gguf +3 -0
- IQ4_XS_R8/DeepSeek-TNG-R1T2-Chimera-IQ4_XS_R8-00003-of-00008.gguf +3 -0
- IQ4_XS_R8/DeepSeek-TNG-R1T2-Chimera-IQ4_XS_R8-00004-of-00008.gguf +3 -0
- IQ4_XS_R8/DeepSeek-TNG-R1T2-Chimera-IQ4_XS_R8-00005-of-00008.gguf +3 -0
- IQ4_XS_R8/DeepSeek-TNG-R1T2-Chimera-IQ4_XS_R8-00006-of-00008.gguf +3 -0
- IQ4_XS_R8/DeepSeek-TNG-R1T2-Chimera-IQ4_XS_R8-00007-of-00008.gguf +3 -0
- IQ4_XS_R8/DeepSeek-TNG-R1T2-Chimera-IQ4_XS_R8-00008-of-00008.gguf +3 -0
.gitattributes
CHANGED
|
@@ -52,3 +52,13 @@ D-Q4_K_R4/DeepSeek-TNG-R1T2-Chimera-D-Q4_K_R4-00007-of-00010.gguf filter=lfs dif
|
|
| 52 |
D-Q4_K_R4/DeepSeek-TNG-R1T2-Chimera-D-Q4_K_R4-00008-of-00010.gguf filter=lfs diff=lfs merge=lfs -text
|
| 53 |
D-Q4_K_R4/DeepSeek-TNG-R1T2-Chimera-D-Q4_K_R4-00009-of-00010.gguf filter=lfs diff=lfs merge=lfs -text
|
| 54 |
D-Q4_K_R4/DeepSeek-TNG-R1T2-Chimera-D-Q4_K_R4-00010-of-00010.gguf filter=lfs diff=lfs merge=lfs -text
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 52 |
D-Q4_K_R4/DeepSeek-TNG-R1T2-Chimera-D-Q4_K_R4-00008-of-00010.gguf filter=lfs diff=lfs merge=lfs -text
|
| 53 |
D-Q4_K_R4/DeepSeek-TNG-R1T2-Chimera-D-Q4_K_R4-00009-of-00010.gguf filter=lfs diff=lfs merge=lfs -text
|
| 54 |
D-Q4_K_R4/DeepSeek-TNG-R1T2-Chimera-D-Q4_K_R4-00010-of-00010.gguf filter=lfs diff=lfs merge=lfs -text
|
| 55 |
+
IQ4_XS_R8/DeepSeek-TNG-R1T2-Chimera-IQ4_XS_R8-00001-of-00008.gguf filter=lfs diff=lfs merge=lfs -text
|
| 56 |
+
IQ4_XS_R8/DeepSeek-TNG-R1T2-Chimera-IQ4_XS_R8-00001-of-00008.gguf.Kebob filter=lfs diff=lfs merge=lfs -text
|
| 57 |
+
IQ4_XS_R8/DeepSeek-TNG-R1T2-Chimera-IQ4_XS_R8-00001-of-00008.gguf.orig filter=lfs diff=lfs merge=lfs -text
|
| 58 |
+
IQ4_XS_R8/DeepSeek-TNG-R1T2-Chimera-IQ4_XS_R8-00002-of-00008.gguf filter=lfs diff=lfs merge=lfs -text
|
| 59 |
+
IQ4_XS_R8/DeepSeek-TNG-R1T2-Chimera-IQ4_XS_R8-00003-of-00008.gguf filter=lfs diff=lfs merge=lfs -text
|
| 60 |
+
IQ4_XS_R8/DeepSeek-TNG-R1T2-Chimera-IQ4_XS_R8-00004-of-00008.gguf filter=lfs diff=lfs merge=lfs -text
|
| 61 |
+
IQ4_XS_R8/DeepSeek-TNG-R1T2-Chimera-IQ4_XS_R8-00005-of-00008.gguf filter=lfs diff=lfs merge=lfs -text
|
| 62 |
+
IQ4_XS_R8/DeepSeek-TNG-R1T2-Chimera-IQ4_XS_R8-00006-of-00008.gguf filter=lfs diff=lfs merge=lfs -text
|
| 63 |
+
IQ4_XS_R8/DeepSeek-TNG-R1T2-Chimera-IQ4_XS_R8-00007-of-00008.gguf filter=lfs diff=lfs merge=lfs -text
|
| 64 |
+
IQ4_XS_R8/DeepSeek-TNG-R1T2-Chimera-IQ4_XS_R8-00008-of-00008.gguf filter=lfs diff=lfs merge=lfs -text
|
IQ4_XS_R8/DeepSeek-TNG-R1T2-Chimera-IQ4_XS_R8-00001-of-00008.gguf
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:8307986941e90c58245495d2328061d674d6cb00495f2faf2c145c579ef84f95
|
| 3 |
+
size 48796555680
|
IQ4_XS_R8/DeepSeek-TNG-R1T2-Chimera-IQ4_XS_R8-00001-of-00008.gguf.Kebob
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:8307986941e90c58245495d2328061d674d6cb00495f2faf2c145c579ef84f95
|
| 3 |
+
size 48796555680
|
IQ4_XS_R8/DeepSeek-TNG-R1T2-Chimera-IQ4_XS_R8-00001-of-00008.gguf.orig
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:2e0ba96f29e034c9cebe9b760aa5871fd9c76dda944657702f4d0ca354654809
|
| 3 |
+
size 48796555680
|
IQ4_XS_R8/DeepSeek-TNG-R1T2-Chimera-IQ4_XS_R8-00002-of-00008.gguf
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:f925c6dcdcc6fab4926e91543aa55a5880c0e9068619fe26d3c7668c4542ceed
|
| 3 |
+
size 49939727616
|
IQ4_XS_R8/DeepSeek-TNG-R1T2-Chimera-IQ4_XS_R8-00003-of-00008.gguf
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:9ae4a71978d956898e59e28e61f50c269a107787065657750aebe2d024d75a40
|
| 3 |
+
size 49939727616
|
IQ4_XS_R8/DeepSeek-TNG-R1T2-Chimera-IQ4_XS_R8-00004-of-00008.gguf
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:e54f8bb0dc6b6f4596f44fb5b3be27af4546dd5f54982b3939dabc7f1281da36
|
| 3 |
+
size 49939727616
|
IQ4_XS_R8/DeepSeek-TNG-R1T2-Chimera-IQ4_XS_R8-00005-of-00008.gguf
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:686b83aa21ee06bcad27a5735374a4e300c3cdc0ff3d3de29366ccd868643d9b
|
| 3 |
+
size 49939727616
|
IQ4_XS_R8/DeepSeek-TNG-R1T2-Chimera-IQ4_XS_R8-00006-of-00008.gguf
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:e6f6e3c89a9fced9d0ebc1f9cfe2e286ed7a6f5f1406307a026b4941f17ce98f
|
| 3 |
+
size 49939727616
|
IQ4_XS_R8/DeepSeek-TNG-R1T2-Chimera-IQ4_XS_R8-00007-of-00008.gguf
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:600b8666efa60e472cac45383711e3570d0eedb2811ed1ddb1acde750ca40607
|
| 3 |
+
size 49939727616
|
IQ4_XS_R8/DeepSeek-TNG-R1T2-Chimera-IQ4_XS_R8-00008-of-00008.gguf
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:381d191e14a23bf070e4efea3a72e19dc95389c71a6f560715b4c080a14b97a0
|
| 3 |
+
size 17462563520
|