Instructions to use Kebob/DeepSeek-TNG-R1T2-Chimera-IK_GGUF with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- llama.cpp
How to use Kebob/DeepSeek-TNG-R1T2-Chimera-IK_GGUF with llama.cpp:
Install (macOS, Linux)
curl -LsSf https://llama.app/install.sh | sh # Start a local OpenAI-compatible server with a web UI: llama serve -hf Kebob/DeepSeek-TNG-R1T2-Chimera-IK_GGUF:IQ4_XS_R # Run inference directly in the terminal: llama cli -hf Kebob/DeepSeek-TNG-R1T2-Chimera-IK_GGUF:IQ4_XS_R
Install from WinGet (Windows)
winget install llama.cpp # Start a local OpenAI-compatible server with a web UI: llama serve -hf Kebob/DeepSeek-TNG-R1T2-Chimera-IK_GGUF:IQ4_XS_R # Run inference directly in the terminal: llama cli -hf Kebob/DeepSeek-TNG-R1T2-Chimera-IK_GGUF:IQ4_XS_R
Build from source code
git clone https://github.com/ggml-org/llama.cpp.git cd llama.cpp cmake -B build cmake --build build -j --target llama-app # Start a local OpenAI-compatible server with a web UI: ./build/bin/llama serve -hf Kebob/DeepSeek-TNG-R1T2-Chimera-IK_GGUF:IQ4_XS_R # Run inference directly in the terminal: ./build/bin/llama cli -hf Kebob/DeepSeek-TNG-R1T2-Chimera-IK_GGUF:IQ4_XS_R
Use Docker
docker model run hf.co/Kebob/DeepSeek-TNG-R1T2-Chimera-IK_GGUF:IQ4_XS_R
- Llama new
- LM Studio
- Jan
- Ollama
How to use Kebob/DeepSeek-TNG-R1T2-Chimera-IK_GGUF with Ollama:
ollama run hf.co/Kebob/DeepSeek-TNG-R1T2-Chimera-IK_GGUF:IQ4_XS_R
- Unsloth Desktop
- Docker Model Runner
How to use Kebob/DeepSeek-TNG-R1T2-Chimera-IK_GGUF with Docker Model Runner:
docker model run hf.co/Kebob/DeepSeek-TNG-R1T2-Chimera-IK_GGUF:IQ4_XS_R
- Lemonade
How to use Kebob/DeepSeek-TNG-R1T2-Chimera-IK_GGUF with Lemonade:
Pull the model
# Download Lemonade from https://lemonade-server.ai/ lemonade pull Kebob/DeepSeek-TNG-R1T2-Chimera-IK_GGUF:IQ4_XS_R
Run and chat with the model
lemonade run user.DeepSeek-TNG-R1T2-Chimera-IK_GGUF-IQ4_XS_R
List all available models
lemonade list
- Atomic Chat
Upload folder using huggingface_hub
Browse files- .gitattributes +10 -0
- D-Q4_K_R4/DeepSeek-TNG-R1T2-Chimera-D-Q4_K_R4-00001-of-00010.gguf +3 -0
- D-Q4_K_R4/DeepSeek-TNG-R1T2-Chimera-D-Q4_K_R4-00002-of-00010.gguf +3 -0
- D-Q4_K_R4/DeepSeek-TNG-R1T2-Chimera-D-Q4_K_R4-00003-of-00010.gguf +3 -0
- D-Q4_K_R4/DeepSeek-TNG-R1T2-Chimera-D-Q4_K_R4-00004-of-00010.gguf +3 -0
- D-Q4_K_R4/DeepSeek-TNG-R1T2-Chimera-D-Q4_K_R4-00005-of-00010.gguf +3 -0
- D-Q4_K_R4/DeepSeek-TNG-R1T2-Chimera-D-Q4_K_R4-00006-of-00010.gguf +3 -0
- D-Q4_K_R4/DeepSeek-TNG-R1T2-Chimera-D-Q4_K_R4-00007-of-00010.gguf +3 -0
- D-Q4_K_R4/DeepSeek-TNG-R1T2-Chimera-D-Q4_K_R4-00008-of-00010.gguf +3 -0
- D-Q4_K_R4/DeepSeek-TNG-R1T2-Chimera-D-Q4_K_R4-00009-of-00010.gguf +3 -0
- D-Q4_K_R4/DeepSeek-TNG-R1T2-Chimera-D-Q4_K_R4-00010-of-00010.gguf +3 -0
.gitattributes
CHANGED
|
@@ -42,3 +42,13 @@ D-IQ4_KS_R4/DeepSeek-TNG-R1T2-Chimera-D-IQ4_KS_R4-00006-of-00009.gguf filter=lfs
|
|
| 42 |
D-IQ4_KS_R4/DeepSeek-TNG-R1T2-Chimera-D-IQ4_KS_R4-00007-of-00009.gguf filter=lfs diff=lfs merge=lfs -text
|
| 43 |
D-IQ4_KS_R4/DeepSeek-TNG-R1T2-Chimera-D-IQ4_KS_R4-00008-of-00009.gguf filter=lfs diff=lfs merge=lfs -text
|
| 44 |
D-IQ4_KS_R4/DeepSeek-TNG-R1T2-Chimera-D-IQ4_KS_R4-00009-of-00009.gguf filter=lfs diff=lfs merge=lfs -text
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 42 |
D-IQ4_KS_R4/DeepSeek-TNG-R1T2-Chimera-D-IQ4_KS_R4-00007-of-00009.gguf filter=lfs diff=lfs merge=lfs -text
|
| 43 |
D-IQ4_KS_R4/DeepSeek-TNG-R1T2-Chimera-D-IQ4_KS_R4-00008-of-00009.gguf filter=lfs diff=lfs merge=lfs -text
|
| 44 |
D-IQ4_KS_R4/DeepSeek-TNG-R1T2-Chimera-D-IQ4_KS_R4-00009-of-00009.gguf filter=lfs diff=lfs merge=lfs -text
|
| 45 |
+
D-Q4_K_R4/DeepSeek-TNG-R1T2-Chimera-D-Q4_K_R4-00001-of-00010.gguf filter=lfs diff=lfs merge=lfs -text
|
| 46 |
+
D-Q4_K_R4/DeepSeek-TNG-R1T2-Chimera-D-Q4_K_R4-00002-of-00010.gguf filter=lfs diff=lfs merge=lfs -text
|
| 47 |
+
D-Q4_K_R4/DeepSeek-TNG-R1T2-Chimera-D-Q4_K_R4-00003-of-00010.gguf filter=lfs diff=lfs merge=lfs -text
|
| 48 |
+
D-Q4_K_R4/DeepSeek-TNG-R1T2-Chimera-D-Q4_K_R4-00004-of-00010.gguf filter=lfs diff=lfs merge=lfs -text
|
| 49 |
+
D-Q4_K_R4/DeepSeek-TNG-R1T2-Chimera-D-Q4_K_R4-00005-of-00010.gguf filter=lfs diff=lfs merge=lfs -text
|
| 50 |
+
D-Q4_K_R4/DeepSeek-TNG-R1T2-Chimera-D-Q4_K_R4-00006-of-00010.gguf filter=lfs diff=lfs merge=lfs -text
|
| 51 |
+
D-Q4_K_R4/DeepSeek-TNG-R1T2-Chimera-D-Q4_K_R4-00007-of-00010.gguf filter=lfs diff=lfs merge=lfs -text
|
| 52 |
+
D-Q4_K_R4/DeepSeek-TNG-R1T2-Chimera-D-Q4_K_R4-00008-of-00010.gguf filter=lfs diff=lfs merge=lfs -text
|
| 53 |
+
D-Q4_K_R4/DeepSeek-TNG-R1T2-Chimera-D-Q4_K_R4-00009-of-00010.gguf filter=lfs diff=lfs merge=lfs -text
|
| 54 |
+
D-Q4_K_R4/DeepSeek-TNG-R1T2-Chimera-D-Q4_K_R4-00010-of-00010.gguf filter=lfs diff=lfs merge=lfs -text
|
D-Q4_K_R4/DeepSeek-TNG-R1T2-Chimera-D-Q4_K_R4-00001-of-00010.gguf
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:acc445c1e0d23ee32de5c00e7e5e8ba653df6e70f6f91c2dbc701d019ef7ef1e
|
| 3 |
+
size 48737777664
|
D-Q4_K_R4/DeepSeek-TNG-R1T2-Chimera-D-Q4_K_R4-00002-of-00010.gguf
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:e5829800ae4ba082f2f1fd6d90664a27de653de1a039fd13c28d70a1e08351b0
|
| 3 |
+
size 48211901664
|
D-Q4_K_R4/DeepSeek-TNG-R1T2-Chimera-D-Q4_K_R4-00003-of-00010.gguf
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:d9f5bf10dc8268b406eca63a1cef182cd01b1070dc592dad9ceb61de67bc7d84
|
| 3 |
+
size 49862888480
|
D-Q4_K_R4/DeepSeek-TNG-R1T2-Chimera-D-Q4_K_R4-00004-of-00010.gguf
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:02a21d34258213e6e880425ce4697b2d37ef598ff3b2f0ddecb960f2f84800c9
|
| 3 |
+
size 48464843840
|
D-Q4_K_R4/DeepSeek-TNG-R1T2-Chimera-D-Q4_K_R4-00005-of-00010.gguf
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:2b1b4e3d2d473790f023431b292e3a1d4d02c1201d113b0c0407c3fd4b4cd97d
|
| 3 |
+
size 49862888480
|
D-Q4_K_R4/DeepSeek-TNG-R1T2-Chimera-D-Q4_K_R4-00006-of-00010.gguf
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:5837de68ca768d44f9e3473908ce725d09651994ad2118edff87e83b202828ce
|
| 3 |
+
size 48464843840
|
D-Q4_K_R4/DeepSeek-TNG-R1T2-Chimera-D-Q4_K_R4-00007-of-00010.gguf
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:f49a8e8262f640efb868b5f8a4c588c0084d9efbfc7fcb9f924eb986ef5a23ae
|
| 3 |
+
size 49862888480
|
D-Q4_K_R4/DeepSeek-TNG-R1T2-Chimera-D-Q4_K_R4-00008-of-00010.gguf
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:625e2415b1ccb3cd732d2aa8cc58b1ca6ab60d0ed54c914a7c43f7b4a39395ab
|
| 3 |
+
size 48464843840
|
D-Q4_K_R4/DeepSeek-TNG-R1T2-Chimera-D-Q4_K_R4-00009-of-00010.gguf
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:1b5cffe52b98cdb3e37b6937cffe730ff5ab20eee7ecc1dc7cc9799943951f02
|
| 3 |
+
size 48480556128
|
D-Q4_K_R4/DeepSeek-TNG-R1T2-Chimera-D-Q4_K_R4-00010-of-00010.gguf
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:8d7b1ead5ccfe06d8483f803a9a616d4d940b2503b647c07f78b5e943fcf032f
|
| 3 |
+
size 2113986848
|