Add DeepswapLLM banner to model card
Browse files
README.md
CHANGED
|
@@ -15,6 +15,10 @@ base_model: mistralai/Mistral-7B-Instruct-v0.3
|
|
| 15 |
pipeline_tag: text-generation
|
| 16 |
---
|
| 17 |
|
|
|
|
|
|
|
|
|
|
|
|
|
| 18 |
# Mistral-7B-Instruct-v0.3-Jbliterated v2
|
| 19 |
|
| 20 |
Jbliterated version of [Mistral-7B-Instruct-v0.3](https://huggingface.co/mistralai/Mistral-7B-Instruct-v0.3) with refusal behaviors removed via multi-direction SVD abliteration.
|
|
|
|
| 15 |
pipeline_tag: text-generation
|
| 16 |
---
|
| 17 |
|
| 18 |
+
[](https://github.com/apolloraines/DeepswapLLM)
|
| 19 |
+
|
| 20 |
+
**Run this model on a GPU too small to hold it** — full precision, no quantization. [DeepswapLLM](https://github.com/apolloraines/DeepswapLLM) streams layers across GPU, RAM, and disk, and runs up to **4x faster than AirLLM**.
|
| 21 |
+
|
| 22 |
# Mistral-7B-Instruct-v0.3-Jbliterated v2
|
| 23 |
|
| 24 |
Jbliterated version of [Mistral-7B-Instruct-v0.3](https://huggingface.co/mistralai/Mistral-7B-Instruct-v0.3) with refusal behaviors removed via multi-direction SVD abliteration.
|