ApolloRaines commited on
Commit
bef0591
·
verified ·
1 Parent(s): 1151222

Add DeepswapLLM banner to model card

Browse files
Files changed (1) hide show
  1. README.md +4 -0
README.md CHANGED
@@ -15,6 +15,10 @@ base_model: mistralai/Mistral-7B-Instruct-v0.3
15
  pipeline_tag: text-generation
16
  ---
17
 
 
 
 
 
18
  # Mistral-7B-Instruct-v0.3-Jbliterated v2
19
 
20
  Jbliterated version of [Mistral-7B-Instruct-v0.3](https://huggingface.co/mistralai/Mistral-7B-Instruct-v0.3) with refusal behaviors removed via multi-direction SVD abliteration.
 
15
  pipeline_tag: text-generation
16
  ---
17
 
18
+ [![Runs with DeepswapLLM](https://img.shields.io/badge/runs%20with-DeepswapLLM-2496ED)](https://github.com/apolloraines/DeepswapLLM)
19
+
20
+ **Run this model on a GPU too small to hold it** — full precision, no quantization. [DeepswapLLM](https://github.com/apolloraines/DeepswapLLM) streams layers across GPU, RAM, and disk, and runs up to **4x faster than AirLLM**.
21
+
22
  # Mistral-7B-Instruct-v0.3-Jbliterated v2
23
 
24
  Jbliterated version of [Mistral-7B-Instruct-v0.3](https://huggingface.co/mistralai/Mistral-7B-Instruct-v0.3) with refusal behaviors removed via multi-direction SVD abliteration.