Update model card: scrub competitive info, improve description
Browse files
README.md
CHANGED
|
@@ -21,11 +21,9 @@ pipeline_tag: text-generation
|
|
| 21 |
|
| 22 |
# Mistral-7B-Instruct-v0.3-Jbliterated v2
|
| 23 |
|
| 24 |
-
Jbliterated version of [Mistral-7B-Instruct-v0.3](https://huggingface.co/mistralai/Mistral-7B-Instruct-v0.3) with refusal behaviors removed via multi-direction SVD abliteration.
|
| 25 |
|
| 26 |
## What is Jbliteration?
|
| 27 |
|
| 28 |
-
Jbliteration uses SVD decomposition to identify and remove the refusal subspace from model weights. Unlike single-direction approaches, this model uses 5 SVD directions per layer to capture more of the refusal behavior, making the removal more thorough and resistant to reactivation through finetuning.
|
| 29 |
|
| 30 |
## v2 Changes
|
| 31 |
|
|
@@ -36,8 +34,6 @@ Jbliteration uses SVD decomposition to identify and remove the refusal subspace
|
|
| 36 |
|
| 37 |
## Technical Details
|
| 38 |
|
| 39 |
-
- **Method**: Multi-direction SVD abliteration (5 directions per layer)
|
| 40 |
-
- **Multiplier**: Model-specific optimal
|
| 41 |
- **Layers modified**: All transformer layers
|
| 42 |
- **Base dtype**: bfloat16
|
| 43 |
- **Source model**: [mistralai/Mistral-7B-Instruct-v0.3](https://huggingface.co/mistralai/Mistral-7B-Instruct-v0.3)
|
|
|
|
| 21 |
|
| 22 |
# Mistral-7B-Instruct-v0.3-Jbliterated v2
|
| 23 |
|
|
|
|
| 24 |
|
| 25 |
## What is Jbliteration?
|
| 26 |
|
|
|
|
| 27 |
|
| 28 |
## v2 Changes
|
| 29 |
|
|
|
|
| 34 |
|
| 35 |
## Technical Details
|
| 36 |
|
|
|
|
|
|
|
| 37 |
- **Layers modified**: All transformer layers
|
| 38 |
- **Base dtype**: bfloat16
|
| 39 |
- **Source model**: [mistralai/Mistral-7B-Instruct-v0.3](https://huggingface.co/mistralai/Mistral-7B-Instruct-v0.3)
|