ApolloRaines commited on
Commit
65d460f
·
verified ·
1 Parent(s): bef0591

Update model card: scrub competitive info, improve description

Browse files
Files changed (1) hide show
  1. README.md +0 -4
README.md CHANGED
@@ -21,11 +21,9 @@ pipeline_tag: text-generation
21
 
22
  # Mistral-7B-Instruct-v0.3-Jbliterated v2
23
 
24
- Jbliterated version of [Mistral-7B-Instruct-v0.3](https://huggingface.co/mistralai/Mistral-7B-Instruct-v0.3) with refusal behaviors removed via multi-direction SVD abliteration.
25
 
26
  ## What is Jbliteration?
27
 
28
- Jbliteration uses SVD decomposition to identify and remove the refusal subspace from model weights. Unlike single-direction approaches, this model uses 5 SVD directions per layer to capture more of the refusal behavior, making the removal more thorough and resistant to reactivation through finetuning.
29
 
30
  ## v2 Changes
31
 
@@ -36,8 +34,6 @@ Jbliteration uses SVD decomposition to identify and remove the refusal subspace
36
 
37
  ## Technical Details
38
 
39
- - **Method**: Multi-direction SVD abliteration (5 directions per layer)
40
- - **Multiplier**: Model-specific optimal
41
  - **Layers modified**: All transformer layers
42
  - **Base dtype**: bfloat16
43
  - **Source model**: [mistralai/Mistral-7B-Instruct-v0.3](https://huggingface.co/mistralai/Mistral-7B-Instruct-v0.3)
 
21
 
22
  # Mistral-7B-Instruct-v0.3-Jbliterated v2
23
 
 
24
 
25
  ## What is Jbliteration?
26
 
 
27
 
28
  ## v2 Changes
29
 
 
34
 
35
  ## Technical Details
36
 
 
 
37
  - **Layers modified**: All transformer layers
38
  - **Base dtype**: bfloat16
39
  - **Source model**: [mistralai/Mistral-7B-Instruct-v0.3](https://huggingface.co/mistralai/Mistral-7B-Instruct-v0.3)