How to use from
SGLang
Install from pip and serve model
# Install SGLang from pip:
pip install sglang
# Start the SGLang server:
python3 -m sglang.launch_server \
    --model-path "adamkarvonen/qwen3_8b_selfexpl_first_person_e3_kl0" \
    --host 0.0.0.0 \
    --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "adamkarvonen/qwen3_8b_selfexpl_first_person_e3_kl0",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'
Use Docker images
docker run --gpus all \
    --shm-size 32g \
    -p 30000:30000 \
    -v ~/.cache/huggingface:/root/.cache/huggingface \
    --env "HF_TOKEN=<secret>" \
    --ipc=host \
    lmsysorg/sglang:latest \
    python3 -m sglang.launch_server \
        --model-path "adamkarvonen/qwen3_8b_selfexpl_first_person_e3_kl0" \
        --host 0.0.0.0 \
        --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "adamkarvonen/qwen3_8b_selfexpl_first_person_e3_kl0",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'
Quick Links

qwen3_8b_selfexpl_first_person_e3_kl0

Qwen3-8B trained to explain its own behavior as a short first-person paragraph instead of the structured report (App. I target ablation).

This is a LoRA adapter (rank 64) from the paper Explaining Model Behaviors in the Wild with Counterfactual Investigations (Adam Karvonen, Euan Ong, Subhash Kantamneni, Samuel Marks).

Usage

from peft import PeftModel
from transformers import AutoModelForCausalLM, AutoTokenizer

base = AutoModelForCausalLM.from_pretrained("Qwen/Qwen3-8B", torch_dtype="auto", device_map="auto")
model = PeftModel.from_pretrained(base, "adamkarvonen/qwen3_8b_selfexpl_first_person_e3_kl0")
tokenizer = AutoTokenizer.from_pretrained("Qwen/Qwen3-8B")

License

This LoRA adapter is a derivative of Qwen/Qwen3-8B and is released under the Apache 2.0 license. Its training data is derived from multiple upstream sources with their own terms β€” see the dataset card for the full license/attribution table (WildChat is ODC-BY and requires attribution).

Framework versions

  • PEFT 0.19.1
Downloads last month
12
Inference Providers NEW
This model isn't deployed by any Inference Provider. πŸ™‹ Ask for provider support

Model tree for adamkarvonen/qwen3_8b_selfexpl_first_person_e3_kl0

Finetuned
Qwen/Qwen3-8B
Adapter
(2,469)
this model

Collection including adamkarvonen/qwen3_8b_selfexpl_first_person_e3_kl0