Fix usage instructions: correct model class / plugin guidance, English-only

README.md

@@ -7,27 +7,35 @@ tags:
 - camera-movement
 - video-understanding
 - qwen3-vl
-- sft
 - distillation
 ---
 
 # CamDistill-4B
 
-Camera-movement 蒸馏 SFT 微调模型，基于 `Qwen/Qwen3-VL-4B-Instruct`。
+Camera-movement understanding model trained with **Camera Token Distillation** on top of
+`Qwen/Qwen3-VL-4B-Instruct`. A lightweight Camera Token Module learns geometry-aware camera
+tokens (distilled from VGGT) and injects them into the language model. Given a video, it outputs
+structured JSON describing every camera-movement segment.
 
-- Checkpoint: `checkpoint-1326`
-- 训练框架: [ms-swift](https://github.com/modelscope/ms-swift)
+- **Paper**: [Temporally Grounded Compositional Camera Motion Understanding via Geometric Knowledge Distillation](https://huggingface.co/papers/2608.10932)
+- **Project page**: https://ddz16.github.io/cammotion.github.io
+- **Code**: https://github.com/ddz16/CamDistill
 
-## 使用
+> ⚠️ **This model cannot be loaded with plain 🤗 Transformers.** It contains an extra Camera Token
+> Module and a patched forward pass. Loading it as a standard `Qwen3VLForConditionalGeneration`
+> would silently drop those weights and produce incorrect results. Use the CamDistill repo, which
+> registers the required custom model type through a plugin.
 
-```python
-from transformers import AutoModelForCausalLM, AutoProcessor
-model = AutoModelForCausalLM.from_pretrained("ddz16/CamDistill-4B", torch_dtype="bfloat16", device_map="auto")
-processor = AutoProcessor.from_pretrained("ddz16/CamDistill-4B")
-```
+## Usage
 
-## Links
+Clone the [CamDistill repo](https://github.com/ddz16/CamDistill), then run (camera tokens are generated internally — **no online
+VGGT required**):
 
-- **Paper**: [Temporally Grounded Compositional Camera Motion Understanding via Geometric Knowledge Distillation](https://huggingface.co/papers/2608.10932)
-- **Project page**: [https://ddz16.github.io/cammotion.github.io](https://ddz16.github.io/cammotion.github.io)
-- **GitHub**: [https://github.com/ddz16/CamDistill](https://github.com/ddz16/CamDistill)
+```bash
+python camera_movement_sft/infer_single.py \
+    --model ddz16/CamDistill-4B \
+    --video /path/to/video.mp4 \
+    --variant camdistill
+```
+
+See the repo's README for environment setup and batch evaluation.