Echo9Zulu commited on
Commit
01af52c
·
verified ·
1 Parent(s): 674a598

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +3 -3
README.md CHANGED
@@ -7,9 +7,9 @@ tags:
7
  - Optimum-Intel
8
  ---
9
 
10
- `Nanonets-OCR2-3B` is based on `Qwen2.5-VL-3B`, which ususally performs when quantization approaches keep vision encoder in full precision.
11
- My usecase involves dense table extraction; for now, I'll hypothesize Nanonet finetuning takes "pressure" off the language model component.
12
- To test this, I used instructions using instructions which do not deviate so much from training data.
13
 
14
  Based on the Qwen-VL papers, this behavior may echo QwenTeam training recipie for ViT and LLM components, where each part was trained seperately, then ViT was frozen, the language model was merged.
15
 
 
7
  - Optimum-Intel
8
  ---
9
 
10
+ `Nanonets-OCR2-3B` is based on `Qwen2.5-VL-3B`, which ususally performs better when quantization approaches keep the vision encoder in full precision.
11
+ My usecase involves dense table extraction; for now, I'll hypothesize Nanonet finetuning takes "pressure" off the language model component so keeping vision encoder in higher precision retains more understanding of vision tokens, which represent information differently than text tokens.
12
+ To test this, I used instructions which do not deviate so much from training data, which Nanonets reccomends in their examples.
13
 
14
  Based on the Qwen-VL papers, this behavior may echo QwenTeam training recipie for ViT and LLM components, where each part was trained seperately, then ViT was frozen, the language model was merged.
15