The MHA2MLA-VLM model published in the paper "MHA2MLA-VLM: Enabling DeepSeek's Economical Multi-Head Latent Attention across Vision-Language Models"
Xiaoran Fan
cnxup
AI & ML interests
NLP, CV, LLM
Recent Activity
liked a dataset 9 days ago
sysuyy/ImgEdit liked a model about 1 month ago
cnxup/LLaVA-NeXT-8B-MLA-stage2-rope32-d_kv_128 liked a model about 1 month ago
cnxup/LLaVA-NeXT-8B-MLA-stage2-rope32-d_kv_32Organizations
None yet
models 9
cnxup/LLaVA-NeXT-8B-MLA-stage1-rope32
8B • Updated • 6 • 1
cnxup/LLaVA-NeXT-8B-MLA-stage2-rope32-d_kv_32
8B • Updated • 9 • 1
cnxup/LLaVA-NeXT-8B-MLA-stage2-rope32-d_kv_64
8B • Updated • 6 • 1
cnxup/LLaVA-NeXT-8B-MLA-stage2-rope32-d_kv_128
9B • Updated • 6 • 1
cnxup/SVD-Init
Updated • 1
cnxup/Qwen2.5-VL-7B-MLA-stage2-rope32-d_kv_128
8B • Updated • 139 • 1
cnxup/Qwen2.5-VL-7B-MLA-stage2-rope32-d_kv_64
8B • Updated • 8 • 1
cnxup/Qwen2.5-VL-7B-MLA-stage2-rope32-d_kv_32
8B • Updated • 2 • 1
cnxup/Qwen2.5-VL-7B-MLA-stage1-rope32
8B • Updated • 208 • 1