mengfanxu
fxmeng
AI & ML interests
None yet
Recent Activity
updated a collection 6 days ago
LatentIndex updated a collection 6 days ago
LatentIndex updated a model 6 days ago
fxmeng/DSV2-Lite-IndexCache-Sparse-1250Organizations
None yet
Principal Singular Values and Singular Vectors Adaptation
Principal Singular Values and Singular Vectors Adaptation
https://arxiv.org/abs/2404.02948
Base Model for TransMLA
Principal Singular Values and Singular Vectors Adaptation
Principal Singular Values and Singular Vectors Adaptation
-
fxmeng/PiSSA-Llama-2-7B-r16-4bit-5iter
Text Generation • 7B • Updated • 11 -
fxmeng/PiSSA-Llama-2-7B-r32-4bit-5iter
Text Generation • 7B • Updated • 11 -
fxmeng/PiSSA-Llama-2-7B-r64-4bit-5iter
Text Generation • 7B • Updated • 12 -
fxmeng/PiSSA-Llama-2-7B-r128-4bit-5iter
Text Generation • 7B • Updated • 12
Substructure of mistralai/Mixtral-8x7B-Instruct-v0.1
Base Model for TransMLA
Principal Singular Values and Singular Vectors Adaptation
Principal Singular Values and Singular Vectors Adaptation
Principal Singular Values and Singular Vectors Adaptation
-
fxmeng/PiSSA-Llama-2-7B-r16-4bit-5iter
Text Generation • 7B • Updated • 11 -
fxmeng/PiSSA-Llama-2-7B-r32-4bit-5iter
Text Generation • 7B • Updated • 11 -
fxmeng/PiSSA-Llama-2-7B-r64-4bit-5iter
Text Generation • 7B • Updated • 12 -
fxmeng/PiSSA-Llama-2-7B-r128-4bit-5iter
Text Generation • 7B • Updated • 12
Principal Singular Values and Singular Vectors Adaptation
https://arxiv.org/abs/2404.02948
Substructure of mistralai/Mixtral-8x7B-Instruct-v0.1