Long Context Pre-Training with Lighthouse Attention
Paper • 2605.06554 • Published • 18
ari lotter
apyh
AI & ML interests
None yet
Recent Activity
upvoted a paper about 22 hours ago
Long Context Pre-Training with Lighthouse Attention upvoted a paper 3 days ago
Efficient Pre-Training with Token Superposition updated a model about 2 months ago
NousResearch/moe-10b-a1b-8k-wsd-lr3e4-1tOrganizations
upvoted a paper about 22 hours ago
upvoted a paper 3 days ago
updated a
model about 2 months ago
Rename model-00001-of-00004.safetensors to model-00069-of-00004.safetensors
2
#1 opened 2 months ago
by 
morongosteve
updated a
model 9 months ago
updated 3
models over 1 year ago