Article
Shipping a Trillion Parameters With a Hub Bucket: Delta Weight Sync in TRL
- +6
aminediroHF, qgallouedec, kashif, lewtun, edbeeching, albertvillanova, lvwerra, sergiopaniego
• • 36Amine Dirhoussi
aminediroHF
AI & ML interests
None yet
Recent Activity
published an article 6 days ago
Shipping a Trillion Parameters With a Hub Bucket: Delta Weight Sync in TRL updated a Space 10 days ago
aminediroHF/delta-weight-sync-figures updated a Space 10 days ago
aminediroHF/delta-weight-sync-anchor-deltaOrganizations
published an article 6 days ago
published an article 3 months ago
Article
Keep the Tokens Flowing: Lessons from 16 Open-Source RL Libraries
- +7
aminediroHF, qgallouedec, kashif, lewtun, edbeeching, albertvillanova, nouamanetazi, lvwerra, sergiopaniego
• • 159