hooking/Instructions_FT_v1
Viewer • Updated • 1M • 13
Andrei Ross
ross-dev
AI & ML interests
None yet
Recent Activity
new activity about 1 month ago
ross-dev/sexyGPT-Uncensored:Update config.json published a dataset about 2 months ago
hooking/Instructions_FT_v1 published a dataset about 2 months ago
hooking/Instructions_Code_v1Organizations
Update config.json
2
#6 opened 3 months ago
by 
ChoLuckyHexSexySuccubusQueen135Age
published 3
datasets about 2 months ago
updated a
Space about 2 months ago
Request: DOI
1
#2 opened 4 months ago
by 
boylnwzav1
Looking for a cooperation.
2
#1 opened 7 months ago
by ross-dev
updated 2
models 5 months ago
published 2
models 5 months ago
updated a
model 7 months ago
Update README.md
2
#5 opened 7 months ago
by 
mohammedmim
liked a
model 7 months ago
reacted to hba123's post with 🚀 7 months ago
Post
2223
Hey, amazing, awesome people of the beautiful internet 😍🥰
Distillation has been (from my point of view) a main driving factor for the success of hashtag#LLMs - like distilling the knowledge of an amazing big model (say hashtag#DeepSeekv3, or hashtag#GeminiAI) into yours.
Probably, you have done it with minimising a KL divergence, and it somehow worked.
Well, not that well, right?
1️⃣ Your model tends to memorise!
2️⃣ Your model might get the right answer, but its reasoning might be flawed.
To fix those problems, we rethink distillation and process a new approach! A method that is based on constrained RL that comes with nice theoretical guarantees and excellent performance!
Check it out: Rethinking Large Language Model Distillation: A Constrained Markov Decision Process Perspective (2509.22921)
Let us do distillation right! Please upvote if you find it useful!
Distillation has been (from my point of view) a main driving factor for the success of hashtag#LLMs - like distilling the knowledge of an amazing big model (say hashtag#DeepSeekv3, or hashtag#GeminiAI) into yours.
Probably, you have done it with minimising a KL divergence, and it somehow worked.
Well, not that well, right?
1️⃣ Your model tends to memorise!
2️⃣ Your model might get the right answer, but its reasoning might be flawed.
To fix those problems, we rethink distillation and process a new approach! A method that is based on constrained RL that comes with nice theoretical guarantees and excellent performance!
Check it out: Rethinking Large Language Model Distillation: A Constrained Markov Decision Process Perspective (2509.22921)
Let us do distillation right! Please upvote if you find it useful!
Let's agree to AGREE!! :)
reacted to giadap's post with 👍 7 months ago
Post
11099
One of the hardest challenges in AI safety is finding the right balance: how do we protect people from harm without undermining their agency? This tension is especially visible in conversational systems, where safeguards can sometimes feel more paternalistic than supportive.
In my latest piece for Hugging Face, I argue that open source and community-driven approaches offer a promising (though not exclusive) way forward.
✨ Transparency can make safety mechanisms into learning opportunities.
✨ Collaboration with diverse communities makes safeguards more relevant across contexts.
✨ Iteration in the open lets protections evolve rather than freeze into rigid, one-size-fits-all rules.
Of course, this isn’t a silver bullet. Top-down safety measures will still be necessary in some cases. But if we only rely on corporate control, we risk building systems that are safe at the expense of trust and autonomy.
Read the blog post here: https://huggingface.co/blog/giadap/preserving-agency
In my latest piece for Hugging Face, I argue that open source and community-driven approaches offer a promising (though not exclusive) way forward.
✨ Transparency can make safety mechanisms into learning opportunities.
✨ Collaboration with diverse communities makes safeguards more relevant across contexts.
✨ Iteration in the open lets protections evolve rather than freeze into rigid, one-size-fits-all rules.
Of course, this isn’t a silver bullet. Top-down safety measures will still be necessary in some cases. But if we only rely on corporate control, we risk building systems that are safe at the expense of trust and autonomy.
Read the blog post here: https://huggingface.co/blog/giadap/preserving-agency
- 7 replies
You know, I always wondered, what will become if we will start training AI "as" a human by mindset, and not as a "separated" entity that can either be a thread or perceive us as threads.
The ONLY way to ensure the future is to work together as people and not companies, as humans with tools, not corporations with weapons.
to be able to guarantee tour species safety, is to work as one and as a community or specie.
updated a
model 7 months ago
published a
model 7 months ago