Yusuf Chowdury
Yusufchy
AI & ML interests
AI agents, open-weight models, machine learning, MLOps, developer tools, AI automation, and AI-assisted publishing.
Recent Activity
repliedto dronefreak's post 28 minutes ago
🌧️❄️ Free demo: remove rain, raindrops, or snow from a photo with a single model
I put together an unofficial demo for **Histoformer** (ECCV 2024, arXiv: 2407.10172), a 16.6M-parameter transformer that handles three different weather degradations, rain streaks, adherent raindrops, and snow, in one unified model. It uses a "histogram self-attention" mechanism that groups pixels by degradation intensity instead of spatial position, which is a
neat way to sidestep the usual spatial-window tradeoffs in restoration transformers.
Try it here, free on ZeroGPU: https://huggingface.co/spaces/dronefreak/histoformer-weather-restoration
Upload a photo and get a before/after slider. Two checkpoints available: one tuned for real-world photos, one for the paper's synthetic benchmarks.
Also put together a cleaner, easy-to-use model card with a copy-pasteable Quickstart if you'd rather run it yourself: https://huggingface.co/dronefreak/Histoformer
This is an unofficial demo/mirror, not affiliated with the original authors. All credit for the actual research goes to Shangquan Sun, Wenqi Ren, Xinwei Gao, Rui Wang, and Xiaochun Cao (@sunsean). Official repo: https://github.com/sunshangquan/Histoformer. Weights are MIT-licensed.
Reported numbers from the paper: 32.1 PSNR on rain+fog (Outdoor-Rain), 33.1 on raindrops, 37.4 / 32.2 on light/heavy snow (Snow100K-S/L). repliedto Banaxi-Tech's post about 21 hours ago
Today we wanted to release BananaMind 2 Pico, our smallest model yet at ~0.9M parameters. Instead, we accidentally ran a very expensive experiment on what happens when you push a tiny model way past its useful token budget.
Short version: we trained on 200B tokens (~222K:1 tokens-per-parameter). The model peaked at 20B tokens with an INT Index of 4.55, then degraded monotonically over the next 160B to 3.31 — a 27% regression. Three of four Open SLM benchmarks were worse at the end of training than they were at 10% through.
The useful compute-optimal range for Pico-tier models looks like ~22K–30K tokens per parameter. Ratios like 7K:1, 15K:1, and 22K:1 all work fine — TinyStories and most sub-3M community models sit in this range. Push much further and benchmarks start rotting.
Follow us for more:
https://huggingface.co/BananaMind
@vovaRL
@Banaxi-Tech
Full writeup with all checkpoints, the Chinchilla-ratio control run, and the schedule-vs-overtraining analysis: https://huggingface.co/blog/Banaxi-Tech/ovdadadadd
And if anyone, i dont know the reason why you would, wants the 20B token checkpoint reply and ill upload it as BananaMind 2.1 Pico EXPOrganizations
None yet