DrJohnCode/NebulaText
Text Generation • Updated • 37 • 2
John Code PRO
DrJohnCode
·
AI & ML interests
AI, ML, CS, LLMS
Recent Activity
reacted to juiceb0xc0de's post with 🔥 about 13 hours ago
You built a model. Wanna know what lights up inside it?💡
I put a little juice in the box so you can find out!🧃
I built Cartographics, a HF ZeroGPU Space for building neural activation atlases of language models.
I wanted to make the tools I use to explore model internals accessible to people building their own LLMs. Punch in a Hugging Face model ID, run the compatibility check, and start a capture. Prompt formatting and the full corpus are handled automatically.
The atlases help you investigate questions like:
- Which layers and channels respond most strongly to different kinds of prompts?
- How do activation patterns vary across code, math, reasoning, and other topics?
- Which features activate together, and where do unusually strong activations appear?
The census contains 8,965 prompts, giving you a shared basis for exploring different models.
GPU capture runs through ZeroGPU using your account’s allowance. I handle the CPU analysis separately. This release supports compatible architectures and models that fit the available GPU memory.
I’m building this independently, and I’d love to see what models builders explore with it.
What would you want to investigate in your own model?
Try Cartographics Beta:
https://huggingface.co/spaces/juiceb0xc0de/cartographics
https://huggingface.co/datasets/juiceb0xc0de/bella-bartender-gemma-e4b-cgs-atlas
If you make an atlas with us, leave the Space a ❤️. You're helping other people discover mechanistic interpretability the way I wish I did.
Prerequisites:
Models under 10B parameters (20GB of weights in bf16)
No trust_remote_code models, for now.
Preflight catches edge cases. Don't be scared to test it out. It's free to check.
Sign in with Hugging Face. The capture runs on your ZeroGPU quota, the atlas build runs on ours. published an article about 13 hours ago
Are We Moving Toward a Future Where AI Models Train Other AI Models? posted an update about 13 hours ago
# Why AI Agents Are Becoming the Next Big Frontier in Machine Learning
For years, the focus of AI development has been on making language models better at generating responses.
But an important shift is happening: **AI systems are increasingly being designed to take actions, use tools, and complete complex workflows.**
Instead of simply answering a question, an AI agent might search through documents, execute code, interact with APIs, and evaluate its own results.
This introduces an entirely different set of challenges.
**Three areas I think will become increasingly important:**
**1. Reliable Tool Use**
Knowing when to call a tool is just as important as knowing how to use it. Models need to distinguish between tasks they can answer directly and tasks requiring external information or computation.
**2. Long-Horizon Planning**
Completing a task involving 20 steps is fundamentally different from generating a single response. Agents must maintain context, recover from errors, and adapt when earlier assumptions prove incorrect.
**3. Verification and Self-Correction**
An agent that can execute code isn't necessarily an agent that can write correct code. Reliable systems need ways to evaluate outputs, detect failures, and revise their approach.
One of the most interesting research questions is whether better agent capabilities will come primarily from larger foundation models or from improvements in training data, evaluation environments, and tool integration.
My guess is that the biggest improvements will come from combining all three.
**What do you think is currently the biggest bottleneck for AI agents: reasoning, memory, tool reliability, or evaluation?**
#AI #MachineLearning #AIAgents #LLM #OpenSourceOrganizations
None yet