How to use from
llama.cpp
Install (macOS, Linux)
curl -LsSf https://llama.app/install.sh | sh
# Start a local OpenAI-compatible server with a web UI:
llama serve -hf TribeBlend/tribeblend-etl-ministral3-3b-instruct:Q4_K_M
# Run inference directly in the terminal:
llama cli -hf TribeBlend/tribeblend-etl-ministral3-3b-instruct:Q4_K_M
Install from WinGet (Windows)
winget install llama.cpp
# Start a local OpenAI-compatible server with a web UI:
llama serve -hf TribeBlend/tribeblend-etl-ministral3-3b-instruct:Q4_K_M
# Run inference directly in the terminal:
llama cli -hf TribeBlend/tribeblend-etl-ministral3-3b-instruct:Q4_K_M
Use pre-built binary
# Download pre-built binary from:
# https://github.com/ggerganov/llama.cpp/releases
# Start a local OpenAI-compatible server with a web UI:
./llama-server -hf TribeBlend/tribeblend-etl-ministral3-3b-instruct:Q4_K_M
# Run inference directly in the terminal:
./llama-cli -hf TribeBlend/tribeblend-etl-ministral3-3b-instruct:Q4_K_M
Build from source code
git clone https://github.com/ggerganov/llama.cpp.git
cd llama.cpp
cmake -B build
cmake --build build -j --target llama-server llama-cli
# Start a local OpenAI-compatible server with a web UI:
./build/bin/llama-server -hf TribeBlend/tribeblend-etl-ministral3-3b-instruct:Q4_K_M
# Run inference directly in the terminal:
./build/bin/llama-cli -hf TribeBlend/tribeblend-etl-ministral3-3b-instruct:Q4_K_M
Use Docker
docker model run hf.co/TribeBlend/tribeblend-etl-ministral3-3b-instruct:Q4_K_M
Quick Links

tribeblend-etl-ministral3-3b-instruct

Ministral 3 3B Instruct fine-tuned for fast local analytics.

Direct base-model GGUF (Q4_K_M) of mistralai/Ministral-3-3B-Instruct-2512-BF16, published for TribeBlend's local Data Chat runtime. TribeBlend grounds answers with Knowledge Graph context at prompt time and a model-aware agent harness, so the base instruction/reasoning model ships as-is (no fine-tuning).

  • Base model: mistralai/Ministral-3-3B-Instruct-2512-BF16
  • Provider / family: mistral / ministral3
  • Local runtime arch: mistral3
  • Recommended profile: standard
  • Quantization: Q4_K_M
  • Native context window: 262144

Usage

Designed for TribeBlend Data Chat, loaded via llama-cpp-2.

License

Inherits the upstream base-model license (apache-2.0); verify upstream terms before redistribution.

Downloads last month
11
GGUF
Model size
3B params
Architecture
mistral3
Hardware compatibility
Log In to add your hardware

4-bit

Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐Ÿ™‹ Ask for provider support

Model tree for TribeBlend/tribeblend-etl-ministral3-3b-instruct