---
license: apache-2.0
base_model: unsloth/gemma-4-E4B-it
tags:
  - gemma
  - gemma-4
  - unsloth
  - gguf
  - medical
  - urdu
  - pakistan
  - llama-cpp
  - ollama
language:
  - ur
  - en
pipeline_tag: text-generation
---

# SehatSaathi · صحت ساتھی · GGUF (Q4_K_M + Q8_0)

Quantized GGUF builds of the SehatSaathi LoRA fine-tune of Gemma 4 E4B,
for offline phone & laptop deployment via **Ollama** or **llama.cpp**.

- Source merged model: [`Ali-001-ch/sehatsaathi-gemma4-e4b`](https://huggingface.co/Ali-001-ch/sehatsaathi-gemma4-e4b)
- LoRA adapter only: [`Ali-001-ch/sehatsaathi-gemma4-e4b-lora`](https://huggingface.co/Ali-001-ch/sehatsaathi-gemma4-e4b-lora)
- Base: [`unsloth/gemma-4-E4B-it`](https://huggingface.co/unsloth/gemma-4-E4B-it)

## Files

| File | Quant | Size | Use case |
|---|---|---|---|
| `sehatsaathi-q4_k_m.gguf` | Q4_K_M | ~5.5 GB | Phones, edge devices |
| `sehatsaathi-q8_0.gguf`   | Q8_0   | ~9 GB   | Laptops, near-lossless |

## Quick start with Ollama

```bash
ollama pull hf.co/Ali-001-ch/sehatsaathi-gemma4-e4b-GGUF:Q4_K_M
ollama run  hf.co/Ali-001-ch/sehatsaathi-gemma4-e4b-GGUF:Q4_K_M
```

## Quick start with llama.cpp

```bash
./llama-cli -m sehatsaathi-q4_k_m.gguf \
    --temp 1.0 --top-p 0.95 --top-k 64 --color --conversation
```

## Disclaimer

SehatSaathi is a medical screening / triage assistant, NOT a substitute
for a qualified doctor. In an emergency call **1122 (Pakistan Rescue)**.
License: Apache-2.0 + Gemma Terms of Use.