empgces commited on
Commit
cc742a9
·
verified ·
1 Parent(s): e29129d

Document fine-tuned GGUF model

Browse files
Files changed (1) hide show
  1. README.md +21 -17
README.md CHANGED
@@ -1,26 +1,30 @@
1
  ---
 
 
 
 
 
 
 
 
 
2
  tags:
 
 
 
3
  - gguf
4
- - llama.cpp
5
  - unsloth
6
-
7
  ---
8
 
9
- # gemma3-270m-grounded-behavior-finetuned-v9-GGUF : GGUF
10
-
11
- This model was finetuned and converted to GGUF format using [Unsloth](https://github.com/unslothai/unsloth).
12
-
13
- **Example usage**:
14
- - For text only LLMs: `llama-cli -hf empgces/gemma3-270m-grounded-behavior-finetuned-v9-GGUF --jinja`
15
- - For multimodal models: `llama-mtmd-cli -hf empgces/gemma3-270m-grounded-behavior-finetuned-v9-GGUF --jinja`
16
 
17
- ## Available Model files:
18
- - `gemma-3-270m-it.Q4_K_M.gguf`
19
 
20
- ## Ollama
21
- An Ollama Modelfile is included for easy deployment.
22
 
23
- ## Note
24
- The model's BOS token behavior was adjusted for GGUF compatibility.
25
- This was trained 2x faster with [Unsloth](https://github.com/unslothai/unsloth)
26
- [<img src="https://raw.githubusercontent.com/unslothai/unsloth/main/images/unsloth%20made%20with%20love.png" width="200"/>](https://github.com/unslothai/unsloth)
 
1
  ---
2
+ language:
3
+ - pt
4
+ license: gemma
5
+ library_name: llama.cpp
6
+ pipeline_tag: text-generation
7
+ base_model: empgces/gemma3-270m-grounded-behavior-finetuned-v9
8
+ base_model_relation: quantized
9
+ datasets:
10
+ - empgces/grounded-behavior-n1-pt
11
  tags:
12
+ - gemma-3
13
+ - fine-tuned
14
+ - finetune
15
  - gguf
16
+ - q4-k-m
17
  - unsloth
18
+ - grounded-behavior
19
  ---
20
 
21
+ # Gemma 3 270M Grounded Behavior — Fine-tuned V9 GGUF
 
 
 
 
 
 
22
 
23
+ Versão **GGUF `Q4_K_M`** do modelo fine-tuned
24
+ [empgces/gemma3-270m-grounded-behavior-finetuned-v9](https://huggingface.co/empgces/gemma3-270m-grounded-behavior-finetuned-v9).
25
 
26
+ O modelo foi treinado sobre `empgces/grounded-behavior-n1-pt` durante
27
+ 2 épocas e convertido para GGUF com Unsloth.
28
 
29
+ Ao executar com llama.cpp, LM Studio ou Ollama, preserve o chat template Gemma
30
+ incluído no artefacto para manter o mesmo formato usado durante o treino.