Upload README.md with huggingface_hub
Browse files
README.md
CHANGED
|
@@ -39,6 +39,7 @@ Q4NX is FastFlowLM's native packed-quantization format - a rearranged Q4_1 layou
|
|
| 39 |
| tokenizer.json | Tokenizer |
|
| 40 |
| tokenizer_config.json | Special tokens and chat template |
|
| 41 |
| chat_template.jinja | Chat template (optional) |
|
|
|
|
| 42 |
| flm-add.py | Installer script - registers this model with FastFlowLM |
|
| 43 |
|
| 44 |
## Install and run
|
|
@@ -53,8 +54,8 @@ export FLM_CONFIG_PATH="$HOME/.config/flm/model_list.json"
|
|
| 53 |
export FLM_XCLBIN_PATH="$HOME/.config/flm"
|
| 54 |
|
| 55 |
git lfs install
|
| 56 |
-
git clone https://huggingface.co/Atomic-Germ/
|
| 57 |
-
cd
|
| 58 |
python3 ./flm-add.py .
|
| 59 |
flm run qwen3.6-moe:35b-a3b
|
| 60 |
```
|
|
@@ -63,14 +64,14 @@ Run `python3 ./flm-add.py --help` for all options. Without a clone, the same
|
|
| 63 |
command works against the repo id directly:
|
| 64 |
|
| 65 |
```bash
|
| 66 |
-
python3 ./flm-add.py Atomic-Germ/
|
| 67 |
```
|
| 68 |
|
| 69 |
If the model has not been published yet, deploy the local directory with the
|
| 70 |
converter instead:
|
| 71 |
|
| 72 |
```bash
|
| 73 |
-
python convert.py -i <source.gguf> -o <this directory> -d qwen3.6-moe:35b-a3b --deploy-name "
|
| 74 |
```
|
| 75 |
|
| 76 |
## Kernels
|
|
@@ -97,6 +98,7 @@ curl http://127.0.0.1:8080/v1/chat/completions \
|
|
| 97 |
- Context length: 262,144 tokens (from config)
|
| 98 |
- Hidden size: 2048
|
| 99 |
- Layers: 40
|
|
|
|
| 100 |
- Vocabulary: 248320
|
| 101 |
- `model.q4nx` size: 21.64 GB
|
| 102 |
- Base model: [ornith-ai/Ornith-1.0-35B](https://huggingface.co/ornith-ai/Ornith-1.0-35B)
|
|
|
|
| 39 |
| tokenizer.json | Tokenizer |
|
| 40 |
| tokenizer_config.json | Special tokens and chat template |
|
| 41 |
| chat_template.jinja | Chat template (optional) |
|
| 42 |
+
| README.md | |
|
| 43 |
| flm-add.py | Installer script - registers this model with FastFlowLM |
|
| 44 |
|
| 45 |
## Install and run
|
|
|
|
| 54 |
export FLM_XCLBIN_PATH="$HOME/.config/flm"
|
| 55 |
|
| 56 |
git lfs install
|
| 57 |
+
git clone https://huggingface.co/Atomic-Germ/Ornith-1.0-35B-NPU2
|
| 58 |
+
cd Ornith-1.0-35B-NPU2
|
| 59 |
python3 ./flm-add.py .
|
| 60 |
flm run qwen3.6-moe:35b-a3b
|
| 61 |
```
|
|
|
|
| 64 |
command works against the repo id directly:
|
| 65 |
|
| 66 |
```bash
|
| 67 |
+
python3 ./flm-add.py Atomic-Germ/Ornith-1.0-35B-NPU2
|
| 68 |
```
|
| 69 |
|
| 70 |
If the model has not been published yet, deploy the local directory with the
|
| 71 |
converter instead:
|
| 72 |
|
| 73 |
```bash
|
| 74 |
+
python convert.py -i <source.gguf> -o <this directory> -d qwen3.6-moe:35b-a3b --deploy-name "Ornith-1.0-35B-NPU2"
|
| 75 |
```
|
| 76 |
|
| 77 |
## Kernels
|
|
|
|
| 98 |
- Context length: 262,144 tokens (from config)
|
| 99 |
- Hidden size: 2048
|
| 100 |
- Layers: 40
|
| 101 |
+
- Intermediate size: 512
|
| 102 |
- Vocabulary: 248320
|
| 103 |
- `model.q4nx` size: 21.64 GB
|
| 104 |
- Base model: [ornith-ai/Ornith-1.0-35B](https://huggingface.co/ornith-ai/Ornith-1.0-35B)
|