Atomic-Germ commited on
Commit
8014fa2
·
verified ·
1 Parent(s): 6909ad7

Upload README.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +6 -4
README.md CHANGED
@@ -39,6 +39,7 @@ Q4NX is FastFlowLM's native packed-quantization format - a rearranged Q4_1 layou
39
  | tokenizer.json | Tokenizer |
40
  | tokenizer_config.json | Special tokens and chat template |
41
  | chat_template.jinja | Chat template (optional) |
 
42
  | flm-add.py | Installer script - registers this model with FastFlowLM |
43
 
44
  ## Install and run
@@ -53,8 +54,8 @@ export FLM_CONFIG_PATH="$HOME/.config/flm/model_list.json"
53
  export FLM_XCLBIN_PATH="$HOME/.config/flm"
54
 
55
  git lfs install
56
- git clone https://huggingface.co/Atomic-Germ/Orinth-1.0-35B-NPU2
57
- cd Orinth-1.0-35B-NPU2
58
  python3 ./flm-add.py .
59
  flm run qwen3.6-moe:35b-a3b
60
  ```
@@ -63,14 +64,14 @@ Run `python3 ./flm-add.py --help` for all options. Without a clone, the same
63
  command works against the repo id directly:
64
 
65
  ```bash
66
- python3 ./flm-add.py Atomic-Germ/Orinth-1.0-35B-NPU2
67
  ```
68
 
69
  If the model has not been published yet, deploy the local directory with the
70
  converter instead:
71
 
72
  ```bash
73
- python convert.py -i <source.gguf> -o <this directory> -d qwen3.6-moe:35b-a3b --deploy-name "Orinth-1.0-35B-NPU2"
74
  ```
75
 
76
  ## Kernels
@@ -97,6 +98,7 @@ curl http://127.0.0.1:8080/v1/chat/completions \
97
  - Context length: 262,144 tokens (from config)
98
  - Hidden size: 2048
99
  - Layers: 40
 
100
  - Vocabulary: 248320
101
  - `model.q4nx` size: 21.64 GB
102
  - Base model: [ornith-ai/Ornith-1.0-35B](https://huggingface.co/ornith-ai/Ornith-1.0-35B)
 
39
  | tokenizer.json | Tokenizer |
40
  | tokenizer_config.json | Special tokens and chat template |
41
  | chat_template.jinja | Chat template (optional) |
42
+ | README.md | |
43
  | flm-add.py | Installer script - registers this model with FastFlowLM |
44
 
45
  ## Install and run
 
54
  export FLM_XCLBIN_PATH="$HOME/.config/flm"
55
 
56
  git lfs install
57
+ git clone https://huggingface.co/Atomic-Germ/Ornith-1.0-35B-NPU2
58
+ cd Ornith-1.0-35B-NPU2
59
  python3 ./flm-add.py .
60
  flm run qwen3.6-moe:35b-a3b
61
  ```
 
64
  command works against the repo id directly:
65
 
66
  ```bash
67
+ python3 ./flm-add.py Atomic-Germ/Ornith-1.0-35B-NPU2
68
  ```
69
 
70
  If the model has not been published yet, deploy the local directory with the
71
  converter instead:
72
 
73
  ```bash
74
+ python convert.py -i <source.gguf> -o <this directory> -d qwen3.6-moe:35b-a3b --deploy-name "Ornith-1.0-35B-NPU2"
75
  ```
76
 
77
  ## Kernels
 
98
  - Context length: 262,144 tokens (from config)
99
  - Hidden size: 2048
100
  - Layers: 40
101
+ - Intermediate size: 512
102
  - Vocabulary: 248320
103
  - `model.q4nx` size: 21.64 GB
104
  - Base model: [ornith-ai/Ornith-1.0-35B](https://huggingface.co/ornith-ai/Ornith-1.0-35B)