Update README.md
Browse files
README.md
CHANGED
|
@@ -87,6 +87,8 @@ curl http://127.0.0.1:8080/v1/chat/completions \
|
|
| 87 |
- Base model: [ornith-ai/Ornith-1.0-35B](https://huggingface.co/ornith-ai/Ornith-1.0-35B)
|
| 88 |
- License: other
|
| 89 |
|
|
|
|
|
|
|
| 90 |
## Original model card
|
| 91 |
|
| 92 |
See the upstream model card for training details, benchmarks, and upstream
|
|
|
|
| 87 |
- Base model: [ornith-ai/Ornith-1.0-35B](https://huggingface.co/ornith-ai/Ornith-1.0-35B)
|
| 88 |
- License: other
|
| 89 |
|
| 90 |
+
ChatCompletionChunk: {"id":"chatcmpl-81cc726ee0a82b1bf2703a65","object":"chat.completion.chunk","created":1786483208,"model":"ornith-moe:35b-a3b","system_fingerprint":"fp_7076fd14a68716c5","choices":[{"index":0,"delta":{"content":null},"finish_reason":"stop"}],"usage":{"prompt_tokens":11140,"completion_tokens":330,"total_tokens":11470,"active_kv_tokens":11470,"max_kv_token_capacity":32768,"kv_token_occupancy_rate_percentage":35.003662109375,"load_duration":1.082e-06,"prefill_duration_ttft":74.225606656,"decoding_duration":33.763416,"prefill_speed_tps":150.0829767768493,"decoding_speed_tps":9.773892546891583}}
|
| 91 |
+
|
| 92 |
## Original model card
|
| 93 |
|
| 94 |
See the upstream model card for training details, benchmarks, and upstream
|