Optiq serve encountered an error during startup
#2
by sqh11 - opened
Python 3.14 installs pip install mlx optiq==0.4.19, and after starting, issues a request error.
Start command:
optiq serve \
--model "${MODEL_NAME}" \
--stream-experts \
--host "${HOST}" \
--port "${PORT}"
Error log:
127.0.0.1 - - [14/Aug/2026 02:07:29] "POST /v1/chat/completions HTTP/1.1" 200 -
INFO:root:Prompt Cache: 0 sequences, 0.00 GB
INFO:root:- assistant: 0 sequences, 0.00 GB
INFO:root:- user: 0 sequences, 0.00 GB
INFO:root:- system: 0 sequences, 0.00 GB
INFO:root:Prompt processing progress: 0/34
libc++abi: terminating due to uncaught exception of type std::runtime_error: There is no Stream(gpu, 1) in current thread.
Have you encountered the same problem?