how to run on android
#1
by ztq6t4 - opened
can i ask how can i run this on android?
please
The model is supposed to run with executorch on smartphones (android, ios).
The executorch repo is at
https://github.com/pytorch/executorch;
with moe kernel / custom ops support at:
https://github.com/pytorch/executorch/tree/main/extension/llm/custom_ops.
We will also release the pte model version to load directly on phones.
You could also follow the guidance on https://github.com/pytorch/executorch to export model directly, and run on phones.
ztq6t4 changed discussion status to closed