10Eros-Max-fl2va-int8-text-encoder / generation_config.json
alaub's picture
int8 weight-only text_encoder (torchao INT8WO)
d03ce6a verified
Raw
History Blame Contribute Delete
142 Bytes
{
"_from_model_config": true,
"bos_token_id": 151643,
"eos_token_id": 151645,
"transformers_version": "5.15.0",
"use_cache": true
}