In newer version of vllm (I'm using v0.23.0), function get_cache_scale() is removed in quant_config. Please update your code to work with latest version
· Sign up or log in to comment
