How to use aifeifei798/gemma-4-12B-Queen-it-qat-q4_0-unquantized with Transformers:
# pip install -U transformers accelerate # Load model directly from transformers import AutoProcessor, AutoModelForMultimodalLM processor = AutoProcessor.from_pretrained("aifeifei798/gemma-4-12B-Queen-it-qat-q4_0-unquantized") model = AutoModelForMultimodalLM.from_pretrained("aifeifei798/gemma-4-12B-Queen-it-qat-q4_0-unquantized", device_map="auto")
gggrandma1990