How to use joboffer/ea07749d-785b-42a9-a944-333133d41f7a with PEFT:
from peft import PeftModel from transformers import AutoModelForCausalLM base_model = AutoModelForCausalLM.from_pretrained("teknium/OpenHermes-2.5-Mistral-7B") model = PeftModel.from_pretrained(base_model, "joboffer/ea07749d-785b-42a9-a944-333133d41f7a")
811f9c3
1
2
3
4
5
{ "<|im_end|>": 32000, "<|im_start|>": 32001 }
