do you think i can run it ?

#1
by gopi87 - opened

hi i have 256gb system ram do you think can i able to run any of this quant ?

if possiple kindly give us DeepSeek-R1-0528-IQ2_K_R4 220GiB and q1

https://huggingface.co/ubergarm/DeepSeek-R1-0528-GGUF

gopi87 changed discussion status to closed
gopi87 changed discussion status to open

I would wait for the IQ2_K_R4 and IQ1_S quants from ubergarm. Unfortunately I wouldn't have time to make a quant with imatrix, which the lower bpw quants really need.

@gopi87

Working on the smaller ones here: https://huggingface.co/ubergarm/DeepSeek-TNG-R1T2-Chimera-GGUF

I'll link to this repo for folks with more RAM for the bigger ones! Thanks @Kebob !

EDIT haha yes just updated the link to point to the new repo, as opposed to copy-pasta from your repo! ty!

I think you meant this link @ubergarm :) https://huggingface.co/ubergarm/DeepSeek-TNG-R1T2-Chimera-GGUF

I'll link back to yours as well!

Sign up or log in to comment