pswitala
/

bielik-11b-v23-instruct-q5_k_m_gguf

Model card Files Files and versions

pswitala/bielik-11b-v23-instruct-q5_k_m_gguf

This model was converted to GGUF format from speakleash/Bielik-11B-v2.3-Instruct using llama.cpp Refer to the original model card for more details on the model.

Really fast at rtx4080

This model run smoothly on RTX4080 with 50 tokens / sec

Downloads last month: 14

GGUF

Model size

11B params

Architecture

llama

Hardware compatibility

Log In to add your hardware

5-bit

Inference Providers NEW

This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for pswitala/bielik-11b-v23-instruct-q5_k_m_gguf

Base model

speakleash/Bielik-11B-v2.3-Instruct

Quantized

(12)

this model