Instructions to use ChaeMs/KoRani-5.8b with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- PEFT
How to use ChaeMs/KoRani-5.8b with PEFT:
from peft import PeftModel from transformers import AutoModelForCausalLM base_model = AutoModelForCausalLM.from_pretrained("EleutherAI/polyglot-ko-5.8b") model = PeftModel.from_pretrained(base_model, "ChaeMs/KoRani-5.8b") - Notebooks
- Google Colab
- Kaggle
| library_name: peft | |
| base_model: EleutherAI/polyglot-ko-5.8b | |
| # ChaeMs/KoRani-5.8b | |
| <p align="center"><img width="150" alt="image" src="https://github.com/chaeminsoo/QnA_GPT/assets/79351899/b9a78bf5-0d80-435a-ba14-e288e8886f99"></p> | |
| <!-- Provide a quick summary of what the model is/does. --> | |
| The korean language model finetuned from EleutherAI's polyglot-ko-5.8b, using QLoRA method. | |
| It trained about 100k instruction data. | |
| Instruction data was made using "네이버 지식인" and ShareGPT data. | |
| ## Model Description | |
| <!-- Provide a longer summary of what this model is. --> | |
| - **Developed by:** [Chae Minsu](https://github.com/chaeminsoo) | |
| - **Model type:** Text Generation | |
| - **Language(s) (NLP):** Korean | |
| - **Finetuned from model:** EleutherAI/polyglot-ko-5.8b | |
| - **Training Data:** [네이버 지식인 data made by beomi](https://huggingface.co/datasets/beomi/KoAlpaca-v1.1a), [ShareGPT data made by junelee](https://huggingface.co/datasets/junelee/sharegpt_deepl_ko) |