Commit History
-
Create README.md
Created this model from BLOOM 560m base as a test for my small personal GPU. Trained on 30 % of the SQUAD 1.0 dataset. ``` {'eval_loss': 6.210013389587402, 'eval_runtime': 9310.8833, 'eval_samples_per_second': 0.43, 'eval_steps_per_second': 0.107, 'epoch': 3.0} {'train_runtime': 52012.0203, 'train_samples_per_second': 0.058, 'train_steps_per_second': 0.058, 'train_loss': 5.395830729166667, 'epoch': 3.0} ```2702618