Commit History

11 days ago

  1. Update card for v4: 100k steps, 1.64B tokens, val_loss 1.7603

    Verified signature
    f2dfad7
  2. v4: 100k steps, 1.64B tokens, val_loss 1.7603 (best 1.7531@96k)

    Verified signature
    885263a
  3. Add model code

    Verified signature
    d73d9e7
  4. Add BPE tokenizer (vocab 4096)

    Verified signature
    2cc3bfa
  5. Add model weights (step 45000)

    Verified signature
    5e16a65
  6. Add model card

    Verified signature
    f725858
  7. initial commit

    Verified signature
    55e78b1