harpertoken commited on
Commit
1d8b417
·
verified ·
1 Parent(s): ccaebb6

Upload README.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +2 -0
README.md CHANGED
@@ -18,6 +18,8 @@ tags:
18
 
19
  This is a continuation, not a chat model. Nothing here establishes turn-taking, instruction following or any conversational protocol: there is no chat template in `tokenizer_config.json`, and the only token added beyond GPT-2's vocabulary is a `[PAD]` entry at id 50257, which takes `vocab_size` to 50258 against GPT-2's 50257. It produces fluent English that resembles dialogue because that is what it was trained to imitate, which is a weaker property than it sounds.
20
 
 
 
21
  The card this replaces documented a `generate_response.py` script and a FastAPI service on `localhost:8000` with `/status`, `/chat` and interactive docs endpoints. None of that is in the repository — it contains weights and tokenizer files only — so those sections have been removed. The declared perplexity, BLEU and F1 metrics likewise had no values behind them; no evaluation is recorded for this checkpoint.
22
 
23
  ## Usage
 
18
 
19
  This is a continuation, not a chat model. Nothing here establishes turn-taking, instruction following or any conversational protocol: there is no chat template in `tokenizer_config.json`, and the only token added beyond GPT-2's vocabulary is a `[PAD]` entry at id 50257, which takes `vocab_size` to 50258 against GPT-2's 50257. It produces fluent English that resembles dialogue because that is what it was trained to imitate, which is a weaker property than it sounds.
20
 
21
+ One detail about the checkpoint itself. It carries twelve `transformer.h.*.attn.masked_bias` tensors that current Transformers does not define: the key was removed from `GPT2Attention` years ago, and the upstream `gpt2` weights contain no such tensor. Loading this repository therefore prints an `UNEXPECTED` warning for those twelve keys on every run. They are inert, since nothing reads them, and generation is unaffected. They are left in place rather than silently stripped, so the file matches whatever produced it.
22
+
23
  The card this replaces documented a `generate_response.py` script and a FastAPI service on `localhost:8000` with `/status`, `/chat` and interactive docs endpoints. None of that is in the repository — it contains weights and tokenizer files only — so those sections have been removed. The declared perplexity, BLEU and F1 metrics likewise had no values behind them; no evaluation is recorded for this checkpoint.
24
 
25
  ## Usage