v102ss commited on
Commit
53c15a0
·
verified ·
1 Parent(s): 8dcc0ea

Upload Alice Qwen3.6 35B A3B MTP GGUF shell

Browse files
.gitattributes CHANGED
@@ -33,3 +33,4 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
 
 
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
36
+ Alice-Qwen3.6-35B-A3B-MTP-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Alice-Qwen3.6-35B-A3B-MTP-Q4_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7db9332344901547292e81a826230e84fa19776e7d3321e9f895e62ad85846e9
3
+ size 21779260576
README.md ADDED
@@ -0,0 +1,48 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ base_model:
3
+ - llmfan46/Qwen3.6-35B-A3B-uncensored-heretic-Native-MTP-Preserved-GGUF
4
+ library_name: llama.cpp
5
+ license: apache-2.0
6
+ tags:
7
+ - gguf
8
+ - qwen3.6
9
+ - qwen3_5_moe
10
+ - moe
11
+ - mtp
12
+ - uncensored
13
+ - heretic
14
+ - alice
15
+ - chinese
16
+ - roleplay
17
+ ---
18
+
19
+ # Alice Qwen3.6 35B A3B MTP GGUF
20
+
21
+ Alice shell release for `Qwen3.6-35B-A3B-uncensored-heretic-Native-MTP-Preserved-Q4_K_M.gguf`.
22
+
23
+ This release patches only `tokenizer.chat_template` to add a shallow Alice identity and roleplay-oriented default behavior. Model tensors are unchanged.
24
+
25
+ Base repo: `llmfan46/Qwen3.6-35B-A3B-uncensored-heretic-Native-MTP-Preserved-GGUF`
26
+
27
+ Recommended llama.cpp flags for MTP smoke testing:
28
+
29
+ ```bash
30
+ llama-server \
31
+ -m Alice-Qwen3.6-35B-A3B-MTP-Q4_K_M.gguf \
32
+ -c 8192 -ngl 99 -np 1 \
33
+ --spec-type draft-mtp --spec-draft-n-max 2 \
34
+ --reasoning off --jinja
35
+ ```
36
+
37
+ Smoke result:
38
+
39
+ - MTP initialized with `draft-mtp`.
40
+ - Identity prompts anchor as Alice.
41
+ - Companion prompt generated normally.
42
+ - Example MTP acceptance: `41 accepted / 114 generated` draft tokens on a short Chinese companion prompt.
43
+
44
+ Notes:
45
+
46
+ - Keep `np=1` for first tests.
47
+ - Test text-only first; do not attach `mmproj` until text generation is stable.
48
+ - If the runtime does not expose MTP, the model should still run as a normal GGUF.