Instructions to use brandonmusic/GLM-5.2-EXL3-TR3v4-3.5bpw-MTP78 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Trellis
How to use brandonmusic/GLM-5.2-EXL3-TR3v4-3.5bpw-MTP78 with Trellis:
# No code snippets available yet for this library. # To use this model, check the repository files and the library's documentation. # Want to help? PRs adding snippets are welcome at: # https://github.com/huggingface/huggingface.js
- Notebooks
- Google Colab
- Kaggle
Download R7_BF16_SHARED_DERIVATION.json from brandonmusic/GLM-5.2-EXL3-TR3v4-3.5bpw-MTP78: direct link, hf CLI and curl.
- Browser
- Download file 1.53 kB
-
https://huggingface.co/brandonmusic/GLM-5.2-EXL3-TR3v4-3.5bpw-MTP78/resolve/ed36ad6d767af08845a317b56fe89ce73ed520f4/R7_BF16_SHARED_DERIVATION.json
- Command line
-
hf download hf://brandonmusic/GLM-5.2-EXL3-TR3v4-3.5bpw-MTP78@ed36ad6d767af08845a317b56fe89ce73ed520f4/R7_BF16_SHARED_DERIVATION.json
-
curl -L -o R7_BF16_SHARED_DERIVATION.json https://huggingface.co/brandonmusic/GLM-5.2-EXL3-TR3v4-3.5bpw-MTP78/resolve/ed36ad6d767af08845a317b56fe89ce73ed520f4/R7_BF16_SHARED_DERIVATION.json
1.53 kB
| { | |
| "added_bf16_tensor_bytes": 5737807872, | |
| "canonical_revision": "9ab9579774cc432df91567a36f6e9e863e0d4c9f", | |
| "canonical_tensors_compared_to_donor": 228, | |
| "central_shard": { | |
| "file_bytes": 5737837256, | |
| "path": "model-sharedbf16.safetensors", | |
| "sha256": "ee1e7d9b2adb5d49c0895dc2f4b7d6d424b108cdb796879eee4c55d040408c6a", | |
| "tensor_bytes": 5737807872, | |
| "tensors": 228 | |
| }, | |
| "donor_config_sha256": "7d42e3a21873412b39c3741e5b9166362d25b05f40c0e66a968e79d422c7dea1", | |
| "donor_index_sha256": "b34398df3830a13d23e25a9582112d38f7da982a48d50b95bc7e0867c94e9fdc", | |
| "donor_repo_id": "willfalco/GLM-5.2-EXL3-TR3-3.42bpw", | |
| "donor_revision": "a350292cb2038f2c31732569a711a89e5d72fd46", | |
| "indexed_tensors": 186905, | |
| "output_tensor_bytes": 346196508248, | |
| "removed_source_shared_tensor_bytes": 2202551172, | |
| "replaced_layers": "3-78", | |
| "replaced_projections": ["down_proj", "gate_proj", "up_proj"], | |
| "runtime_intent": "ONLINE_QUANT=exl3-b6", | |
| "source_config_sha256": "a231e816fb3495a33ba4f89b5cb7d2ffc86f0c66f71a42a0e792dead3868bf5c", | |
| "source_index_sha256": "3077bb6d01f0831c62775d0504b06c45989d2efe8fec944ab50ed911902e5678", | |
| "source_manifest_sha256": "df2f4c87b22c21c5234ef216149f5b5adc556820bb97ae4bc6dd7f4f0647b8db", | |
| "source_repo_id": "brandonmusic/GLM-5.2-EXL3-TR3v4-3.5bpw-MTP78", | |
| "source_revision": "c55c1cd4ca4216c27b0dddb51a4c6757c1765d1e", | |
| "validation": { | |
| "bf16_shared_tensors": 228, | |
| "covered_layers": [3, 78], | |
| "non_bf16_or_unexpected_tensors": 0, | |
| "stale_shared_exl3_records": 0 | |
| } | |
| } | |