XMemTransfer Pythia-410M adaptor from Pythia-160M source (20M)

This repository contains a target-side adaptor checkpoint for the XMemTransfer cross-architecture transfer setting.

Project links

Website: XMemTransfer project page
Paper: Cross-Model Memory Transfer via Target-Side Reader Adaptation
Code: OLAResearch/XMemTransfer
Model repo: https://huggingface.co/OLAResearchX/xmemtransfer-pythia410m-from-pythia160m-20m
Collection: https://huggingface.co/collections/OLAResearchX/xmemtransfer

Files

adaptor_best.pt: best target-side adaptor checkpoint
config.json: adaptor configuration
results.json: summary metrics from the run

Related source memory

This adaptor is loaded on top of EleutherAI/pythia-410m and uses the frozen source memory released at OLAResearchX/xmemtransfer-pythia160m-source-50m.

Provenance

source memory: Pythia-160M WikiText source memory
target model family: Pythia-410M
reader setting: single-branch adaptor
token budgets: 50M source / 20M target-side fitting
canonicalization mode: vocab

Usage and limitations

These files are research artifacts for the XMemTransfer implementation, not standalone Transformers pipeline checkpoints. Follow the project code to construct the memory reader and load the checkpoint. Results depend on the paired backbone, source memory, data preprocessing, and configuration released with the model.