Hugging Face's logo

answerdotai
/
ModernBERT-base

Fill-Mask
Transformers
PyTorch
ONNX
Safetensors
English
modernbert
masked-lm
long-context
Model card Files
xet
 Community
85

seq2seq

#52
by khusrav13 - opened
Discussion
khusrav13

Hello everyone, is it feasible to integrate modernBERT as the encoder within a seq2seq transformer architecture, or are there better-suited alternatives for this use case?

As I know, CodeBERT uses, how about ModernBERT?
https://github.com/microsoft/CodeBERT/blob/master/CodeBERT/code2nl/model.py
pszemraj

see discussion ongoing here: https://huggingface.co/answerdotai/ModernBERT-base/discussions/38
khusrav13

@pszemraj Thank you.
khusrav13 changed discussion status to closed

Sign up or log in to comment