How do transformers handle rare or unseen words?

They use subword tokenization like BPE or WordPiece to break rare words into known units.

Transformers avoid OOV (out-of-vocabulary) issues using subword tokenization. Rare words are decomposed into frequent subunits, enabling generalization. FastText further uses character n-grams for robustness.