What is self-supervised learning in neural networks?

Self-supervised learning generates labels from data itself for training.

It creates proxy tasks like masked token prediction to learn representations without manual labels.