How do transformers encode hierarchical structure without explicit trees?

Transformers learn hierarchical representations implicitly through layered attention transformations.

Lower layers capture local syntactic patterns while deeper layers encode abstract semantic relationships. This hierarchy emerges from stacked self-attention and feed-forward transformations without explicit tree supervision.