What is layer normalization vs batch normalization?

Updated May 17, 2026

Short answer

Layer norm normalizes across features; batch norm normalizes across batch samples.

Deep explanation

Layer norm is independent of batch size and widely used in transformers, while batch norm depends on batch statistics.

Unlock with a Pro subscription to view this section.

View pricing

Real-world example

No real-world example available yet.

Unlock with a Pro subscription to view this section.

Upgrade to Pro

Common mistakes

No common mistakes listed yet.

Unlock with a Pro subscription to view this section.

Upgrade to Pro

Follow-up questions

No follow-up questions available yet.

Unlock with a Pro subscription to view this section.

Upgrade to Pro

More Neural Networks interview questions

View all →