Initializing Techhub.cafe

Design a low-latency feature serving architecture that avoids training/serving skew

Updated Aug 1, 2026

Short answer

Compute features once in a shared pipeline that writes to both an online store for serving and an offline store for training, use point-in-time correct joins to build training sets, and keep any request-time computation in a library shared by both paths.

Deep explanation

Skew arises whenever a feature's value at training time differs from what serving produces for the same entity and moment. The architecture must make the two paths structurally identical, not merely intended to match.

Feature taxonomy — the design falls out of this classification:

  1. Batch features (30-day spend, lifetime orders) — computed on a schedule, served from the online store.
  2. Streaming features (transactions in the last 5 minutes) — computed by Kinesis/Flink or Lambda, written to the online store continuously.

3.…

Unlock with a Pro subscription to view this section.

View pricing

Real-world example

No real-world example available yet.

Unlock with a Pro subscription to view this section.

Upgrade to Pro

Common mistakes

No common mistakes listed yet.

Unlock with a Pro subscription to view this section.

Upgrade to Pro

Follow-up questions

No follow-up questions available yet.

Unlock with a Pro subscription to view this section.

Upgrade to Pro

More AWS Machine Learning interview questions

View all →