Monolith: Real Time Recommendation System With Collisionless Embedding Table

I didn’t get that much from this paper, probably because it’s pretty high level and I don’t have a strong background in recommendation systems.

The approach is their Cuckoo Hashmap for embedding from which they can update parameters on the fly using existing data engineering pipeline technology.

Instead of reading mini-batch examples from the storage, a training worker consumes realtime data on-the-fly and updates the training PS. The training PS periodically syn- chronizes its parameters to the serving PS, which will take effect on the user side immediately. This enables our model to interactively adapt itself according to a user’s feedback in realtime.

Leave a Reply

This site uses Akismet to reduce spam. Learn how your comment data is processed.