Even if you are remotely familiar with the big data ecosystem, then you will very well know that the simple paradigm of map and reduce surprisingly solves a large variety of problems. Here are a few class of patterns that can be applied with map reduce problems.

Summarization Patterns

  1. Counting with counters

A few years back, I got my hands dirty building a quintessential Lambda architecture that involved computing a user affinity model for an e-commerce company. The objective was to understand users’ historical and recent tastes and surface interesting recommendations by pivoting around these interests. Check the image below for reference.

Shashank Baravani

Get the Medium app

A button that says 'Download on the App Store', and if clicked it will lead you to the iOS App store
A button that says 'Get it on, Google Play', and if clicked it will lead you to the Google Play store