The Lambda Architecture is a deployment model for data processing that organizations use to combine a traditional batch pipeline with a fast real-time stream pipeline for data access. It is a common architecture model in IT and development organizations’ toolkits as businesses strive to become more data-driven and event-driven in the face of massive volumes of rapidly generated data, often referred to as “big data.” In such scenarios Lambda architecture stands out and helps ingesting both batch and stream data. The term Lambda in the word Lambda Architecture comes from the mathematical lambda symbol. This architecture became very famous in the Big Data industry and has been used with Big Data technologies like Spark & Hadoop. However, this architecture is not specific to Spark or Hadoop. It is a generic architecture that can be applied with any set of technologies.
