Lambda => Query = function(all data) iterata AG Industriestrasse - - PowerPoint PPT Presentation

▶

Jan 27, 2023 235 likes •286 views

Lambda Query Function Lambda => Query = function(all data) iterata AG Industriestrasse 8 5722 Grnichen Schweiz info@iterata.ch Tel. +41 62 842 88 27 Fax +41 62 842 88 28 Lambda Architecture Hadoop Batch Layer Batch

SLIDE 1

iterata AGIndustriestrasse 85722 GränichenSchweizinfo@iterata.chTel. +41 62 842 88 27Fax +41 62 842 88 28

Lambda Query Function

Lambda => Query = function(all data)

SLIDE 2

iterata AGIndustriestrasse 85722 GränichenSchweizinfo@iterata.chTel. +41 62 842 88 27Fax +41 62 842 88 28

Hadoop Realtime views (Apache HBase) Batch views (HDFS / Impala) Storm Serving Layer Speed Layer

Lambda Architecture

New Data Stream Query (Impala) All Data (HDFS) Process Stream Increment views Precompute views (MapReduce) QFD 1 QFD 2 QFD N QFD 1 QFD 2 QFD N Merge Realtime increment Batch recompute Batch Layer

SLIDE 3

iterata AGIndustriestrasse 85722 GränichenSchweizinfo@iterata.chTel. +41 62 842 88 27Fax +41 62 842 88 28

Realtime views can be discarded

nce the data they contain is

represented in the batch view Batch Batch Realtime Realtime Batch Realtime Time Now

Lambda Architecture