MONITORING SERVERLESS ARCHITECTURES CAN YOU HELP WITH SOME - - PowerPoint PPT Presentation

▶
monitoring serverless architectures can you help with
SMART_READER_LITE
LIVE PREVIEW

MONITORING SERVERLESS ARCHITECTURES CAN YOU HELP WITH SOME - - PowerPoint PPT Presentation

Jan 13, 2023 259 likes •929 views

MONITORING SERVERLESS ARCHITECTURES CAN YOU HELP WITH SOME PRODUCTION PROBLEMS? Your Manager @RafalGancarz (CC) Rachel Gardner Rafal Gancarz Lead Consultant @ OpenCredo @RafalGancarz WHAT IS SERVERLESS? @RafalGancarz (CC) theaucitron

slide-1
SLIDE 1

MONITORING SERVERLESS ARCHITECTURES

slide-2
SLIDE 2

@RafalGancarz

Your Manager CAN YOU HELP WITH SOME PRODUCTION PROBLEMS?

slide-3
SLIDE 3

(CC) Rachel Gardner

slide-4
SLIDE 4

Rafal Gancarz

Lead Consultant @ OpenCredo

@RafalGancarz

slide-5
SLIDE 5

@RafalGancarz

WHAT IS SERVERLESS?

slide-6
SLIDE 6

(CC) theaucitron

slide-7
SLIDE 7

@RafalGancarz

Cloud-native

slide-8
SLIDE 8

@RafalGancarz

PaaS?

slide-9
SLIDE 9

@RafalGancarz

Serverless ≠ FaaS

Faas Serverless

slide-10
SLIDE 10

@RafalGancarz

Managed runtime

slide-11
SLIDE 11

@RafalGancarz

WHY SERVERLESS?

slide-12
SLIDE 12

(CC) snapp3r

slide-13
SLIDE 13

@RafalGancarz

Availability

slide-14
SLIDE 14

@RafalGancarz

Scalability

slide-15
SLIDE 15

@RafalGancarz

Economy

slide-16
SLIDE 16

@RafalGancarz

Time to market

slide-17
SLIDE 17

@RafalGancarz

Security

slide-18
SLIDE 18

@RafalGancarz

Operability

slide-19
SLIDE 19

@RafalGancarz

SERVERLESS BUILDING BLOCKS

slide-20
SLIDE 20

@RafalGancarz

AWS Lambda

Java, C#, NodeJS, Python sync & async invocation 1 million invocations and 400k GB-s free per month $0.20 per 1 million requests and ~$6.65 for 400k GB-s thereafter

slide-21
SLIDE 21

@RafalGancarz

AWS API Gateway

security, caching, throttling functions as API implementations 1 million requests free per month $3.50 per 1 million requests and $0.09/GB (for the first 10 TB, then cheaper)

slide-22
SLIDE 22

@RafalGancarz

AWS DynamoDB

document and key-value function as triggered procedures 25 GB of storage and 25 units of read capacity each month for free (~200k requests per month) $0.25 per GB/month and $0.0065 per hour for 10 units of write capacity (36k writes/hour) or 50 units of read capacity (180k reads/hour)

slide-23
SLIDE 23

@RafalGancarz

AWS S3

durable, available and scalable functions as content processors 5 GB of storage and 15 GB of data transfer out to Internet each month for free $0.03 per TB/month and $0.09 per GB data transfer out to Internet

slide-24
SLIDE 24

@RafalGancarz

AWS SNS

pub-sub, push notifications functions as destinations 1m publishes, 1m mobile push notifications, 1k emails, 100k HTTP notifications and 1 GB of data transfer out each month for free $0.50 per 1m publishes, $0.60 per 1m HTTP notifications and $0.09 per GB data transfer out to the Internet

slide-25
SLIDE 25

@RafalGancarz

AWS Kinesis Streams

pub-sub, persistent functions as consumers no free tier $0.015 per shard/hour, $0.014 per 1m PUT payload units (25KB) + extended retention charges data transfer is free

slide-26
SLIDE 26

@RafalGancarz

Other AWS services

SQS Redshift IoT ElastiCache Cognito SES RDS ElasticSearch EMR Batch Route53 CloudFront Greengrass Button Step Functions

slide-27
SLIDE 27

(CC) Grégoire Lannoy

MONITORING

slide-28
SLIDE 28

@RafalGancarz

AWS CloudWatch

scalable, managed real-time monitoring metrics, logs, alarms, events

slide-29
SLIDE 29

(CC) Jérôme S

METRICS

slide-30
SLIDE 30

@RafalGancarz

CloudWatch Metrics

retention: 1m (15 days), 5m (63 days), 1h (15 months) basic monitoring (1m/5m) is free 10 metrics and 1 million API requests for free each month $0.30 per metric/month for the first 10k metrics ($0.02 for metrics over 1M) $0.01 for 1000 API requests

slide-31
SLIDE 31

@RafalGancarz

AWS Lambda

Invocations Errors Dead Letter Errors Duration Throttles

slide-32
SLIDE 32

@RafalGancarz

AWS API Gateway

4XX Error 5XX Error Cache Hit Count Cache Miss Count Count Integration Latency Latency

slide-33
SLIDE 33

@RafalGancarz

AWS DynamoDB

Provisioned Capacity Units Read/Write Consumed Capacity Units Read/Write Online Index Consumed Capacity/Progress/Throttling Returned Bytes Returned Item Count Returned Records Count (Streams) Successful Request Latency Errors System/User Conditional Check Failed Requests Throttled Events Read/Write/Requests

slide-34
SLIDE 34

@RafalGancarz

AWS S3

Bucket Size Bytes (daily) Number Of Objects (daily) All Requests Get/Put/Delete/Head/Post/List Requests Bytes Downloaded/Uploaded Errors 4XX/5XX First Byte Latency Total Request Latency

slide-35
SLIDE 35

@RafalGancarz

AWS SNS

Number Of Messages Published Publish Size Number Of Notifications Delivered Number Of Notifications Failed SMS Success Rate

slide-36
SLIDE 36

@RafalGancarz

Custom Metrics

function Lambda CloudWatch

SDK

slide-37
SLIDE 37

@RafalGancarz

Estimated Billing

Total Estimated Charges Estimated Charges (per service)

slide-38
SLIDE 38

(CC) Kevin Dooley

DASHBOARDS

slide-39
SLIDE 39

@RafalGancarz

CloudWatch Dashboards

metrics, alarms, static text 3 dashboards (up to 50 metrics) per month for free $3 per dashboard per month

slide-40
SLIDE 40

ALERTING

(CC) Martin Abegglen

slide-41
SLIDE 41

@RafalGancarz

CloudWatch Alarms

watches metrics over time can trigger a function via SNS 10 alarms per month for free $0.10 per alarm per month

slide-42
SLIDE 42

@RafalGancarz

Serverless Alerting

function alarm topic email SMS channel metric

condition

slide-43
SLIDE 43

LOGGING

(CC) Mari Smith

slide-44
SLIDE 44

@RafalGancarz

CloudWatch Logs

ingests and stores application logs configurable retention period 5 GB data ingestion and 5 GB archived storage per month for free $0.5985 per GB ingested per month $0.0315 per GB archived per month

slide-45
SLIDE 45

@RafalGancarz

Log Collection

log group Lambda stdout function stderr

slide-46
SLIDE 46

@RafalGancarz

Log Filtering

log group metric alarm filter condition

slide-47
SLIDE 47

@RafalGancarz

Log Streaming

log group function Elastic Search stream function

slide-48
SLIDE 48

@RafalGancarz

Log Browsing

log group Elastic Search function

JSON

Kibana

+ Bunyan CLI Bunyan

slide-49
SLIDE 49

EVENTS

(CC) JD Hancock

slide-50
SLIDE 50

@RafalGancarz

CloudWatch Events

stores & streams application events $1 per 1 million custom events

slide-51
SLIDE 51

@RafalGancarz

Custom Events

function

SDK

event rule function

slide-52
SLIDE 52

@RafalGancarz

DynamoDB dynamic capacity

function

SDK

event metrics table

slide-53
SLIDE 53

HEALTH CHECKS

(CC) Rosmarie Voegtli

slide-54
SLIDE 54

@RafalGancarz

Route53 Health Checks

monitors HTTP(S) endpoints 50 AWS endpoint checks per month for free $0.50 per health check per month $1 per feature (HTTPS, string matching, fast interval, latency) per month

slide-55
SLIDE 55

@RafalGancarz

Health Checks

health check metric alarm api function table

slide-56
SLIDE 56

TRACING

(CC) Ozzy Delaney

slide-57
SLIDE 57

@RafalGancarz

AWS X-Ray

collects transaction traces support for Lambda coming soon 100k traces recorded and 1 million traces retrieved/scanned free per month $5 per 1 million traces recorded and $0.50 per 1 million traces retrieved/ scanned per month

slide-58
SLIDE 58

AUDITING

(CC) The Steve

slide-59
SLIDE 59

@RafalGancarz

AWS CloudTrail

audits all console, API, SDK activity first copy of management event free additional copies $2 per 100k events $0.10 per 100k data events

slide-60
SLIDE 60

THE FUTURE

(CC) matt northam

slide-61
SLIDE 61

@RafalGancarz

Total Visibility

slide-62
SLIDE 62

@RafalGancarz

Monitoring as a Service

slide-63
SLIDE 63

@RafalGancarz

Monitoring not only for Operations

slide-64
SLIDE 64

@RafalGancarz

Application <-> Monitoring

metrics events logs feedback Application Services Monitoring Services

slide-65
SLIDE 65

@RafalGancarz

Monitoring as the enabler for the new functionality

slide-66
SLIDE 66

(CC) Alan Turkus

QUESTIONS?

@RafalGancarz