Skip to content

Financial data ingestion and analysis with AWS Kinesis and Athena

Notifications You must be signed in to change notification settings

xianchen2/Financal_Data_Ingestion

Repository files navigation

Streaming_Finance_Data

API endpoint: https://am2k3ccjvj.execute-api.us-east-2.amazonaws.com/default/collector-stream

This project consists of three major infrastructure elements that work in tandem:

  1. A AWS Lambda function that collects the data ( DataCollector )
  2. A AWS Lambda that transforms and places data into S3 ( DataTransformer )
  3. A AWS Glue crawler was set up to run AWS Athena queries against data ( DataAnalyzer )

DataCollector Lambda Configuration page

ScreenShot

Kinesis Data Firehose Delivery Stream Monitoring page

ScreenShot

About

Financial data ingestion and analysis with AWS Kinesis and Athena

Topics

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages