Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

integrate postgres/s3 with cluster #31

Open
MegCheppy opened this issue Oct 7, 2022 · 0 comments
Open

integrate postgres/s3 with cluster #31

MegCheppy opened this issue Oct 7, 2022 · 0 comments
Assignees
@MegCheppy

Comments

@MegCheppy
Copy link
Member

MegCheppy commented Oct 7, 2022 •
edited
Loading

Your cluster will be responsible for creating a Delta Lake - a bucket in S3 where Spark transformed streaming data from users reading the texts you showed them are stored. Use spark to configure s3 bucket
@MegCheppy MegCheppy self-assigned this Oct 7, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@MegCheppy MegCheppy

Labels
None yet
Projects
kafka, airflow, spark data pipeline
Status: Todo
Milestone
No milestone
Development

No branches or pull requests
1 participant
@MegCheppy