Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Create WPS Dispatcher for WIT Docker Container #8

Open
whatnick opened this issue May 21, 2021 · 0 comments
Open

Create WPS Dispatcher for WIT Docker Container #8

whatnick opened this issue May 21, 2021 · 0 comments
Assignees

Comments

@whatnick
Copy link
Contributor

Create a dispatcher script packaged in a docker container that:

  • Reads polygons from a PostgreSQL DB or Shapefile
  • Dispatches these to polygon drill / csv creation functions in WPS
  • Does this in batches and exits early if the target CSV already exists in S3
  • Uses single-thread multi-container or multi-thread single-container approach , single-thread is preferred for Kubernetes paradigm.
  • Times out failed polygon drills with estimated processing time derived from polygon area + heuristics
  • Captures failed polygons for review
@whatnick whatnick self-assigned this May 21, 2021
whatnick added a commit that referenced this issue May 23, 2021
whatnick added a commit that referenced this issue May 23, 2021
whatnick added a commit that referenced this issue May 24, 2021
Signed-off-by: Tisham Dhar <[email protected]>
whatnick pushed a commit that referenced this issue May 26, 2021
whatnick pushed a commit that referenced this issue May 27, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant