v2.0.0

This release marks the successful completion of SIT-2. Further information about what was tested in SIT-2 can be found in this galaxy page and the SIT-2 GitHub Project Board.

Features

• Ability to deploy and test software in the SDC Staging environment.
• Software can be successfully promoted from the SDC Staging Environment to the SDC Data Production Environment.
• Delivery of data files to the SPDF for routine archival purposes.
  • Backing up both OpenSearch and the data bucket to the backup account.
• Use of the API data interfaces by both SDC personnel as well as instrument teams. APIs:
  • The /upload endpoint for uploading new data to SDC
  • The /download endpoint for downloading data from SDC
  • The /query endpoint for querying information about data and data location.
• Demonstrate the SDC's ability to trigger jobs based on data availability and launch necessary processing containers.
  • Implementing a data watcher (Database) that keeps track of processing status.
  • Establishing a processing pipeline that initiates processing tasks.

What's Changed

• Primarily adding more fine-grained permissions to the lambda by @bryan-harter in #30
• Adding a way to create unique stack names each deploy by @bryan-harter in #29
• Adding the upload API to the stack and adding the Upload API code by @bryan-harter in #33
• MNT: Style updates by @greglucas in #19
• Adding poetry to the project by @maxinelasp in #38
• TST: Add test for s3 bucket properties by @greglucas in #42
• MNT: Ignore deprecation warnings by @greglucas in #44
• [pre-commit.ci] pre-commit autoupdate by @pre-commit-ci in #51
• 1 create a spot to store configjson in a centralized location on aws by @sdhoyt in #50
• Improve stack creation testing by @sdhoyt in #52
• Update issue templates to include spike by @maxinelasp in #58
• 24 mock opensearch for unit testing by @sdhoyt in #69
• PR template by @sdhoyt in #70
• moved pull request template one directory up by @sdhoyt in #78
• Code of Conduct by @bourque in #77
• Modularize CDK code by @laspsandoval in #101
• API Gateway by @laspsandoval in #102
• TST: Reorganizing tests and moving to pytest-style by @greglucas in #103
• Removing templates now that we have a project-wide template for issues by @maxinelasp in #106
• Documentation by @maxinelasp in #109
• Add pre-commit hooks by @bourque in #115
• [pre-commit.ci] pre-commit autoupdate by @pre-commit-ci in #80
• Updated infrastructure tests by @laspsandoval in #118
• adding .rst to docs/cdk by @GFMoraga in #114
• MNT: Add more information in the app template file by @greglucas in #112
• Implementation of Track Data Availability by @tech3371 in #120
• Changing the Upload API to use a GET rather than a POST by @bryan-harter in #110
• Initial Implementation of Trigger jobs based on data availability by @tech3371 in #119
• Opensearch snapshot by @sdhoyt in #121
• S3 backups by @maxinelasp in #125
• Updating permissions for data bucket role - SIT2 fix by @maxinelasp in #128
• SIT-2 Release [main] by @bourque in #150

Full Changelog: v1.0.1...v2.0.0