Skip to content

A Krawler based service to download data from the OpenRadiation project.

License

Notifications You must be signed in to change notification settings

kalisio/k-openradiation

Repository files navigation

k-openradiation

Latest Release CI License: MIT

A Krawler based service to download data from the OpenRadiation project.

Description

The k-openradiation job allow to scrape measurements from the OpenRadiation API. The downloaded data are stored within a MongoDB database and more precisely in a collection named openradiation.

All records are stored in GeoJson format.

The job is executed according a specific cron expression. By default, every hours.

Configuration

Variable Description
KEY The key to use the API. As mentioned here, you should ask this access code to the OpenRadiation team.
DB_URL The mongoDB database URL. The default value is mongodb://127.0.0.1:27017/openradiation
COLLECTION The mongoDB database collection. The default value is openradiation
TTL The measurements data time to live. It must be expressed in seconds and the default value is 604 800 (7 days)
DATE_OF_CREATION Force the date of measurements to be retrieved. Undefined by default so that the current date will be used.
DEBUG Enables debug output. Set it to krawler* to enable full output. By default it is undefined.

Deployment

We personally use Kargo to deploy the service.

Contributing

Please refer to contribution section for more details.

Authors

This project is sponsored by

Kalisio

License

This project is licensed under the MIT License - see the license file for details

About

A Krawler based service to download data from the OpenRadiation project.

Topics

Resources

License

Stars

Watchers

Forks

Packages

No packages published