Private jet flights

This repository contains a CLI application to analyze flights of private jets.

It is supported by an S3 Blob storage container for caching data, thereby reducing its impact to https://adsbexchange.com/.

Risk and impact

This code performs API calls to https://adsbexchange.com/, a production website of a company.

Use critical thinking when using this code and how it impacts them.

We strongly recommend that if you plan to perform large scale analysis (e.g. in time or aircrafts), that you reach out via an issue before, so that we can work together to cache all hits to https://adsbexchange.com/ on an horizontally scaled remote storage and therefore remove its impact to adsbexchange.com of future calls.

All cached data is available on S3 blob storage at endpoint

https://private-jets.fra1.digitaloceanspaces.com

and has anonymous and public read permissions.

How to use

This repository contains both a Rust library and a set of examples/ used to perform actual calculations. To use one of such examples:

1. Install Rust
2. run cargo run --features="build-binary" --bin single_day -- --tail-number "OY-GFS" --date "2023-10-20"
3. open OY-GFS_2023-10-20_0.md

Step 2. has an optional arguments, --access-key, --secret-access-key, specifying credentials to write to the remote storate, as opposed to disk.

Finally, setting --backend disk ignores the remote storage altogether and only uses disk for caching (resulting in higher cache misses and thus more interactions with ADS-B exchange).

In general:

• Use the default parameters when creating ad-hoc stories
• Use --access-key when improving the database with new data.
• Use --backend disk when testing the caching system

As of today, the flag --access-key is only available when the code is executed from main, as writing to the blob storage must be done through a controlled code base that preserves data integrity.

Examples:

# Story about Danish private jets that flew to Davos between two dates
cargo run --features="build-binary" --bin country -- --from=2024-01-13 --to=2024-01-21 --country=denmark --location=davos
# Story about Danish private jets that flew between two dates
cargo run --features="build-binary" --bin country -- --from=2024-01-13 --to=2024-01-21 --country=denmark
# Story about Portuguese private jets that flew between two dates
cargo run --features="build-binary" --bin country -- --from=2024-01-13 --to=2024-01-21 --country=portugal

# Story about German private jets that flew in 2023, where secret is on a file
cargo run --features="build-binary" --bin country -- --from=2023-01-01 --to=2024-01-01 --country=germany --access-key=DO00AUDGL32QLFKV8CEP --secret-access-key=$(cat secrets.txt)

# Build database of positions `[2020, 2023]`
cargo run --features="build-binary" --release --bin etl_positions -- --access-key=DO00AUDGL32QLFKV8CEP --secret-access-key=$(cat secrets.txt)
# they are available at
# https://private-jets.fra1.digitaloceanspaces.com/position/icao_number={icao}/month={year}-{month}/data.json

# Build database of legs `[2020, 2023]` (over existing positions computed by `etl_positions`)
cargo run --features="build-binary" --release --bin etl_legs -- --access-key=DO00AUDGL32QLFKV8CEP --secret-access-key=$(cat secrets.txt)
# they are available at
# https://private-jets.fra1.digitaloceanspaces.com/leg/v1/data/icao_number={icao}/month={year}-{month}/data.csv

Methodology

The methodology used to extract information is available at methodology.md.

Generated datasets

Set of worldwide aicrafts whose primary use is to be a private jet:

• Data
• Description