motion-base

motion-base is a web application that aims to provide a unified entry point for accessing and processing ground motion records from different national databases.

It comes with a web interface and a Python client that can be used to access the data programmatically.

Check out the demo site.

Installation

as a developer

# 1. clone the project
git clone https://github.com/TLCFEM/motion-base.git
cd motion-base
# 2. create a virtual environment and install python dependencies
python -m venv .venv
source .venv/bin/activate
pip install -e .[dev,client]
# 3. install node.js dependencies
cd gui
pnpm install
cd ..

There are no extra steps needed to set up the development environment. To run the application locally, use the following command:

# 1. mongodb and rabbitmq
docker compose -f docker/docker-compose.yml up -d
# 2. backend
python ./mb_runner.py
# 3. celery workers
python ./mb_runner.py celery
# 4. frontend
cd gui
pnpm dev

Use back.Dockerfile and front.Dockerfile to build the docker images for the backend and frontend, respectively.

as a host

To host the application, two files are needed: .env and docker-compose-production.yml.

mkdir motion-base && cd motion-base
wget https://raw.githubusercontent.com/TLCFEM/motion-base/master/docker/.env
wget https://raw.githubusercontent.com/TLCFEM/motion-base/master/docker/docker-compose-production.yml

# edit the .env file to set the correct values
# or create those environment variables in other means
docker compose -f docker-compose-production.yml up -d

It shall run out of the box, but it is recommended to check the settings and adjust accordingly.

It is recommended to use one process per container and scale the application horizontally. To do so, one can check the example given in file docker/docker-compose-production-nginx.yaml. To use it, docker/nginx.conf.sh should also be available.

mkdir motion-base && cd motion-base
wget https://raw.githubusercontent.com/TLCFEM/motion-base/master/docker/.env
wget https://raw.githubusercontent.com/TLCFEM/motion-base/master/docker/nginx.conf.sh
wget https://raw.githubusercontent.com/TLCFEM/motion-base/master/docker/docker-compose-production-nginx.yml

docker compose -f docker-compose-production-nginx.yml up -d

Please feel free to use other tools to deploy the application, such as Kubernetes, Docker Swarm, etc.

as an analyst

# 1. clone the project
git clone https://github.com/TLCFEM/motion-base.git
cd motion-base
# 2. create a virtual environment and install python dependencies
python -m venv .venv
source .venv/bin/activate
pip install .[client]

It is then possible to use the client to access the data.

import anyio

from mb.client import MBClient

api_url = "http://somewhere.the.application.is.hosted"


async def search():
    async with MBClient(api_url) as client:
        results = await client.search({"min_magnitude": 6.0, "min_pga": 200.0})
        for r in results:
            print(r)


if __name__ == "__main__":
    anyio.run(search)

Raw Data Source

The raw data, once downloaded from sources, can be uploaded to the application.

import anyio

from mb.client import MBClient

# assuming the application is running locally
api_url = "http://localhost:8000"
# using the default credentials
username = "test"
password = "password"
region = "jp"


# assume current folder contains the files to be uploaded
async def upload():
    async with MBClient(api_url, username, password) as client:
        await client.upload(region, '.')


if __name__ == "__main__":
    anyio.run(upload)

Japan

The raw data is available at Strong Motion Seismograph Networks. The waveform files in ASCII format *.EW, *.NS, and *.UD can be uploaded and parsed.

New Zealand

The raw data is available at Strong Motion Data Products. The waveform files *.V1A and *.V2A can be uploaded and parsed.