Skip to content

πŸŽ₯🌲πŸ”₯ Improving wildfire smoke detection models by creating virtual fine-tuning data in Unreal Engine.

Notifications You must be signed in to change notification settings

parkeraddison/smoke-and-mirrors

Folders and files

NameName
Last commit message
Last commit date

Latest commit

Β 

History

21 Commits
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 

Repository files navigation

(More Than) Smoke and Mirrors: Using Virtual Data to Fine-tune Real World Wildfire Smoke Detection

Improving wildfire smoke detection models by creating virtual training data with Unreal Engine 5.

This repository contains UE source code for creating environments to capture virtual smoke imagery, Python scripts implementing smoke detection machine learning models, and notebooks evaluating model performance when trained on real data versus fine-tuning with virtual data sources.

Contents:

Path Description
src/ Source code for preprocessing and loading data, training and evaluating models, and utils
VirtualSmoke/ Unreal Engine 5.0.3 project for generating virtual smoke images
1_Datasets.ipynb Downloading and organizing data sources; Instructions for generating the virtual images; Preprocessing the data
2_Model.ipynb Training a model on various combinations of data sources
3_Experiment.ipynb Replicating many trials of model training on different combinations of data sources; Analysis of the results

Dependencies

Notebooks:

Virtual Smoke Generation:

  • Unreal Engine 5
    • Plugin: Cesium for Unreal
    • Plugin: Volumetrics
    • Content: UE5 Starter Content

Acknowledgements