Skip to content

ngshiheng/cafireshistorydb

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

39 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

California Fires History DB

Tracking fire data from www.fire.ca.gov/incidents.

This project is inspired by and adapts the work from simonw/ca-fires-history. Instead of using Git scraping, this project stores the data in a SQLite database and uses GitHub artifacts for storage.

Read more...

How It Works

graph TB
	subgraph Railway
        deployment[Datasette]
        class deployment Railway;
    end

    subgraph GitHub
        subgraph Actions
            scraper[scrape.py]
        end
        subgraph Artifacts
            db[(fires.db)]
            class db artifacts;
        end
    end

    subgraph CAL FIRE
        api[API]
    end

    db --> |1: Download| scraper
    api --> |2: Fetch Data| scraper
    scraper --> |3: Upload| db
    scraper --> |4: Publish| deployment
    deployment --> |5: View/Access Data| client[User]
Loading

Usage

Running the Script

To run the script locally and update the database:

python3 scrape.py

Optional: Running Datasette

To view and explore the data using Datasette:

pip install datasette # optional: install Datasette if you haven't already

datasette data/fires.db --metadata data/metadata.json

License

This project is licensed under the MIT License.

Disclaimer

This software is only used for research purposes, users must abide by the relevant laws and regulations of their location, please do not use it for illegal purposes. The user shall bear all the consequences caused by illegal use.