A modern, open-source data platform built entirely with Python tools, demonstrating a complete end-to-end data pipeline for Star Wars film data.

• Data Ingestion: dlt for extracting data from the Star Wars API
• Data Warehouse: DuckDB for fast, embedded analytics
• Data Transformation: dbt for SQL-based data modelling
• Data Orchestration: Dagster for pipeline management
• Data Visualization: Streamlit for interactive dashboards

• Python 3.8+
• just command runner (optional)

1. Clone the repository:

git clone https://github.com/your-username/pystack.git cd pystack

2. Create and activate a virtual environment:

uv sync

just bi # Or manually:cd src && streamlit run visualisation/app.py

just orchestrate # Or manually: dagster dev -f src/orchestration/definitions.py

just duck # Or manually: duckdb src/pystack.duckdb

just dbt-docs

pystack/ ├── src/ │ ├── orchestration/ # Dagster pipeline definitions │ ├── transformation/ # dbt models and configurations │ └── visualisation/ # Streamlit dashboard ├── justfile # Command shortcuts └── README.md 

• Financials: View film budgets, box office revenue, and ROI
• Attributes: Analyze species, characters, planets, and starships per film

This project is open source and available under the MIT License.

• Star Wars API (SWAPI) for providing the data
• PyConDE 2025 for inspiration

Built using Python for PyCon DE and PyData 2025