Data Engineering Portfolio
Practical Projects for data collection and automation
š Earthquake Data Pipeline
A full ETL pipeline collecting and analyzing earthquake data from the USGS API.
- Python-based ETL process
- Data storage with PostgreSQL
- Visualization with Streamlit and Leaflet
āļø Weather Alerts ETL Pipeline
An ETL pipeline fetching and analyzing active weather alerts from the NWS API.
- Automated data collection via Python
- PostgreSQL storage of structured alert data
- Interactive dashboard with Streamlit
š¾ Real-Time Data Ingestion
Prototype system for ingesting, processing, and storing real-time environmental data.
- Streaming with Python and Kafka (coming soon)
- PostgreSQL database integration
- Dashboards with Grafana or Streamlit
š Satellite Data ETL (Planned)
Designing a pipeline to process satellite-based environmental data for insights on climate and natural events.
- Working with open-source NASA/ESA datasets
- Python-based extraction and transformation
- Scalable storage solutions (PostgreSQL, AWS)