Metadata-driven framework for Databricks Spark Declarative Pipelines. Config-driven, pattern based approach to batch & streaming across the medallion architecture. Deploys via Declarative Automation Bundles. Built for simplicity, extensibility, and alignment with the Databricks product roadmap.

Medallion Architecture for Data Engineering projects

Declarative Implementation of Medallion Architecture - using Opinionated Open-source libraries at different Layers

Mineral process quality forecasting on Databricks — flotation plant ML platform with SPC charts, what-if simulator, and Medallion architecture. Real industrial data (737K rows, 24 sensors).

ZippyHunt is a city-wide event platform designed to connect people, local businesses, and community organizations through immersive scavenger hunts. These events promote exploration, support local commerce, and foster civic pride — all wrapped in a fun and social gamified experience.

71M Steam reviews × IGDB in a Microsoft Fabric medallion lakehouse, measuring where review sentiment disagrees with the thumbs.

Full-featured Apache Iceberg lakehouse data engineering lab with 19 Spark scenarios in Scala and PySpark, 2 CI-verified Maven Scala Spark applications built by Jenkins and orchestrated by Airflow, Trino SQL and BI, Redpanda streaming, and a medallion architecture across bronze, silver, and gold layers using Docker Compose to run the Atlas platform.

This small project contains SQL and raw data used to build a Snowsight (Snowflake) dashboard for hotel bookings

A hands-on project that builds a modern ELT pipeline and dashboard entirely in code — using Python, BigQuery, and Streamlit.

Databricks Finance End to End Project

⬡ TRUSTINT — Trust Intelligence Architecture · provenance-first substrate for trust governance · SQLite (WAL+FTS5) · explicit db_path · idempotent ingest · ADR-driven · collapse-aware · 🥉 v0.1.1

A comprehensive guide to building a data warehouse with SQL Server, including ETL processes, data modeling, and analytics.

Building a modern data warehouse with SQL Server, automated ETL processes, data modeling, and analytics.

Arquitectura medallion usando databricks y azure. Diseño un flujo ETL

Medallion ETL pipeline on Databricks ingesting 1.65B LANL cybersecurity events into Delta Lake with ML-ready feature tables

Automated job hunting pipeline — scrapes vacancies, filters and scores them with AI, and delivers the best matches via Telegram.

A self-evolving, AI-governed cognitive data architecture

A modern data warehouse using the batch processing. And ETL implementation on CRM and ERP data.