unity-catalog

Databricks framework to validate Data Quality of pySpark DataFrames and Tables

End-to-end Data Lakehouse project built on Databricks, following the Medallion Architecture (Bronze, Silver, Gold). Covers real-world data engineering and analytics workflows using Spark, PySpark, SQL, Delta Lake, and Unity Catalog. Designed for learning, portfolio building, and job interviews.

Automated migrations to Unity Catalog

A cloud-native data pipeline and visualization project analyzing Formula 1 racing data using Azure, Databricks, Delta Lake, Tableau, and Python for insightful EDA and interactive dashboards.

Open, Multi-modal Catalog for Data & AI, written in Rust

Production-ready PySpark ETL template for Databricks — medallion architecture, DABs, tests, DQX, CI/CD, and agentic development with Claude Code.

Notebooks, terraform, tools to enable setting up Unity Catalog

Visual intelligence tool for Databricks workspaces. Builds a live ontology of Unity Catalog assets, compute, jobs, dashboards, and apps as entities with semantic relationships, enriched with cost attribution, lineage, and governance insights.

Production-grade Databricks infrastructure templates for Azure. Deploy in 20 minutes with VNet injection, Unity Catalog, managed identity. Perfect for learning and prototyping. Free and open source.

AI-powered Databricks platform engineering — provision workspaces, configure Unity Catalog, manage identity & governance, and set up networking across Azure, AWS, and GCP, all through natural language with Claude.

Unity Catalog Explorer is a TypeScript + Next.js based Web UI for the Unity Catalog OSS.

Open-source community study guide for all six Databricks certifications (Data Engineer Associate / Professional, Data Analyst Associate, ML Associate / Professional, GenAI Engineer Associate). Aligned to the 2025-2026 official exam guides. Obsidian-flavoured Markdown; PRs welcome.

How to Configure Azure Databricks Unity Catalog using Terraform

SchemaX - Automatic Schema Management

Databricks cost observability app — cloud-agnostic, MOCK_MODE for free-tier workspaces

End-to-end Azure Databricks retail data engineering project using Medallion Architecture (Bronze, Silver, Gold). Implements Auto Loader, Unity Catalog, Delta Lake, SCD Type 1 & 2 dimensions, and Fact Orders for analytics-ready star schema modeling.

The Internals of Unity Catalog

Enterprise Databricks app factory using @databricks Genie Code Agent Mode — 90+ apps at Alpura. Presented at DATA+AI Summit 2026.

Production-ready support ticket classification using Unity Catalog AI Functions, Vector Search, and RAG. Features 6-phase workflow, knowledge base integration, and Streamlit dashboard.

Per-user Genie DBU usage dashboard for Databricks — safe to share account-wide without exposing billing system tables. Deploy anywhere in two commands.