How i build a Metadata-Driven Incremental Ingestion Platform with Azure Data Factory and Databricks

How I stopped duplicating pipelines and started treating ingestion as a metadata problem.