Implementing Slowly Changing Dimension Type-2 (SCD Type-2) in PySpark with Delta Lake

Introduction