06 Lakehouse Optimizations

To ensure consistent performance in a Microsoft Fabric environment, Lakehouse tables need to be optimized. The Spark notebook Optimize Delta Lake Tables achieves this by compacting small files and cleaning up unused files. This notebook can set to run on a maintenance schedule. It utilizes the optimizeDelta() function from the DeltaLakeFunctions notebook to iterate through each table in the Lakehouse.