MDA TCH SPT DE DED(Data Engineering Digest) Taming the Cloud: How to Optimize S3 API Calls when Querying Parquet with Apache Spark When running Apache Spark queries or adding code to get parquet footer / metadata to make decision to skip the parquet file reading ( over…
