Oct 2, 2023
Use spark querying services like EMR/ Athena/ Glue to query the delta tables accordingly.
You should only query lightweight tables to avoid high costs. To get those tables, you need to perform some data engineering.
Written by Nicholas Leong
Data Engineer — Crunching data and writing about it so you don’t get headaches. 1M+ reads on Medium. https://www.linkedin.com/in/nickefy/