Q: How did you manage your data before Snowflake? A: We used Airflow to automate tasks and started doing ETL. As different sources became available, we would write a Python script, which would fetch the data, change it to the format that our analysts wanted, and load it in Amazon S3. We also sourced data from external data sources provided by our partners. For example, Facebook provided a dashboard showing the number of advertisements we had running, our ROI on ad spend, and other metrics. Q: What were some of your pain points at the time? A: Our major pain point was that we had no single source of truth and no standard workflow or procedures. For example, our internal data would often conflict with what we were seeing in our Facebook dashboard. And people would just randomly l

Join for free to read