BigQuery to Pandas Dataframe is super slow
When I run my app queries in BigQuery console, they take 3-4 seconds to return nearly a million rows. The same queries in my streamlit python app (local, community cloud, GCP) all take about 180 seconds to complete including writing the results into a dataframe. Upon instrumentation it shows most of the time is with rowiterator. Is there a different way to do this? Environments have plenty of RAM and CPU.