source of data:
the original data that I have problems with resides on my google drive, in the form of a .csv file. It then gets uploaded to bigquery using the add > google drive, no issues here.
size:
the size of .csv file is over 107mb, this is why I can´t upload the csv directly to looker studio, plus it’s easier for me to get the csv data combined with other sources while working with it in BQ, which I can do without any issues.
what I can do:
In BQ: I can work with the data in BQ as usual, I can query/merged/combined the data in the .csv with other sources/tables through a BQ queries
in Looker Studio: I can add the datset as a custom Query from BQ or as view/table. I get no errors when getting the data in using the BQ connector in looker studio the problem starts when I need to use that dataset using a chart element or other dashboard element. no filters used.
where the problem appears:
Once I get a chart or any other data element in looker studio, I get an error that says that Looker Studio Failed to fetch data from the underlying data set, with some apparently random error code.
What I have tried:
-
since the error is common I went through this guide https://www.databloo.com/blog/looker-studio-cannot-connect-to-your-dataset/, no change.. the error continues no matter what.
-
I tried to explore the data (.csv file in question by itself) with looker studio starting from BQ, which starts a new looker studio file and that works, but I can´t reuse the source in any other looker studio file. now if I try to explore with looker studio the query in which I have 3 datasets combined (including the problem .csv) BQ does not give me the option to explore the data with looker studio. (option appears greyed out)
Current work around:
I loaded the problem .csv file to BQ and got a subset of the data in it exported to a google sheet (the original problem .csv has 2.5M rows, the subset I exported to google sheets has 20K), then I re-add the google sheet data with the subset to BQ so I can use the subset data to combine it in BQ with the other 2 sources I used in my query, then I can connect that Query to looker studio with no issues.
I just want to understand why looker can´t connect to the dataset if I use the csv loaded from google drive to bq, why aren´t there any errors when connecting to my full query to looker studio but the error only appears when I need to use the dataset resulting from my custom query? why is it that I can load a google sheet and I have no issues with that source in my custom query but I have issues if the data used in my custom query is sourced from the orignal .csv file stored in google drive?
please note that the csv, the google drive and permissions to access BQ they are all under my google account so I doubt this is a permissions issue.