I have a location in ADLS and need to ingest data from said location into Unity Catalog.
This directory in ADLS has a mixture of .txt, .txt.parquet and .parquet.
I am using autoloader and parquet option to ingest this data.
<code>CREATE STREAMING LIVE TABLE Example_raw
TBLPROPERTIES ("quality" = "bronze")
AS SELECT * FROM cloud_files("/mnt/Example", "parquet");</code>
<code>CREATE STREAMING LIVE TABLE Example_raw
TBLPROPERTIES ("quality" = "bronze")
AS SELECT * FROM cloud_files("/mnt/Example", "parquet");</code>
CREATE STREAMING LIVE TABLE Example_raw
TBLPROPERTIES ("quality" = "bronze")
AS SELECT * FROM cloud_files("/mnt/Example", "parquet");But the presence of .txt and txt.parquet files is causing the ingestion to fail.
Can autoloader handle multiple file types in a ingestion?
Thanks