I am using Databricks (14.3 LTS, Apache Spark 3.5.0, Scala 2.12)
I have created a view, then I noticed that I need to change its columns, and then I couldn’t recreate it with a new schema. Furthermore, I have tried to drop it and create once again, but it didn’t help, IU always get the error:
[CANNOT_RECOGNIZE_HIVE_TYPE] Cannot recognize hive type string: “”, column: vca_columns
. The specified data type for the field cannot be recognized by Spark SQL. Please check the data type of the specified field and ensure that it is a valid Spark SQL data type. Refer to the Spark SQL documentation for a list of valid data types and their format. If the data type is correct, please ensure that you are using a supported version of Spark SQL. SQLSTATE: 429BB, db: mes, table: measurement_cols.
So now I cannot drop or recreate the view. SQL command doesn’t work, WEB UI neither.
Did anybody face the issue?
Is there is any option to do a “force” drop of a view?
I didn’t find any similar options in the official documentation.
I appreciate any help!
#views #drop #hivetypes