I have an S3 bucket which contains 1000s of folders which are basically table_names and those contains parquet files.
I’m trying to create tables with that schema in redshift.
I’m using redshift-data api. But getting below error when trying to create more than 500 tables.

Error Category: UNCLASSIFIED_ERROR; Failed Line Number: 93; ActiveStatementsExceededException: An error occurred (ActiveStatementsExceededException) when calling the ExecuteStatement operation: Active statements exceeded the allowed quota (500).

for every table create statement, I’m calling this code

redshift_data_client.execute_statement(
        Database='dev',
        Sql=statement,
        WorkgroupName='rss-workgroup'
    )

and I’m expecting those 1000s of tables to be created without issue.