Unexplained s3 slowdowns when ingesting data to hudi tables using spark/python Glue jobs
I’m using AWS Glue Spark/python jobs to ingest data into hudi tables in a s3 bucket. I’m hitting major s3 slowdown issues, in a way that goes beyond reasonable, but unable to pin down the root cause.