im trying to split data from a csv and import it in two different tables in postgresql.
im using in visual glue the “split dataset by fields” function but after configuring both outputs I try to connect it to a databse/catalog but encountering the error: “Parent node Split Dataset By Fields outputs a collection, but node AWS Glue Data Catalog does not accept a collection”
after searching online it should be first connected to a change schema but when I add it I get the same problem: “Parent node Split Dataset By Fields outputs a collection, but node Change Schema does not accept a collection.”
im new to glue and starting to doubt this tool such basic steps are difficult to navigate (used to work with visual studio which is much more intuitive)
and im wondering why I cant find a lot of answers online about these problems. Am I here tatoally on the wrong path? (e.g. glue visual is useless and I have to do it all via coding and pyspark)
thanks