(https://i.sstatic.net/TMctybFJ.png): This is my Schema for glue table.
(https://i.sstatic.net/6rWDe0BM.png): This is want Data values I get in S3.
But I want to get key Value pair not only values.
I have created Firehose from MSK kafka to S3. In which json data is converted into parquet and stored in s3 via firehose. So I have a payload which is has many nested fields in it and I want to store it with key value pair. But currently I am not able to get Key fields I am getting only value field. I have used Glue Table for schema mapping and Payload is in under Struct. So Any one having any solution for that plz help me out. I don’t want Values in String because I have to query them later
I tried to change Struct to String but it combines all the Columns of payload so not able to run query on that.
Mustafa Khambhati is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.