dataframe schema is as follows

root
|– name: string (nullable = true)
|– address_info: string (nullable = true)

sample contents or address_info column is as below
{[email protected], fqdn=sparp.org, domain=sharp, host=sharp.org, subdomain=, alias=, addr=test, tld=org, [email protected]}

Tried to convert to json by using from_json and using the custom schema to match the address_info, but no luck.

desired output of dataframe is as follows :

name original_email fqdn domain
XXX [email protected] sparp.org sharp

Tried to convert string type column to json by using from_json by using the custom schema to match the address_info, but no luck.

Expected output of dataframe :

name original_email fqdn domain
XXX [email protected] sparp.org sharp