I have an Azure ADF pipeline which selects a delta of records from a table, of which some columns are DateTimeOffset columns. The sink is doing an upsert into a MongoDB Atlas collection. The value being stored in MongoDB is being stored as a string value instead of the required mongodb date value.
This is fine until I need to do filtering on the date using .Net OData which then fails. See below:
The output in MongoDB currently
This is what it should look like:
Desired output
Tried:
- Writing an aggregation in MongoDB, but this is not sustainable due to generic nature of the ETL
- Tried investigating JSON path mapping using dynamic expressions in ADF with no luck.
New contributor
Adrian de Vries is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.