I’ve been working on this project where my responsibilities are to code for validating, processing and then dumping into database excel file.

Me and my colleague tried multiple approaches to make it generic as much as possible but it seems to be not achievable (that’s what I and he think).

Our last generic approach is that, we moved our business validation into query means no more code, we were validating, processing and dumping (insertion/updation) with query.

The real problem is that whenever there any new columns added into we need to modify whole query all the time and it is so much time-consuming even for one column.

When we were trying “Query Method” we came to know about that processing csv file is much easier and more efficient than excel so we convert our excel to csv and then we use “COPY” method of PostgreSQL to copy from csv to temporary table.

Is there any way I can make this process fully generic?