Coordinating a complicated data migration process
A project I’m involved in has suffered a change in scope, and before I set about trying to cook up some homegrown solution, I’m wondering if there is something out there — some framework, for example — that will spare me from having to design and debug my own code. Let me try to explain the details as simply as possible.
Is ReST useful in Read/Write Operations that involve over 100 Gig
I work in Healthcare and we use SAS to Extract and Transform medical and pharmacy claims data for use in downstream reporting applications. For a given Report Request(usually 40 are running at a time) we have to extract from various DBMS’s and transform the data. Once completed with this ET step, the data is over 100 gig in aggregated form(SAS Tables). This data is indexed and optimized for report consumption. We don’t have to go back to the database after we have extracted the data.
Using ESB for database synchronisation / replication
We’re starting to look at implementing an ESB / Microservices architecture. I (think) I know about the concepts, but there’s one thing I don’t seem to be able to get a good idea about: data replication / synchronisation.