We’re looking at moving our data from an on-prem Microsoft SQL Server to AWS and are looking into various table formats like Hudi, Delta Lake, and Apache Iceberg. Our current setup in SQL Server uses auto-increment IDs for most of our primary keys and it doesn’t seem Iceberg has a straightforward equivalent.
I’m trying to figure out the best way to deal with unique identifiers in Iceberg, especially since we rely on these auto-increment IDs a lot. For example, taking a stockmarket example, you would have a Security table with details like Security Code, Description, and ISIN, and a Price table where each price entry is linked to a security via its ID.
Any suggestions on how to replicate or replace the auto-increment functionality in Iceberg?