Relative Content

Tag Archive for sqlscalaapache-sparkamazon-s3datasource

How to build Apache Spark 3.0 Data Source V2 or V1?

I am trying to build a spark 3.0 custom data source (either v1 or v2). There are a large number of tutorials online but many of them use TableProvider. I am interested in using RelationProvider instead because of the ability to perform DDL operations.