How to use livy or spark_shell with external library
I try to use livy statement to submit a piece of scala code that reads lucene index and then read S3 files. As you can imagine, I try to use spark/livy to search data. Is that possible? How to include those jars into the session? I assume I should have them set up when calling the livy API to create the session.