I want to read all the files from an s3 bucket into a dataframe. I am currently getting my s3 bucket connection from an .Renviron file.
**Sensitive information such as the path has been removed. **
Right now the prefix_path is retuning a list of 0. So it isn’t working as intended.
I would like to see all the files present so then I can combine it into one dataframe.
Below is the code I am currently working with
readRenviron("~/.Renviron")
S3_DASHBOARD_ENV <- Sys.getenv("S3_DASHBOARDENV")
S3_DRUPAL_BUCKET <- Sys.getenv("S3_BUCKET")
prefix_path <- file.path(S3_DASHBOARD_ENV, "path/to/the/data/folder/")
# read all files in path
fpx_files <- get_bucket(bucket = S3_DRUPAL_BUCKET,
prefix = prefix_path,
recursive = TRUE
)