I have over 200 partitioned Parquet files stored in an S3 bucket under a common prefix. Currently, to load the data, I need to list all the individual file paths under the prefix and run the COPY command separately for each file in a loop.
It would be extremely helpful to have native support for loading all Parquet files from a given S3 prefix in a single COPY operation, rather than having to specify each file individually. This would greatly simplify the workflow.