Google Cloud Storage is a managed service for storing unstructured data.This covers how to load document objects from an
Google Cloud Storage (GCS) directory (bucket)
.
Specifying a prefix
You can also specify a prefix for more fine-grained control over what files to load -including loading all files from a specific folder-.Continue on failure to load a single file
Files in a GCS bucket may cause errors during processing. Enable thecontinue_on_failure=True
argument to allow silent failure. This means failure to process a single file will not break the function, it will log a warning instead.