Skip to content

Instantly share code, notes, and snippets.

@julian-west

julian-west/dremio-gcs-config.yaml

Created April 12, 2022 10:08
Show Gist options
  • Save julian-west/fbbfb38700713371b35b5675cb07e636 to your computer and use it in GitHub Desktop.
Save julian-west/fbbfb38700713371b35b5675cb07e636 to your computer and use it in GitHub Desktop.
Download ZIP
Raw
dremio-gcs-config.yaml
# Control where uploaded files are stored for Dremio.
# For more information, see https://docs.dremio.com/deployment/distributed-storage.html
distStorage:
# The supported distributed storage types are: local (<21.0.0 only), aws, azure, gcp, or azureStorage.
#
# local: (<21.0.0 only) Not recommended for production use. When using local, dist-caching is disabled.
# aws: AWS S3, additional parameters required, see "aws" section.
# azure: ADLS Gen 1, additional parameters required, see "azure" section.
# azureStorage: Azure Storage Gen2, additional paramters required, see "azureStorage" section.
# gcp: Google Cloud Storage, additional parameters required, see "gcp" section.
type: "gcp"
# Google Cloud Storage
#
# bucketName: The name of the GCS bucket for distributed storage.
# path: The path, relative to the bucket, to create Dremio's directories.
# authentication: Valid types are: serviceAccountKeys or auto.
# - When using "auto" authentication, Dremio uses Google Application Default Credentials to
# authenticate. This is platform dependent and may not be available in all Kubernetes clusters.
# - Note: When using a GCS bucket on GKE, we recommend enabling Workload Identity and configuring
# a Kubernetes Service Accountfor Dremio with an associated workload identity that
# has access to the GCS bucket.
# credentials: If using serviceAccountKeys authentication, uncomment the credentials section below.
gcp:
bucketName: "<YOUR_BUCKET_NAME>"
path: "/"
authentication: "auto"
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment