Accessing CDH Data

Using Jupyter Notebooks

In the follwoing you can find some basic Jupyter Notebooks examples how to access cdh data by using role chaning

https://bmw.ghe.com/connected-ai/playground/tree/main/cdh-managed-environment

Writing Data Back to CDH

As a consumer of CDH datasets, you do not have the permission to write any data back to the buckets from which the datasets are consumed. Only provider accounts can do that and have write permissions to their provider buckets. An environment can be both a consumer and a provider account. You can also create dedicated provider accounts.

Writing data back to CDH means the creation of a new dataset. How a new dataset can be created from the Cloud Data Hub portal UI is described here.

All steps described in the documentation above should be accessible via the CDH API and can be automated.

As soon as a dataset has been created within the data portal, it just contains metadata information and no environment is associated with the new dataset. When creating a new resource (e.g., filestore → S3 Bucket), an existing environment has to be selected that will act as a provider environment (i.e., provider account). The provider account has the permissions to write data into the S3 bucket.

You are not allowed to write any data into buckets you are consuming, only into those you are providing.