Microsoft Azure Blob Storage connection

To access your data in Microsoft Azure Blob Storage, create a connection asset for it.

Azure Blob Storage is used for storing large amounts of data in the cloud.

Create a connection to Microsoft Azure Blob Storage

To create the connection asset, you need the following connection details:

  • Container: The name of the container that contains the files to access.

Credentials

You have specific authentication methods based on your deployment:

Note: Prerequisite for Entra ID authentication:

Microsoft Entra ID is a cloud-based identity and access management service. To obtain connection values for the Entra ID authentication method, sign in to the Microsoft Azure portal and go to your storage account. For information about Microsoft Entra ID, see What is Microsoft Entra ID?.

Common connectivity

Authentication methods for common connectivity:

Connection string

  • Connection string: Connection string from the storage account's Access keys page on the Microsoft Azure portal.

Example connection string, which you can find in the ApiKeys section of the container:

DefaultEndpointsProtocol=https;AccountName=sampleaccount;AccountKey=samplekey;EndpointSuffix=core.windows.net

Entra ID client secret credential

  • Tenant ID: The Microsoft Entra tenant ID. To find the Tenant ID, go to Microsoft Entra ID> Properties. Scroll down to the Tenant ID field. For more information, see How to find your Microsoft Entra tenant ID.
  • Client ID: The client ID for authorizing access to Microsoft Azure Blob Storage. To find the Client ID for your application, select Microsoft Entra ID. From App registrations, select your application. Click Copy to copy the Client ID of your application. For more information, see Register a Microsoft Entra app and create a service principal.
  • Client secret: The authentication key that is associated with the client ID for authorizing access to Microsoft Azure Blob Storage. To find the Client secret for your application, select Microsoft Entra ID. From App registrations, select your application. Go to Certificates & secrets > Client secrets. Click Copy to copy the existing Client secret or click New client secret to create a new Client secret and copy it. For more information, see Register a Microsoft Entra app and create a service principal.
  • Storage account URL: Storage account URL.

Entra ID username password credential

  • Client ID: The client ID for authorizing access to Microsoft Azure Blob Storage. To find the Client ID for your application, select Microsoft Entra ID. From App registrations, select your application. Click Copy to copy the Client ID of your application. For more information, see Register a Microsoft Entra app and create a service principal.
  • Username and Password: Username and password for the Microsoft Azure Blob Storage account. You need permission to access the blob without multi-factor authentication.
  • Storage account URL: Storage account URL.

StreamSets

Authentication methods for StreamSets:

Azure Managed Identity

  • Client ID: The client ID for authorizing access to Microsoft Azure Blob Storage. To find the Client ID for your application, select Microsoft Entra ID. From App registrations, select your application. Click Copy to copy the Client ID of your application. For more information, see Register a Microsoft Entra app and create a service principal.

Connection string

  • Connection string: Connection string from the storage account's Access keys page on the Microsoft Azure portal.

Example connection string, which you can find in the ApiKeys section of the container:

DefaultEndpointsProtocol=https;AccountName=sampleaccount;AccountKey=samplekey;EndpointSuffix=core.windows.net

Entra ID client secret credential

  • Tenant ID: The Microsoft Entra tenant ID. To find the Tenant ID, go to Microsoft Entra ID> Properties. Scroll down to the Tenant ID field. For more information, see How to find your Microsoft Entra tenant ID.
  • Client ID: The client ID for authorizing access to Microsoft Azure Blob Storage. To find the Client ID for your application, select Microsoft Entra ID. From App registrations, select your application. Click Copy to copy the Client ID of your application. For more information, see Register a Microsoft Entra app and create a service principal.
  • Client secret: The authentication key that is associated with the client ID for authorizing access to Microsoft Azure Blob Storage. To find the Client secret for your application, select Microsoft Entra ID. From App registrations, select your application. Go to Certificates & secrets > Client secrets. Click Copy to copy the existing Client secret or click New client secret to create a new Client secret and copy it. For more information, see Register a Microsoft Entra app and create a service principal.
  • Storage account URL: Storage account URL.

Supported file types

The Azure Blob Storage connection supports structured and unstructured file formats.

The connection supports the following structured file types: Avro, CSV, Delimited text, Excel, JSON, ORC, Parquet, SAS, SAV, SHP, and XML.

The connection supports modes for reading and writing binary data. These modes can be used to read and write the unstructured data formats such as: DOC, DOCX, MD, PDF, PPT, PPTX, and TXT.

Table formats

The Azure Blob Storage connection supports these Data Lake table formats: Delta Lake and Iceberg.

Learn more