Azure Data Engineering: Loading Parquet Data into Azure Blob Storage | Authentication Mechanisms

Loading Parquet Data into Azure Blob Storage

Question

Natalie is a data analyst working on Cloud Data engineering projects where she has to load bulk data through COPY statement into Synapse SQL.

The ingested file type is Parquet.

She needs to load the data into Azure Blob storage.

Which kind of authentication mechanism can be used for ingestion?

Answers

Explanations

Click on the arrows to vote for the correct answer

A. B. C. D. E.

Correct Answer: A.

In order to load bulk data through COPY statement into Synapse SQL, Natalie needs to authenticate herself to Azure Blob storage. The ingested file type is Parquet, and the data needs to be loaded into Azure Blob storage. There are multiple authentication mechanisms that can be used to ingest data into Azure Blob storage.

A. SAS and Storage account Key:

SAS (Shared Access Signature) is a token that allows access to a resource for a specific period of time. It can be used to provide temporary access to Azure Blob storage. The storage account key is a primary or secondary key that provides access to the entire storage account. Both SAS and Storage account key can be used for authentication.

B. Storage account Name and Key:

The storage account name and key can also be used for authentication. The storage account key is a primary or secondary key that provides access to the entire storage account.

C. Blob storage endpoint:

The Blob storage endpoint is the URL used to access Azure Blob storage. It can be used for authentication.

D. Service Principal:

A Service Principal is a security identity used by applications, services, and automation tools to access Azure resources. It can be used for authentication to Azure Blob storage.

E. MSI (Managed Service Identity):

Managed Service Identity is an Azure service that provides an automatically managed identity in Azure Active Directory. It can be used for authentication to Azure Blob storage.

In conclusion, Natalie can use any of the above-mentioned authentication mechanisms for ingestion. However, SAS and Storage account Key or Storage account Name and Key are the most common mechanisms used for authentication when loading data into Azure Blob storage.