Azure Data Warehouse Data Ingestion using Azure Synapse Analytics

Data Ingestion Process for Azure Data Warehouse using Azure Synapse Analytics

Prev Question Next Question

Question

Note: This question is a part of series of questions that present the same scenario. Each question in the series contains a unique solution. Determine whether the solution meets the stated goals.

You develop a data ingestion process that will import data to an enterprise data warehouse in Azure Synapse Analytics. The data to be ingested resides in parquet files stored in an Azure Data Lake Gen 2 storage account.

You need to load the data from the Azure Data Lake Gen 2 storage account into the Data Warehouse.

Solution:

1. Create a remote service binding pointing to the Azure Data Lake Gen 2 storage account

2. Create an external file format and external table using the external data source

3. Load the data using the CREATE TABLE AS SELECT statement

Does the solution meet the goal?

Answers

Explanations

Click on the arrows to vote for the correct answer

A. B.

B

You need to create an external file format and external table from an external data source, instead from a remote service binding pointing.

https://docs.microsoft.com/en-us/azure/sql-data-warehouse/sql-data-warehouse-load-from-azure-data-lake-store

The solution provided for loading data from Azure Data Lake Gen 2 storage account to Azure Synapse Analytics data warehouse involves the following steps:

  1. Create a remote service binding pointing to the Azure Data Lake Gen 2 storage account.
  2. Create an external file format and external table using the external data source.
  3. Load the data using the CREATE TABLE AS SELECT statement.

Step 1: Create a remote service binding pointing to the Azure Data Lake Gen 2 storage account A remote service binding is used to establish a connection to an external data source from within Azure Synapse Analytics. In this case, a remote service binding is created to connect to the Azure Data Lake Gen 2 storage account.

Step 2: Create an external file format and external table using the external data source An external file format defines the structure of the data files being ingested, such as the delimiter, encoding, and data type of each column. An external table is created based on the external file format, and it represents the schema of the data to be ingested. The external data source is used to specify the connection details and credentials for the Azure Data Lake Gen 2 storage account.

Step 3: Load the data using the CREATE TABLE AS SELECT statement The CREATE TABLE AS SELECT statement is used to insert data from the external table into a new or existing table within the Azure Synapse Analytics data warehouse.

Overall, the solution provided is a valid approach to load data from an Azure Data Lake Gen 2 storage account to an Azure Synapse Analytics data warehouse. Therefore, the answer is A. Yes, the solution meets the goal.

Prev Question Next Question