To set up Azure Blob as data lake, you need to follow below steps
1. Navigate to Settings.
2. Click on Destination
3. Click on Setup Data Lake.
4. Insert all the data lake specific credentials, along with a name and description for the connection.
5. Click on Validate
and then Create
to save the data lake connection.
Azure Blob Storage Account Key | Account key of Azure Blob Storage |
Azure Blob Storage Account Name | Corresponding account name of Azure Blob Storage Account |
Output Format | Output data format |
Normalization | Whether the input data be normalized |
Azure Blob Storage Bucket Name | Name of the Azure Blob Storage container |
Endpoint Domain Name | Endpoint domain of Azure Blob Storage |
Azure Blob Storage Buffer Size | The amount of megabytes to buffer for the output stream to Azure |
Azure Blob Storage file spill size | The amount of megabytes after which the container should spill the records in a new blob object |
SHA Key |
To set up SQL Server as data warehouse, you need to follow below steps
1. Navigate to Settings.
2. Click on Destination
3. Click on Setup Data Warehouse.
4. Insert all the data warehouse specific credentials, along with a name and description for the connection.
5. Click on Validate
and then Create
to save the data warehouse connection.
Host | Host name of MS SQL database |
Port | Port of MSSQL database |
DB Name | Name of MSSQL database |
Default Schema | Default schema |
User | Username to access database |
Password | Password associated with the username |
JDBC URL Params | Additional properties to pass JDBC URL string when connecting to database |
Raw Table Schema name | Schema to write raw tables into |
SSL Method | Encryption method used to communicate with the database |
SSH Tunnel Method | Whether to initiate SSH tunnel before connecting to the database |