Configure Connection to ELT Source¶
Alation Cloud Service Applies to Alation Cloud Service instances of Alation
Customer Managed Applies to customer-managed instances of Alation
After installing the dbt Gen2 OCF connector, you need to configure the connection to dbt as part of setting up the ELT dbt source. Depending on your dbt deployment type, choose either dbt Cloud or dbt Core.
Follow these steps to configure the connection to dbt:
Configure Authentication for dbt Cloud¶
In the Configure authentication section of General Settings tab, click DBT Cloud.
The dbt Gen2 OCF connector for dbt Cloud supports authentication using Personal Access Tokens (PATs) or service tokens.
Perform the following steps to configure authentication in Alation UI:
On the Settings page of your dbt Gen2 ELT source, go to the General Settings tab.
Provide the following information:
Parameter
Description
dbt Cloud Admin API Endpoint
Specify the Admin API URL to access dbt. Format:
https:://<hostname>
dbt Cloud Account Id
Specify the service account id to access dbt.
dbt Cloud Discovery API Endpoint
Specify the Admin API URL to access dbt for extracting metadata from dbt Discovery API. Format:
https:://<hostname>/graphql
Token
Specify the dbt Resource URL used to grant access scope dbt APIs. You can either use Personal Access Token or service token.
Click Save.
Configure Authentication for dbt Core¶
Configure the authentication based on your dbt file storage location:
GitHub¶
To configure authentication for GitHub, perform the following steps:
On the Settings page of your dbt Gen2 ELT source, go to the General Settings tab.
In the Configure authentication section, click DBT Core.
Provide the following information on the GitHub tab:
Parameter
Description
GitHub URL
Specify the URL of the GitHub repository where the dbt projects are stored. Format:
https://github.com/<user_name>/<repository_name>
Location
Specify the location of the dbt projects within the GitHub repository. Alation considers the immediate folders under this location as the dbt project.
Access Token
Specify the GitHub access token. Ensure that the token includes the
repo
as the GitHub Scope.Click Save.
Amazon S3¶
To configure authentication for Amazon S3, perform the following steps:
On the Settings page of your dbt Gen2 ELT source, go to the General Settings tab.
In the Configure authentication section, click DBT Core.
Provide the following information on the Amazon S3 tab:
Parameter
Description
AWS region
Specify your AWS S3 region, for example
us-east-1
Access key
Specify the access key of the AWS IAM user.
Secret access key
Specify the secret access key of the AWS IAM user.
Bucket name or Path
Specify the S3 bucket name or the path to the dbt project within S3. If you specify the bucket name. Alation checks for dbt projects at the bucket root level. Path formats: bucket-name/path-to-dbt-projects/ s3://bucket-name/path-to-dbt-projects/
Click Save.
Azure Blob Storage¶
To configure authentication for Azure Blob storage, perform the following steps:
On the Settings page of your dbt Gen2 ELT source, go to the General Settings tab.
In the Configure authentication section, click DBT Core.
Provide the following information on the Azure Blob Storage tab:
Parameter
Description
Storage account name
Specify the Azure storage account name.
Shared access signature
Turn on the toggle to authenticate using shared access signature.
Access key/Shared Access signature
Specify the access key or specify the shared access signature if you are using it to authenticate.
Storage endpoint suffix
Specify the storage endpoint suffix.
Location
Enter the name of the container or the path to the dbt project within the container. If you specify the container name, Alation checks for dbt projects at the container root level. Path formats: container-name/path-to-dbt-projects/
Click Save.
Test the Connection¶
The connection test checks connectivity to dbt.
To validate the network connectivity, go to General Settings > Test connection of the Settings page of your dbt Gen2 ELT source and click Test.
A dialog box appears confirming the status of the connection test.
Configure Logging¶
To set the logging level for your dbt Gen2 OCF ELT source logs, perform these steps:
On the Settings page of your dbt Gen2 OCF ELT source, go to General Settings > Connector logs.
Select a logging level for the connector logs and click Save.
The default log level is INFO.