Reprocess Lineage for Views (Beta)

Alation Cloud Service Applies to Alation Cloud Service instances of Alation

Customer Managed Applies to customer-managed instances of Alation

Available from version 2024.3.4

Important

You are viewing documentation for Classic Alation.

Starting in version 2024.3.4, Data Source Admins who also hold the role of Catalog Admin or Server Admin can reprocess lineage for view objects in a data source.

Reprocessing is a job on the Alation server that recalculates the lineage data for views in a data source.

You may need to reprocess lineage for views if users report that lineage data for those views doesn’t appear on lineage charts or that the lineage charts for those view objects are not displayed at all.

Note

Limitation: The view reprocessing capability is not available for the Databricks Unity Catalog OCF connector.

To reprocess lineage for views:

  1. Click on More on the top right of the data source catalog page and in the dropdown menu that opens, click Settings.

    ../../_images/Lineage_OpenSettings_Classic.png

  2. On the Settings page, click the Lineage Settings tab to open it.

  3. Under the Lineage Processing for Views section of Lineage Settings, find two options for reprocessing views:

    • Reprocess All Views—Triggers the parse_all_view_info_in_ds job to reprocess all views in the current data source.

    • Reprocess Failed Views—Triggers the parse_all_view_info_in_ds job but only for views where lineage creation previously failed due to a parsing error. This option is useful when a new General SQL Parser (GSP) update introduces support for previously unsupported view query syntax.

    Click either Reprocess All Views or Reprocess Failed Views as needed.

    ../../_images/Lineage_DataSourceSettings_ReprocessViews.png

  4. You’ll see a status message at the bottom of the page that confirms that a reprocessing job is queued.

    ../../_images/Lineage_DataSourceSettings_ReprocessMessage.png

  5. Server Admins can monitor the reprocessing job in Admin Settings > Monitor > Active Tasks or Completed Tasks. The task name to monitor is parse_all_view_info_in_ds.

  6. Once the reprocessing job completes, review the lineage charts for views where users reported issues with lineage display.

Additional Lineage Reprocessing Capabilities

Users with the Catalog and Server Admin roles can Run Lineage Diagnostics directly from the Lineage tab on the catalog page of a specific view.