We use cookies to improve site navigation, analyze site usage, and enhance your user experience. Click "Accept" to enable cookies or "Reject" to reject cookies.

main-concepts

No menu items for this category
Home/Main Concepts/Metadata Standard/Schemas/Metadataingestion/Dbtpipeline
OpenMetadata Documentation

dbtPipeline

dbt Pipeline Configuration.

Properties

  • type: Pipeline type. Refer to #/definitions/dbtConfigType. Default: dbt.
  • dbtConfigSource: Available sources to fetch dbt catalog and manifest files.
  • searchAcrossDatabases (boolean): Optional configuration to search across databases for tables or not. Default: False.
  • dbtUpdateDescriptions (boolean): Optional configuration to update the description from dbt or not. Default: False.
  • dbtUpdateOwners (boolean): Optional configuration to update the owners from dbt or not. Default: False.
  • includeTags (boolean): Optional configuration to toggle the tags ingestion. Default: True.
  • dbtClassificationName (string): Custom OpenMetadata Classification name for dbt tags. Default: dbtTags.
  • schemaFilterPattern: Regex to only fetch tables or databases that matches the pattern. Refer to ../type/filterPattern.json#/definitions/filterPattern.
  • tableFilterPattern: Regex exclude tables or databases that matches the pattern. Refer to ../type/filterPattern.json#/definitions/filterPattern.
  • parsingTimeoutLimit (integer): Configuration to set the timeout for parsing the query in seconds. Default: 300.
  • databaseFilterPattern: Regex to only fetch databases that matches the pattern. Refer to ../type/filterPattern.json#/definitions/filterPattern.

Definitions

  • dbtConfigType (string): dbt Config Pipeline type. Must be one of: ['dbt']. Default: dbt.

Documentation file automatically generated at 2025-01-15 09:05:41.923720+00:00.