How To Run Ingestion Pipeline Via CLI with Basic Auth
Out of the box, OpenMetadata comes with a Username & Password Login Mechanism.
Basic Authentication Basic Authentication
From 0.12.1
OpenMetadata has changed the default no-auth
to Basic
auth, So to run any ingestion pipeline from CLI you will have to pass the jwtToken
and authProvider
in the securityConfig
.
How to get the JWT token
Go to the
settings
page from the navbar and then scroll down to theIntegrations
Section. Click on theBots
and you will see the list of bots, then click on theingestion-bot
.You will be redirected to the
ingestion-bot
details page. there you will get the JWT token, click on the copy button and copy the JWT token.
Alright, now you have the JWT token, let see how to add that into the workflow config.
How to add JWT token into the workflow config
Now Past the copied JWT Token into your pipeline securityConfig
, So your final workflow config will look like this.
AuthProvider Should be openmetadata i.e authProvider: openmetadata
workflowConfig:
openMetadataServerConfig:
hostPort: http://localhost:8585/api
authProvider: openmetadata
securityConfig:
jwtToken: 'eyJraWQiO...'
Now you can run the pipeline by running.
metadata ingest -c ./pipeline_name.yaml