search

datahub-project / datahub

The Metadata Platform for your Data and AI Stack
https://datahubproject.io
Apache License 2.0
9.93k stars 2.94k forks source link

Azure AD ingestion source doesn't work with v2 (Entra ID) endpoints #11856

Open wfrced opened 1 week ago

wfrced commented 1 week ago

Describe the bug

Currently v2 endpoints are stated to not be supported. However, the only reason for this I could find is the strict enforcement of request fields schema by the v2 endpoints (v2 endpoints don't know about resource fields), and it seems like a trivial change to request formation would make it work - I've tested it using a custom ingestion source and it works.

To Reproduce

Steps to reproduce the behavior:

  1. Try to ingest Azure AD data from Entra ID source (UI/CLI)
  2. Get an HTTP 400 error

Additional context

Should be fixed by https://github.com/datahub-project/datahub/pull/11749