open-metadata / OpenMetadata

OpenMetadata is a unified metadata platform for data discovery, data observability, and data governance powered by a central metadata repository, in-depth column level lineage, and seamless team collaboration.
https://open-metadata.org
Apache License 2.0
5.5k stars 1.04k forks source link

Qlik Sense Exclude the draft dashboards #12964

Closed aknoda closed 7 months ago

aknoda commented 1 year ago

When I ingest the Qlik Sense apps, the unpublished apps are coming. I wish there was a way to be able to import only published apps. Thanks

ulixius9 commented 1 year ago

Hey @aknoda, We will need your help to fix this issue, can you please help us with the engine api response for any unpublished app.

thiagopirex commented 1 year ago

Hi @ulixius9 . I have the same need, and I guess this maybe help you.

For example, this is our request:

request_data = {
    "jsonrpc": "2.0",
    "id": 1,
    "method": "GetDocList",
    "handle": -1,
    "params": []
}

ws.send(json.dumps(request_data))
resp = ws.recv()
print(json.loads(resp))

And this is the response from Qlik with 2 app's. The app-1 isn't published ('published': False) while app-2 is published in Stream ('name': 'Everyone')

{'qDocName': 'app-1',
    'qConnectedUsers': 0,
    'qFileTime': 0,
    'qFileSize': 414955,
    'qDocId': '4ddb44bf-f01f-4c95-9f79-364c477a99af',
    'qMeta': {'createdDate': '2023-10-11T12:33:54.568Z',
     'modifiedDate': '2023-10-11T12:52:13.345Z',
     'published': False,
     'publishTime': '1753-01-01T00:00:00.000Z',
     'description': '',
     'dynamicColor': '',
     'create': None,
     'stream': None,
     'canCreateDataConnections': False},
    'qLastReloadTime': '2023-10-11T12:48:33.462Z',
    'qTitle': 'Application 1',
    'qThumbnail': {}
   },
   {'qDocName': 'app-2',
    'qConnectedUsers': 0,
    'qFileTime': 0,
    'qFileSize': 804821,
    'qDocId': '5b671671-a716-4903-87c4-e02279c2b5e0',
    'qMeta': {'createdDate': '2023-05-02T17:30:30.502Z',
     'modifiedDate': '2023-05-03T20:08:41.891Z',
     'published': True,
     'publishTime': '2023-05-03T20:08:41.876Z',
     'description': '',
     'dynamicColor': '',
     'create': None,
     'stream': {'id': 'aaec8d41-5201-43ab-809f-3063750dfafd',
      'name': 'Everyone'},
     'canCreateDataConnections': False},
    'qLastReloadTime': '2023-05-03T19:34:13.425Z',
    'qTitle': 'Application 2',
    'qThumbnail': {}
}
pmbrull commented 11 months ago

add a generic include/exclude drafts and fix similar issues (e.g. superset)

harshsoni2024 commented 7 months ago

I will be working on this.