search

elastic / connectors

Source code for all Elastic connectors, developed by the Search team at Elastic, and home of our Python connector development framework
https://www.elastic.co/guide/en/enterprise-search/master/index.html
Other
70 stars 124 forks source link

[ServiceNow] Connector to support custom tables #2745

Open iamhowardtheduck opened 1 month ago

iamhowardtheduck commented 1 month ago

Problem Description

Specific tables require to be ingested for a security use-cases that are not covered within the 5 supported services.

Attempted to ingest all services which resulted in a timeout, limited the scoped to Incident as well as Requested Item with table related data not ingested. Attempted an advanced rule which would look for anything related to one of the tables that

Proposed Solution

Provide URL(s) specific to the table(s) which require to be ingested, and have synchronization jobs pull from the URL(s)>

Alternatives

Download data to S3 bucket and ingest to Elastic, while viable, breaks requirements from the security team as the data is highly sensitive.

Additional Context

image (24)

seanstory commented 1 month ago

Hi @iamhowardtheduck , did you try specifying your custom tables in the configuration for "comma-separated list of services"? See this note in the docs:

If you have configured a custom service, the * value will not fetch data from the basic services above by default. In this case you’ll need to mention these service names explicitly.

Separately, regarding:

Attempted to ingest all services which resulted in a timeout, ... Attempted an advanced rule which would look for anything related to one of the tables

If either of these didn't work as expected, please feel free to file a Bug issue, with details around the errors you encountered.