Use connector data in job during execution

elastic / connectors-ruby

Official Connector Clients for Elastic Elasticsearch, Enterprise Search, App Search and Workplace Search

https://www.elastic.co/guide/en/enterprise-search/master/index.html

Other

9 stars 17 forks source link

Use connector data in job during execution #450

Closed wangch079 closed 1 year ago

wangch079 commented 1 year ago

Part of https://github.com/elastic/enterprise-search-team/issues/3283

Closes https://github.com/elastic/enterprise-search-team/issues/3191

This PR

adds trigger_method when creating a connector job
adds configuration when creating a connector job
Use configuration, pipeline, index_name, and service_type from job entity during job execution

Checklists

Pre-Review Checklist

[x] Covered the changes with automated tests
[x] Tested the changes locally

artem-shelkovnikov commented 1 year ago

@wangch079 following up a recent Slack discussion about problems with utility gem in Enterprise Search - did you test the gem with this change in Enterprise Search?

wangch079 commented 1 year ago

following up a recent Slack discussion about problems with utility gem in Enterprise Search - did you test the gem with this change in Enterprise Search?

Are you referring to this one?

Not yet. The change is supposed to be in the gem, and I plan to merge this PR https://github.com/elastic/ent-search/pull/7095 the last.

github-actions[bot] commented 1 year ago

💚 Backport PR(s) successfully created

Status	Branch	Result
✅	8.6	https://github.com/elastic/connectors-ruby/pull/470

This backport PR will be merged automatically after passing CI.