search

syndesisio / syndesis

This project is archived. A flexible, customizable, open source platform that provides core integration capabilities as a service.
https://syndesis.io/
Apache License 2.0
597 stars 204 forks source link

Offload DataManager initialization from the main thread #4505

Closed zregvart closed 5 years ago

zregvart commented 5 years ago

This is a...


[x] Feature request
[ ] Regression (a behavior that used to work and stopped working in a new release)
[ ] Bug report  
[ ] Documentation issue or request

Description

This bit is delaying the application startup by ~18 sec on my machine:

https://github.com/syndesisio/syndesis/blob/3fbc53d9f28cfb87caf39d5e03d9fe191b2630c9/app/server/dao/src/main/java/io/syndesis/server/dao/manager/DataManager.java#L102-L107

Should be fairly easy to place that initialization on a separate thread.

Logs:

2019-02-11 11:17:44.906  INFO [-,,,] 1 --- [           main] i.s.server.dao.manager.DataManager       : Load connector: timer from resource: jar:file:/deployments/runtime.jar!/BOOT-INF/lib/connector-support-catalog-1.6-SNAPSHOT.jar!/META-INF/syndesis/connector/timer.json
--
  | 2019-02-11 11:17:49.819  INFO [-,,,] 1 --- [           main] i.s.server.dao.manager.DataManager       : Load connector: log from resource: jar:file:/deployments/runtime.jar!/BOOT-INF/lib/connector-support-catalog-1.6-SNAPSHOT.jar!/META-INF/syndesis/connector/log.json
  | 2019-02-11 11:17:50.298  INFO [-,,,] 1 --- [           main] i.s.server.dao.manager.DataManager       : Load connector: sftp from resource: jar:file:/deployments/runtime.jar!/BOOT-INF/lib/connector-support-catalog-1.6-SNAPSHOT.jar!/META-INF/syndesis/connector/sftp.json
  | 2019-02-11 11:17:51.394  INFO [-,,,] 1 --- [           main] i.s.server.dao.manager.DataManager       : Load connector: fhir from resource: jar:file:/deployments/runtime.jar!/BOOT-INF/lib/connector-support-catalog-1.6-SNAPSHOT.jar!/META-INF/syndesis/connector/fhir.json
  | 2019-02-11 11:17:52.122  INFO [-,,,] 1 --- [           main] i.s.server.dao.manager.DataManager       : Load connector: salesforce from resource: jar:file:/deployments/runtime.jar!/BOOT-INF/lib/connector-support-catalog-1.6-SNAPSHOT.jar!/META-INF/syndesis/connector/salesforce.json
  | 2019-02-11 11:17:53.237  INFO [-,,,] 1 --- [           main] i.s.server.dao.manager.DataManager       : Load connector: amqp from resource: jar:file:/deployments/runtime.jar!/BOOT-INF/lib/connector-support-catalog-1.6-SNAPSHOT.jar!/META-INF/syndesis/connector/amqp.json
  | 2019-02-11 11:17:53.522  INFO [-,,,] 1 --- [           main] i.s.server.dao.manager.DataManager       : Load connector: google-calendar from resource: jar:file:/deployments/runtime.jar!/BOOT-INF/lib/connector-support-catalog-1.6-SNAPSHOT.jar!/META-INF/syndesis/connector/calendar.json
  | 2019-02-11 11:17:53.904  INFO [-,,,] 1 --- [           main] i.s.server.dao.manager.DataManager       : Load connector: servicenow from resource: jar:file:/deployments/runtime.jar!/BOOT-INF/lib/connector-support-catalog-1.6-SNAPSHOT.jar!/META-INF/syndesis/connector/servicenow.json
  | 2019-02-11 11:17:54.017  INFO [-,,,] 1 --- [           main] i.s.server.dao.manager.DataManager       : Load connector: kafka from resource: jar:file:/deployments/runtime.jar!/BOOT-INF/lib/connector-support-catalog-1.6-SNAPSHOT.jar!/META-INF/syndesis/connector/kafka.json
  | 2019-02-11 11:17:54.198  INFO [-,,,] 1 --- [           main] i.s.server.dao.manager.DataManager       : Load connector: twitter from resource: jar:file:/deployments/runtime.jar!/BOOT-INF/lib/connector-support-catalog-1.6-SNAPSHOT.jar!/META-INF/syndesis/connector/twitter.json
  | 2019-02-11 11:17:54.695  INFO [-,,,] 1 --- [           main] i.s.server.dao.manager.DataManager       : Load connector: odata from resource: jar:file:/deployments/runtime.jar!/BOOT-INF/lib/connector-support-catalog-1.6-SNAPSHOT.jar!/META-INF/syndesis/connector/odata.json
  | 2019-02-11 11:17:54.730  INFO [-,,,] 1 --- [           main] i.s.server.dao.manager.DataManager       : Load connector: webhook from resource: jar:file:/deployments/runtime.jar!/BOOT-INF/lib/connector-support-catalog-1.6-SNAPSHOT.jar!/META-INF/syndesis/connector/webhook.json
  | 2019-02-11 11:17:54.804  INFO [-,,,] 1 --- [           main] i.s.server.dao.manager.DataManager       : Load connector: telegram from resource: jar:file:/deployments/runtime.jar!/BOOT-INF/lib/connector-support-catalog-1.6-SNAPSHOT.jar!/META-INF/syndesis/connector/telegram.json
  | 2019-02-11 11:17:54.914  INFO [-,,,] 1 --- [           main] i.s.server.dao.manager.DataManager       : Load connector: ftp from resource: jar:file:/deployments/runtime.jar!/BOOT-INF/lib/connector-support-catalog-1.6-SNAPSHOT.jar!/META-INF/syndesis/connector/ftp.json
  | 2019-02-11 11:17:55.102  INFO [-,,,] 1 --- [           main] i.s.server.dao.manager.DataManager       : Load connector: mqtt from resource: jar:file:/deployments/runtime.jar!/BOOT-INF/lib/connector-support-catalog-1.6-SNAPSHOT.jar!/META-INF/syndesis/connector/mqtt.json
  | 2019-02-11 11:17:55.325  INFO [-,,,] 1 --- [           main] i.s.server.dao.manager.DataManager       : Load connector: sheets from resource: jar:file:/deployments/runtime.jar!/BOOT-INF/lib/connector-support-catalog-1.6-SNAPSHOT.jar!/META-INF/syndesis/connector/sheets.json
  | 2019-02-11 11:17:55.923  INFO [-,,,] 1 --- [           main] i.s.server.dao.manager.DataManager       : Load connector: irc from resource: jar:file:/deployments/runtime.jar!/BOOT-INF/lib/connector-support-catalog-1.6-SNAPSHOT.jar!/META-INF/syndesis/connector/irc.json
  | 2019-02-11 11:17:56.028  INFO [-,,,] 1 --- [           main] i.s.server.dao.manager.DataManager       : Load connector: aws-s3 from resource: jar:file:/deployments/runtime.jar!/BOOT-INF/lib/connector-support-catalog-1.6-SNAPSHOT.jar!/META-INF/syndesis/connector/aws-s3.json
  | 2019-02-11 11:17:56.328  INFO [-,,,] 1 --- [           main] i.s.server.dao.manager.DataManager       : Load connector: concur from resource: jar:file:/deployments/runtime.jar!/BOOT-INF/lib/connector-support-catalog-1.6-SNAPSHOT.jar!/META-INF/syndesis/connector/concur-api.json
  | 2019-02-11 11:18:00.423  INFO [-,,,] 1 --- [           main] i.s.server.dao.manager.DataManager       : Load connector: activemq from resource: jar:file:/deployments/runtime.jar!/BOOT-INF/lib/connector-support-catalog-1.6-SNAPSHOT.jar!/META-INF/syndesis/connector/activemq.json
  | 2019-02-11 11:18:00.792  INFO [-,,,] 1 --- [           main] i.s.server.dao.manager.DataManager       : Load connector: dropbox from resource: jar:file:/deployments/runtime.jar!/BOOT-INF/lib/connector-support-catalog-1.6-SNAPSHOT.jar!/META-INF/syndesis/connector/dropbox.json
  | 2019-02-11 11:18:00.817  INFO [-,,,] 1 --- [           main] i.s.server.dao.manager.DataManager       : Load connector: gmail from resource: jar:file:/deployments/runtime.jar!/BOOT-INF/lib/connector-support-catalog-1.6-SNAPSHOT.jar!/META-INF/syndesis/connector/gmail.json
  | 2019-02-11 11:18:01.114  INFO [-,,,] 1 --- [           main] i.s.server.dao.manager.DataManager       : Load connector: http4 from resource: jar:file:/deployments/runtime.jar!/BOOT-INF/lib/connector-support-catalog-1.6-SNAPSHOT.jar!/META-INF/syndesis/connector/http4.json
  | 2019-02-11 11:18:01.401  INFO [-,,,] 1 --- [           main] i.s.server.dao.manager.DataManager       : Load connector: api-provider from resource: jar:file:/deployments/runtime.jar!/BOOT-INF/lib/connector-support-catalog-1.6-SNAPSHOT.jar!/META-INF/syndesis/connector/api-provider.json
  | 2019-02-11 11:18:01.638  INFO [-,,,] 1 --- [           main] i.s.server.dao.manager.DataManager       : Load connector: slack from resource: jar:file:/deployments/runtime.jar!/BOOT-INF/lib/connector-support-catalog-1.6-SNAPSHOT.jar!/META-INF/syndesis/connector/slack.json
  | 2019-02-11 11:18:01.946  INFO [-,,,] 1 --- [           main] i.s.server.dao.manager.DataManager       : Load connector: kudu from resource: jar:file:/deployments/runtime.jar!/BOOT-INF/lib/connector-support-catalog-1.6-SNAPSHOT.jar!/META-INF/syndesis/connector/kudu.json
  | 2019-02-11 11:18:02.316  INFO [-,,,] 1 --- [           main] i.s.server.dao.manager.DataManager       : Load connector: https4 from resource: jar:file:/deployments/runtime.jar!/BOOT-INF/lib/connector-support-catalog-1.6-SNAPSHOT.jar!/META-INF/syndesis/connector/https4.json
  | 2019-02-11 11:18:02.568  INFO [-,,,] 1 --- [           main] i.s.server.dao.manager.DataManager       : Load connector: sql from resource: jar:file:/deployments/runtime.jar!/BOOT-INF/lib/connector-support-catalog-1.6-SNAPSHOT.jar!/META-INF/syndesis/connector/sql.json
tplevko commented 5 years ago

@zregvart isn't this related to this? https://github.com/syndesisio/syndesis/issues/4523

zregvart commented 5 years ago

@tplevko could be the root cause yes.

tplevko commented 5 years ago

Verified.