search

elastic / connectors

Source code for all Elastic connectors, developed by the Search team at Elastic, and home of our Python connector development framework
https://www.elastic.co/guide/en/enterprise-search/master/index.html
Other
71 stars 126 forks source link

[Confluence]: Data loss while executing full sync in Confluence Data Center when advance sync rule is active. #2631

Closed khushbu-elastic closed 3 months ago

khushbu-elastic commented 3 months ago

Bug Description

[Confluence]: Data loss while executing full sync in Confluence Data Center when advance sync rule is active.

To Reproduce

Steps to reproduce the behavior:

  1. Update the package using the command make install.
  2. Create an index in Elasticsearch and configure an index name and connector id in config.yml.
  3. Define the advance sync rules and save and validate it.
  4. Execute the CLI using command make run
  5. Once the execution is completed, verify the data indexed in Elasticsearch
  6. Compare the data indexed in Elasticsearch with records present in confluence Data Center.

Sync Rule Configured: [ { "query": "space=SPACE111" } ]

Expected behavior

  1. All the data from confluence should be indexed into Elasticsearch index according to the advanced sync rules configured.
  2. There should not be any data loss.

Actual behavior

For configured space only 50 documents are getting indexed while space contains 1000+ documents

Environment