opensearch-project / index-management

🗃 Automate periodic data operations, such as deleting indices at a certain age or performing a rollover at a certain size
https://opensearch.org/docs/latest/im-plugin/index/
Apache License 2.0
52 stars 107 forks source link

[BUG] PUT _plugins/_transform/<transform_id> hangs indefinitely #1119

Open Pablosko98 opened 4 months ago

Pablosko98 commented 4 months ago

Describe the bug

PUT _plugins/_transform/<transform_id> call with correct body hangs indefinitely after pulling OpenSearch 2.12 Exact same request works fine in 2.11

Related component

Plugins

To Reproduce

  1. Hit /_plugins/_transform/test with the following body:
    {        
    "transform": {
        "enabled": true,
        "continuous": true,
        "description": "",
        "groups": [
            {
                "date_histogram": {
                    "calendar_interval": "1h",
                    "source_field": "datetime",
                    "target_field": "datetime",
                    "timezone": "UTC"
                }
            }
        ],
        "page_size": 1,
        "roles": [],
        "schedule": {
            "interval": {
                "unit": "Hours",
                "period": "1"
            }
        },
        "source_index": "test-source",
        "target_index": "test-target"
    }
    }
  2. Observe the operation hanging indefinitely

Expected behavior

Operation should return a 201 Created response.

Additional Details

Validation seems to work. For example:

msfroh commented 4 months ago

@opensearch-project/admin -- can we please move this to the https://github.com/opensearch-project/index-management repo?

enieto-vex commented 2 months ago

Same happens to me, I cant create transforms with the Transform API after upgrade to OpenSearch 2.12

amaciejk commented 2 months ago

this appears to have the same root cause as: https://github.com/opensearch-project/index-management/issues/1161 but for transforms you unfortunately don't get the nice error msg explaining that the start_time field is missing.

dblock commented 2 weeks ago

Does anyone want to PR a fix?

Catch All Triage - 1 2 3 4 5