search

apache / hop

Hop Orchestration Platform
https://hop.apache.org/
Apache License 2.0
940 stars 342 forks source link

[Bug]: Multiple Hop Server Object IDs for a single HOP Pipeline on the HOP Server #4086

Open kirana-ks opened 3 months ago

kirana-ks commented 3 months ago

Apache Hop version?

2.9.0

Java version?

11

Operating system

Windows

What happened?

Installation details:- Download and extract the apache-hop-client-2.9.0.zip file from the official page: https://hop.apache.org/download/ apache-hop-client-2.9.0.zip and Run the HOP-GUI.bat file to start the HOP application.

Java Version:- 11

Reproduction Steps:-

  1. Open HOP GUI using hop-gui.bat.
  2. Open any existing Pipeline.
  3. Goto Metadata (Ctrl + Shift + M) and right-click on HOP Server to select New option.

  4. Enter the HOP Server details as per the below instruction. Create A New HOP Server

    1. Enter the HOP Run Config details as per the below instruction.

Create New Run Config (Remote Pipeline Engine)

  1. Enter the HOP Execution Information Location details as per the below instruction. Create New Execution Location

  2. Enter the HOP Execution Data Profile details as per the below instruction. image

  3. Now Run the Pipeline as per the following options.

Run Option

HOP GUI will log the following message:-

2024/06/24 18:36:01 - Hop - Pipeline opened. 2024/06/24 18:36:01 - Hop - Launching pipeline [Test-DataGrid]... 2024/06/24 18:36:01 - Hop - Started the pipeline execution. 2024/06/24 18:36:01 - Test-DataGrid - Executing this pipeline using the Remote Pipeline Engine with run configuration 'HOPSERVER-RUN-CONFIG' 2024/06/24 18:36:01 - Hop Server - Connecting to: [http://localhost:8080/hop/registerPipeline/?xml=Y] 2024/06/24 18:36:01 - Hop Server - Response status code: [200] 2024/06/24 18:36:01 - Hop Server - "Response body: <?xml version="1.0" encoding="UTF-8"?> OK Pipeline 'Test-DataGrid' was added to HopServer with id e7259ae3-e4de-49df-8630-fa676e931e98 e7259ae3-e4de-49df-8630-fa676e931e98 2024/06/24 18:36:01 - Hop Server - Sent XML to service [/hop/registerPipeline/?xml=Y] on host [localhost]

But in the Web Console Page, we see there are multiple object entries in the HOP Server.

Test-Grid- HOP GUI (Multiple Entries) Test-Grid- HOP Server (Multiple Entries)

Generally, this happens mostly during the first-pipeline (Test-DataGrid.hpl) execution. However, for the next pipeline (read-classicmodels-customers.hpl) execution there is only one entry in the HOP Server Console.

2 Pipelines - Multi Entries

Note: The issues exist in the Docker version.

Issue Priority

Priority: 3

Issue Component

Component: Hop Server

bamaer commented 1 month ago

make sure you don't have self-referencing run configurations. with a remote pipeline run configuration, the Run Configuration option specifies how you'll run your pipeline on the server. In most cases, that will be local. Let us know if the problem still exists if you change that option to your local run configuration.