kudawdev / nifi-monitoring-splunk

Nifi Monitoring Splunk
MIT License
5 stars 4 forks source link

Status History Questions variables process_group_list, processors_list #40

Open idglabs opened 7 months ago

idglabs commented 7 months ago

Hello again,

Today I've decide to update on my side the app code to 1.2.1 and to add new feature you deployed related to Status History, which seem amazing

Review: a. I'm not using the HEC method , instead I'm sending all logs to a folder and is work well , where is processed be splunk forwarder b. i'm using as well SSL authentication for API in NiFi c. I've added the 2 Processor Groups / GetHttp process_groups_history and GetHttp processors_history

  1. where I find the list of processor_list and process_groups_list who generate this list?

  2. Processor GenerateFlowFile under GetHTTP-processor_history , my errors at moment is with Processor InvokeHTTP which seem is not passed the ${pid} in the Remote URL for both (GetHttp process_groups_history and GetHttp processors_history) not sure where ${pid} is supposed to come from in that URL ? and as well variable ${process_group_list} from where is coming?

  3. not understanding very well the Group Processor GetHTTP-processor_history Thank you for all support

Best regards, 1 2 error 3 error details

oguerinoni commented 7 months ago

Hi Ilie Thanks for your comments. We will look into this as soon as we can, as some of us are on summer vacations.

Best

jdieterichkdw commented 6 months ago

Hi Ilie, Based on what you've mentioned, I understand that the main confusion lies in understanding how these 2 new variables are used by the processors process_groups_history and processors_history. Firstly, I must indicate that the lists processors_list and process_group_list should be generated manually by obtaining the IDs of the objects you wish to monitor in Splunk. Below, I am providing a dummy example to illustrate how the configuration of these variables should look like. Example of test process group and processors: imagen (1)

The list of IDs should be separated by a line break in both variables.

imagen

Finally, this list of IDs is used by the process groups process_groups_history and processors_history to generate queries to the API with the respective IDs. We remain attentive to any doubts. Best regards.