Appdynamics / AppDynamics.DEXTER

Turn your APM data store into a Data Warehouse with advanced reporting, including entities, configuration, metrics, flowmaps, events, snapshots and call graph flame graphs
https://www.appdynamics.com/community/exchange/extension/appdynamics-dexter-data-extraction-enhanced-reporting/
Apache License 2.0
88 stars 48 forks source link

An item with the same key has already been added #119

Open kschne7 opened 4 years ago

kschne7 commented 4 years ago

2020-09-17 13:05:47.4165|Info|AppDynamics.Dexter|8500|1|AppDynamics.Dexter.Console|Executing job step IndexBIQMetrics(85) 2020-09-17 13:05:47.4165|Trace|AppDynamics.Dexter|8500|1|AppDynamics.Dexter.Console|IndexBIQMetrics(85): Starting 2020-09-17 13:05:47.4165|Trace|AppDynamics.Dexter|8500|1|AppDynamics.Dexter.Console|LicensedReports.EntityMetrics=True 2020-09-17 13:05:47.4165|Trace|AppDynamics.Dexter|8500|1|AppDynamics.Dexter.Console|Input.Metrics=True 2020-09-17 13:05:47.4165|Warn|AppDynamics.Dexter|8500|1|AppDynamics.Dexter.Console|No BIQ targets to process 2020-09-17 13:05:47.4165|Trace|AppDynamics.Dexter|8500|1|AppDynamics.Dexter.Console|IndexBIQMetrics(85): total duration 00:00:00.0015382 (1 ms) 2020-09-17 13:05:47.4310|Info|AppDynamics.Dexter|8500|1|AppDynamics.Dexter.Console|Executing job step IndexAPMMetricsList(86) 2020-09-17 13:05:47.5366|Trace|AppDynamics.Dexter|8500|1|AppDynamics.Dexter.Console|IndexAPMMetricsList(86): Starting 2020-09-17 13:05:47.5366|Trace|AppDynamics.Dexter|8500|1|AppDynamics.Dexter.Console|LicensedReports.EntityMetrics=True 2020-09-17 13:05:47.5366|Trace|AppDynamics.Dexter|8500|1|AppDynamics.Dexter.Console|Input.MetricsList=True 2020-09-17 13:05:47.5366|Info|AppDynamics.Dexter|8500|1|AppDynamics.Dexter.Console|IndexAPMMetricsList(86): [1/394], https://discoverfinancial.saas.appdynamics.com APPNAME(xxx) [APM] 2020-09-17 13:05:47.8322|Warn|AppDynamics.Dexter|8500|1|AppDynamics.Dexter.Console|System.ArgumentException: An item with the same key has already been added. Key: Oracle DB-LDAP-Oracle Database 19c Enterprise Edition Release 19.0.0.0.0 - Production at System.Collections.Generic.Dictionary2.TryInsert(TKey key, TValue value, InsertionBehavior behavior) at System.Collections.Generic.Dictionary2.Add(TKey key, TValue value) at System.Linq.Enumerable.ToDictionary[TSource,TKey,TElement](List1 source, Func2 keySelector, Func2 elementSelector, IEqualityComparer1 comparer) at System.Linq.Enumerable.ToDictionary[TSource,TKey,TElement](IEnumerable1 source, Func2 keySelector, Func2 elementSelector, IEqualityComparer1 comparer) at System.Linq.Enumerable.ToDictionary[TSource,TKey,TElement](IEnumerable1 source, Func2 keySelector, Func`2 elementSelector) at AppDynamics.Dexter.ProcessingSteps.IndexAPMMetricsList.Execute(ProgramOptions programOptions, JobConfiguration jobConfiguration) in C:\appdynamics\AppDynamics.DEXTER\src\ProcessingSteps\Index\IndexAPMMetricsList.cs:line 110 2020-09-17 13:05:47.8414|Trace|AppDynamics.Dexter|8500|1|AppDynamics.Dexter.Console|IndexAPMMetricsList(86): [1/394], https://discoverfinancial.saas.appdynamics.com Account_Center_Decision_Engine duration 00:00:00.3027369 (302 ms) 2020-09-17 13:05:47.8414|Trace|AppDynamics.Dexter|8500|1|AppDynamics.Dexter.Console|IndexAPMMetricsList(86): total duration 00:00:00.3167905 (316 ms) 2020-09-17 13:05:47.8542|Warn|AppDynamics.Dexter|8500|1|AppDynamics.Dexter.Console|If you need support, please review https://github.com/Appdynamics/AppDynamics.DEXTER/wiki#getting-support and send the logs

bhjelmar commented 4 years ago

Hey @kschne7 this is likely a duplicate of 114. Can you please download our latest release and verify it works for you?

kschne7 commented 4 years ago

2020-10-02 00:04:32.0921|Warn|AppDynamics.Dexter|4924|1|AppDynamics.Dexter.Console|System.ArgumentNullException: Value cannot be null. (Parameter 'key') at System.Collections.Generic.Dictionary2.FindEntry(TKey key) at System.Collections.Generic.Dictionary2.TryGetValue(TKey key, TValue& value) at AppDynamics.Dexter.ProcessingSteps.IndexAPMMetricsList.Execute(ProgramOptions programOptions, JobConfiguration jobConfiguration) in C:\Users\bhjel\RiderProjects\AppDynamics.DEXTER\ProcessingSteps\Index\IndexAPMMetricsList.cs:line 855 2020-10-02 00:04:32.1040|Trace|AppDynamics.Dexter|4924|1|AppDynamics.Dexter.Console|IndexAPMMetricsList(86): [4/411], https://discoverfinancial.saas.appdynamics.com Acquisitions duration 00:00:26.8645941 (26864 ms) 2020-10-02 00:04:32.1040|Trace|AppDynamics.Dexter|4924|1|AppDynamics.Dexter.Console|IndexAPMMetricsList(86): total duration 00:00:43.2669704 (43266 ms) 2020-10-02 00:04:32.1284|Warn|AppDynamics.Dexter|4924|1|AppDynamics.Dexter.Console|If you need support, please review https://github.com/Appdynamics/AppDynamics.DEXTER/wiki#getting-support and send the logs 2020-10-02 00:04:32.1546|Trace|AppDynamics.Dexter|4924|1|AppDynamics.Dexter.Console|Application execution took 1.05:18:28.5150149 (105508515 ms)

kschne7 commented 4 years ago

We have a very large controller - this runs for over 26 hours -

danielodievich commented 4 years ago

You can always restart the job https://github.com/Appdynamics/AppDynamics.DEXTER/wiki/Restart-Job-From-Specific-Step at the https://github.com/Appdynamics/AppDynamics.DEXTER/wiki/Phases-and-Job-Steps#indexapmmetrics-80 step and not rerun previous 25.99 hours.

bhjelmar commented 3 years ago

Please try with latest release, this issue should be fixed in version 21.6.0.0.