search

jeremylong / DependencyCheck

OWASP dependency-check is a software composition analysis utility that detects publicly disclosed vulnerabilities in application dependencies.
https://owasp.org/www-project-dependency-check/
Apache License 2.0
6.43k stars 1.28k forks source link

Sudden failures updating mariadb NVD CVE DB, due to illegal characters in NIST NVD CVE json feed #2338

Open LinkMJB opened 4 years ago

LinkMJB commented 4 years ago

Describe the bug Updates to a local mariadb instance as a local cache of the NVD CVE feed (based on https://github.com/jeremylong/dependencycheck-central-mysql-docker ) started failing, containing 2 errors in the stack trace (the download error appears to be a false positive -- it also happens consistently). This issue appears to be because of https://nvd.nist.gov/vuln/detail/CVE-2019-9719#vulnCurrentDescriptionTitle containing UTF8 "replace" characters (see: https://stackoverflow.com/questions/11159118/incorrect-string-value-xef-xbf-xbd-for-column )

Version of dependency-check used

Also tried using the following versions, with no improvement in behavior:

Gradle version:

------------------------------------------------------------
Gradle 6.0.1
------------------------------------------------------------

Build time:   2019-11-18 20:25:01 UTC
Revision:     fad121066a68c4701acd362daf4287a7c309a0f5

Kotlin:       1.3.50
Groovy:       2.5.8
Ant:          Apache Ant(TM) version 1.10.7 compiled on September 1 2019
JVM:          11.0.5 (AdoptOpenJDK 11.0.5+10)
OS:           Linux 4.9.184-linuxkit amd64

Java version:

openjdk version "11.0.5" 2019-10-15
OpenJDK Runtime Environment AdoptOpenJDK (build 11.0.5+10)
OpenJDK 64-Bit Server VM AdoptOpenJDK (build 11.0.5+10, mixed mode)

Log file 06:14:13.306 [DEBUG] [org.gradle.internal.operations.DefaultBuildOperationExecutor] Build operation 'Run tasks' completed 06:14:13.315 [ERROR] [org.gradle.internal.buildevents.BuildExceptionReporter] 06:14:13.315 [ERROR] [org.gradle.internal.buildevents.BuildExceptionReporter] FAILURE: Build failed with an exception. 06:14:13.315 [ERROR] [org.gradle.internal.buildevents.BuildExceptionReporter] 06:14:13.315 [ERROR] [org.gradle.internal.buildevents.BuildExceptionReporter] * What went wrong: 06:14:13.315 [ERROR] [org.gradle.internal.buildevents.BuildExceptionReporter] Execution failed for task ':dependencyCheckUpdate'. 06:14:13.315 [ERROR] [org.gradle.internal.buildevents.BuildExceptionReporter] > The execution of the download was interrupted 06:14:13.315 [ERROR] [org.gradle.internal.buildevents.BuildExceptionReporter] 06:14:13.315 [ERROR] [org.gradle.internal.buildevents.BuildExceptionReporter] * Try: 06:14:13.315 [ERROR] [org.gradle.internal.buildevents.BuildExceptionReporter] Run with --scan to get full insights. 06:14:13.315 [ERROR] [org.gradle.internal.buildevents.BuildExceptionReporter] 06:14:13.315 [ERROR] [org.gradle.internal.buildevents.BuildExceptionReporter] * Exception is: 06:14:13.315 [ERROR] [org.gradle.internal.buildevents.BuildExceptionReporter] org.gradle.api.tasks.TaskExecutionException: Execution failed for task ':dependencyCheckUpdate'. 06:14:13.315 [ERROR] [org.gradle.internal.buildevents.BuildExceptionReporter] at org.gradle.api.internal.tasks.execution.ExecuteActionsTaskExecuter.executeActions(ExecuteActionsTaskExecuter.java:96) 06:14:13.315 [ERROR] [org.gradle.internal.buildevents.BuildExceptionReporter] at org.gradle.api.internal.tasks.execution.ExecuteActionsTaskExecuter.execute(ExecuteActionsTaskExecuter.java:65) 06:14:13.315 [ERROR] [org.gradle.internal.buildevents.BuildExceptionReporter] at org.gradle.api.internal.tasks.execution.ActionEventFiringTaskExecuter.execute(ActionEventFiringTaskExecuter.java:44) 06:14:13.315 [ERROR] [org.gradle.internal.buildevents.BuildExceptionReporter] at org.gradle.api.internal.tasks.execution.TimeoutTaskExecuter.execute(TimeoutTaskExecuter.java:53) 06:14:13.315 [ERROR] [org.gradle.internal.buildevents.BuildExceptionReporter] at org.gradle.api.internal.tasks.execution.SnapshotAfterExecutionTaskExecuter.execute(SnapshotAfterExecutionTaskExecuter.java:38) 06:14:13.315 [ERROR] [org.gradle.internal.buildevents.BuildExceptionReporter] at org.gradle.api.internal.tasks.execution.OutputDirectoryCreatingTaskExecuter.execute(OutputDirectoryCreatingTaskExecuter.java:51) 06:14:13.316 [ERROR] [org.gradle.internal.buildevents.BuildExceptionReporter] at org.gradle.api.internal.tasks.execution.SkipUpToDateTaskExecuter.execute(SkipUpToDateTaskExecuter.java:59) 06:14:13.316 [ERROR] [org.gradle.internal.buildevents.BuildExceptionReporter] at org.gradle.api.internal.tasks.execution.ResolveTaskOutputCachingStateExecuter.execute(ResolveTaskOutputCachingStateExecuter.java:49) 06:14:13.316 [ERROR] [org.gradle.internal.buildevents.BuildExceptionReporter] at org.gradle.api.internal.tasks.execution.ValidatingTaskExecuter.execute(ValidatingTaskExecuter.java:61) 06:14:13.316 [ERROR] [org.gradle.internal.buildevents.BuildExceptionReporter] at org.gradle.api.internal.tasks.execution.SkipEmptySourceFilesTaskExecuter.execute(SkipEmptySourceFilesTaskExecuter.java:101) 06:14:13.316 [ERROR] [org.gradle.internal.buildevents.BuildExceptionReporter] at org.gradle.api.internal.tasks.execution.CleanupStaleOutputsExecuter.execute(CleanupStaleOutputsExecuter.java:91) 06:14:13.316 [ERROR] [org.gradle.internal.buildevents.BuildExceptionReporter] at org.gradle.api.internal.tasks.execution.FinalizePropertiesTaskExecuter.execute(FinalizePropertiesTaskExecuter.java:44) 06:14:13.316 [ERROR] [org.gradle.internal.buildevents.BuildExceptionReporter] at org.gradle.api.internal.tasks.execution.ResolveTaskArtifactStateTaskExecuter.execute(ResolveTaskArtifactStateTaskExecuter.java:62) 06:14:13.316 [ERROR] [org.gradle.internal.buildevents.BuildExceptionReporter] at org.gradle.api.internal.tasks.execution.SkipTaskWithNoActionsExecuter.execute(SkipTaskWithNoActionsExecuter.java:55) 06:14:13.316 [ERROR] [org.gradle.internal.buildevents.BuildExceptionReporter] at org.gradle.api.internal.tasks.execution.SkipOnlyIfTaskExecuter.execute(SkipOnlyIfTaskExecuter.java:54) 06:14:13.316 [ERROR] [org.gradle.internal.buildevents.BuildExceptionReporter] at org.gradle.api.internal.tasks.execution.CatchExceptionTaskExecuter.execute(CatchExceptionTaskExecuter.java:35) 06:14:13.316 [ERROR] [org.gradle.internal.buildevents.BuildExceptionReporter] at org.gradle.api.internal.tasks.execution.EventFiringTaskExecuter$1.run(EventFiringTaskExecuter.java:49) 06:14:13.316 [ERROR] [org.gradle.internal.buildevents.BuildExceptionReporter] at org.gradle.internal.operations.DefaultBuildOperationExecutor$RunnableBuildOperationWorker.execute(DefaultBuildOperationExecutor.java:301) 06:14:13.316 [ERROR] [org.gradle.internal.buildevents.BuildExceptionReporter] at org.gradle.internal.operations.DefaultBuildOperationExecutor$RunnableBuildOperationWorker.execute(DefaultBuildOperationExecutor.java:293) 06:14:13.316 [ERROR] [org.gradle.internal.buildevents.BuildExceptionReporter] at org.gradle.internal.operations.DefaultBuildOperationExecutor.execute(DefaultBuildOperationExecutor.java:175) 06:14:13.316 [ERROR] [org.gradle.internal.buildevents.BuildExceptionReporter] at org.gradle.internal.operations.DefaultBuildOperationExecutor.run(DefaultBuildOperationExecutor.java:91) 06:14:13.316 [ERROR] [org.gradle.internal.buildevents.BuildExceptionReporter] at org.gradle.internal.operations.DelegatingBuildOperationExecutor.run(DelegatingBuildOperationExecutor.java:31) 06:14:13.316 [ERROR] [org.gradle.internal.buildevents.BuildExceptionReporter] at org.gradle.api.internal.tasks.execution.EventFiringTaskExecuter.execute(EventFiringTaskExecuter.java:44) 06:14:13.316 [ERROR] [org.gradle.internal.buildevents.BuildExceptionReporter] at org.gradle.execution.plan.LocalTaskNodeExecutor.execute(LocalTaskNodeExecutor.java:43) 06:14:13.316 [ERROR] [org.gradle.internal.buildevents.BuildExceptionReporter] at org.gradle.execution.taskgraph.DefaultTaskExecutionGraph$InvokeNodeExecutorsAction.execute(DefaultTaskExecutionGraph.java:337) 06:14:13.316 [ERROR] [org.gradle.internal.buildevents.BuildExceptionReporter] at org.gradle.execution.taskgraph.DefaultTaskExecutionGraph$InvokeNodeExecutorsAction.execute(DefaultTaskExecutionGraph.java:325) 06:14:13.316 [ERROR] [org.gradle.internal.buildevents.BuildExceptionReporter] at org.gradle.execution.taskgraph.DefaultTaskExecutionGraph$BuildOperationAwareExecutionAction.execute(DefaultTaskExecutionGraph.java:318) 06:14:13.316 [ERROR] [org.gradle.internal.buildevents.BuildExceptionReporter] at org.gradle.execution.taskgraph.DefaultTaskExecutionGraph$BuildOperationAwareExecutionAction.execute(DefaultTaskExecutionGraph.java:304) 06:14:13.316 [ERROR] [org.gradle.internal.buildevents.BuildExceptionReporter] at org.gradle.execution.plan.DefaultPlanExecutor$ExecutorWorker$1.execute(DefaultPlanExecutor.java:134) 06:14:13.316 [ERROR] [org.gradle.internal.buildevents.BuildExceptionReporter] at org.gradle.execution.plan.DefaultPlanExecutor$ExecutorWorker$1.execute(DefaultPlanExecutor.java:129) 06:14:13.316 [ERROR] [org.gradle.internal.buildevents.BuildExceptionReporter] at org.gradle.execution.plan.DefaultPlanExecutor$ExecutorWorker.execute(DefaultPlanExecutor.java:202) 06:14:13.316 [ERROR] [org.gradle.internal.buildevents.BuildExceptionReporter] at org.gradle.execution.plan.DefaultPlanExecutor$ExecutorWorker.executeNextNode(DefaultPlanExecutor.java:193) 06:14:13.316 [ERROR] [org.gradle.internal.buildevents.BuildExceptionReporter] at org.gradle.execution.plan.DefaultPlanExecutor$ExecutorWorker.run(DefaultPlanExecutor.java:129) 06:14:13.316 [ERROR] [org.gradle.internal.buildevents.BuildExceptionReporter] at org.gradle.execution.plan.DefaultPlanExecutor.process(DefaultPlanExecutor.java:74) 06:14:13.316 [ERROR] [org.gradle.internal.buildevents.BuildExceptionReporter] at org.gradle.execution.taskgraph.DefaultTaskExecutionGraph.executeWithServices(DefaultTaskExecutionGraph.java:167) 06:14:13.316 [ERROR] [org.gradle.internal.buildevents.BuildExceptionReporter] at org.gradle.execution.taskgraph.DefaultTaskExecutionGraph.execute(DefaultTaskExecutionGraph.java:150) 06:14:13.316 [ERROR] [org.gradle.internal.buildevents.BuildExceptionReporter] at org.gradle.execution.SelectedTaskExecutionAction.execute(SelectedTaskExecutionAction.java:41) 06:14:13.316 [ERROR] [org.gradle.internal.buildevents.BuildExceptionReporter] at org.gradle.execution.DefaultBuildExecuter.execute(DefaultBuildExecuter.java:40) 06:14:13.316 [ERROR] [org.gradle.internal.buildevents.BuildExceptionReporter] at org.gradle.execution.DefaultBuildExecuter.access$000(DefaultBuildExecuter.java:24) 06:14:13.316 [ERROR] [org.gradle.internal.buildevents.BuildExceptionReporter] at org.gradle.execution.DefaultBuildExecuter$1.proceed(DefaultBuildExecuter.java:46) 06:14:13.316 [ERROR] [org.gradle.internal.buildevents.BuildExceptionReporter] at org.gradle.execution.DryRunBuildExecutionAction.execute(DryRunBuildExecutionAction.java:49) 06:14:13.317 [ERROR] [org.gradle.internal.buildevents.BuildExceptionReporter] at org.gradle.execution.DefaultBuildExecuter.execute(DefaultBuildExecuter.java:40) 06:14:13.317 [ERROR] [org.gradle.internal.buildevents.BuildExceptionReporter] at org.gradle.execution.DefaultBuildExecuter.execute(DefaultBuildExecuter.java:33) 06:14:13.317 [ERROR] [org.gradle.internal.buildevents.BuildExceptionReporter] at org.gradle.initialization.DefaultGradleLauncher$ExecuteTasks.run(DefaultGradleLauncher.java:367) 06:14:13.317 [ERROR] [org.gradle.internal.buildevents.BuildExceptionReporter] at org.gradle.internal.operations.DefaultBuildOperationExecutor$RunnableBuildOperationWorker.execute(DefaultBuildOperationExecutor.java:301) 06:14:13.317 [ERROR] [org.gradle.internal.buildevents.BuildExceptionReporter] at org.gradle.internal.operations.DefaultBuildOperationExecutor$RunnableBuildOperationWorker.execute(DefaultBuildOperationExecutor.java:293) 06:14:13.317 [ERROR] [org.gradle.internal.buildevents.BuildExceptionReporter] at org.gradle.internal.operations.DefaultBuildOperationExecutor.execute(DefaultBuildOperationExecutor.java:175) 06:14:13.317 [ERROR] [org.gradle.internal.buildevents.BuildExceptionReporter] at org.gradle.internal.operations.DefaultBuildOperationExecutor.run(DefaultBuildOperationExecutor.java:91) 06:14:13.317 [ERROR] [org.gradle.internal.buildevents.BuildExceptionReporter] at org.gradle.internal.operations.DelegatingBuildOperationExecutor.run(DelegatingBuildOperationExecutor.java:31) 06:14:13.317 [ERROR] [org.gradle.internal.buildevents.BuildExceptionReporter] at org.gradle.initialization.DefaultGradleLauncher.runTasks(DefaultGradleLauncher.java:231) 06:14:13.317 [ERROR] [org.gradle.internal.buildevents.BuildExceptionReporter] at org.gradle.initialization.DefaultGradleLauncher.doBuildStages(DefaultGradleLauncher.java:158) 06:14:13.317 [ERROR] [org.gradle.internal.buildevents.BuildExceptionReporter] at org.gradle.initialization.DefaultGradleLauncher.executeTasks(DefaultGradleLauncher.java:133) 06:14:13.317 [ERROR] [org.gradle.internal.buildevents.BuildExceptionReporter] at org.gradle.internal.invocation.GradleBuildController$1.execute(GradleBuildController.java:79) 06:14:13.317 [ERROR] [org.gradle.internal.buildevents.BuildExceptionReporter] at org.gradle.internal.invocation.GradleBuildController$1.execute(GradleBuildController.java:76) 06:14:13.317 [ERROR] [org.gradle.internal.buildevents.BuildExceptionReporter] at org.gradle.internal.invocation.GradleBuildController$3.create(GradleBuildController.java:103) 06:14:13.317 [ERROR] [org.gradle.internal.buildevents.BuildExceptionReporter] at org.gradle.internal.invocation.GradleBuildController$3.create(GradleBuildController.java:96) 06:14:13.317 [ERROR] [org.gradle.internal.buildevents.BuildExceptionReporter] at org.gradle.internal.work.DefaultWorkerLeaseService.withLocks(DefaultWorkerLeaseService.java:183) 06:14:13.317 [ERROR] [org.gradle.internal.buildevents.BuildExceptionReporter] at org.gradle.internal.work.StopShieldingWorkerLeaseService.withLocks(StopShieldingWorkerLeaseService.java:40) 06:14:13.317 [ERROR] [org.gradle.internal.buildevents.BuildExceptionReporter] at org.gradle.internal.invocation.GradleBuildController.doBuild(GradleBuildController.java:96) 06:14:13.317 [ERROR] [org.gradle.internal.buildevents.BuildExceptionReporter] at org.gradle.internal.invocation.GradleBuildController.run(GradleBuildController.java:76) 06:14:13.317 [ERROR] [org.gradle.internal.buildevents.BuildExceptionReporter] at org.gradle.tooling.internal.provider.ExecuteBuildActionRunner.run(ExecuteBuildActionRunner.java:28) 06:14:13.317 [ERROR] [org.gradle.internal.buildevents.BuildExceptionReporter] at org.gradle.launcher.exec.ChainingBuildActionRunner.run(ChainingBuildActionRunner.java:35) 06:14:13.317 [ERROR] [org.gradle.internal.buildevents.BuildExceptionReporter] at org.gradle.tooling.internal.provider.ValidatingBuildActionRunner.run(ValidatingBuildActionRunner.java:32) 06:14:13.317 [ERROR] [org.gradle.internal.buildevents.BuildExceptionReporter] at org.gradle.launcher.exec.RunAsBuildOperationBuildActionRunner$3.run(RunAsBuildOperationBuildActionRunner.java:49) 06:14:13.317 [ERROR] [org.gradle.internal.buildevents.BuildExceptionReporter] at org.gradle.internal.operations.DefaultBuildOperationExecutor$RunnableBuildOperationWorker.execute(DefaultBuildOperationExecutor.java:301) 06:14:13.317 [ERROR] [org.gradle.internal.buildevents.BuildExceptionReporter] at org.gradle.internal.operations.DefaultBuildOperationExecutor$RunnableBuildOperationWorker.execute(DefaultBuildOperationExecutor.java:293) 06:14:13.317 [ERROR] [org.gradle.internal.buildevents.BuildExceptionReporter] at org.gradle.internal.operations.DefaultBuildOperationExecutor.execute(DefaultBuildOperationExecutor.java:175) 06:14:13.317 [ERROR] [org.gradle.internal.buildevents.BuildExceptionReporter] at org.gradle.internal.operations.DefaultBuildOperationExecutor.run(DefaultBuildOperationExecutor.java:91) 06:14:13.317 [ERROR] [org.gradle.internal.buildevents.BuildExceptionReporter] at org.gradle.internal.operations.DelegatingBuildOperationExecutor.run(DelegatingBuildOperationExecutor.java:31) 06:14:13.317 [ERROR] [org.gradle.internal.buildevents.BuildExceptionReporter] at org.gradle.launcher.exec.RunAsBuildOperationBuildActionRunner.run(RunAsBuildOperationBuildActionRunner.java:44) 06:14:13.317 [ERROR] [org.gradle.internal.buildevents.BuildExceptionReporter] at org.gradle.tooling.internal.provider.SubscribableBuildActionRunner.run(SubscribableBuildActionRunner.java:51) 06:14:13.317 [ERROR] [org.gradle.internal.buildevents.BuildExceptionReporter] at org.gradle.launcher.exec.InProcessBuildActionExecuter$1.transform(InProcessBuildActionExecuter.java:47) 06:14:13.317 [ERROR] [org.gradle.internal.buildevents.BuildExceptionReporter] at org.gradle.launcher.exec.InProcessBuildActionExecuter$1.transform(InProcessBuildActionExecuter.java:44) 06:14:13.317 [ERROR] [org.gradle.internal.buildevents.BuildExceptionReporter] at org.gradle.composite.internal.DefaultRootBuildState.run(DefaultRootBuildState.java:79) 06:14:13.317 [ERROR] [org.gradle.internal.buildevents.BuildExceptionReporter] at org.gradle.launcher.exec.InProcessBuildActionExecuter.execute(InProcessBuildActionExecuter.java:44) 06:14:13.317 [ERROR] [org.gradle.internal.buildevents.BuildExceptionReporter] at org.gradle.launcher.exec.InProcessBuildActionExecuter.execute(InProcessBuildActionExecuter.java:30) 06:14:13.317 [ERROR] [org.gradle.internal.buildevents.BuildExceptionReporter] at org.gradle.launcher.exec.BuildTreeScopeBuildActionExecuter.execute(BuildTreeScopeBuildActionExecuter.java:39) 06:14:13.317 [ERROR] [org.gradle.internal.buildevents.BuildExceptionReporter] at org.gradle.launcher.exec.BuildTreeScopeBuildActionExecuter.execute(BuildTreeScopeBuildActionExecuter.java:25) 06:14:13.317 [ERROR] [org.gradle.internal.buildevents.BuildExceptionReporter] at org.gradle.tooling.internal.provider.ContinuousBuildActionExecuter.execute(ContinuousBuildActionExecuter.java:78) 06:14:13.317 [ERROR] [org.gradle.internal.buildevents.BuildExceptionReporter] at org.gradle.tooling.internal.provider.ContinuousBuildActionExecuter.execute(ContinuousBuildActionExecuter.java:52) 06:14:13.318 [ERROR] [org.gradle.internal.buildevents.BuildExceptionReporter] at org.gradle.tooling.internal.provider.ServicesSetupBuildActionExecuter.execute(ServicesSetupBuildActionExecuter.java:62) 06:14:13.318 [ERROR] [org.gradle.internal.buildevents.BuildExceptionReporter] at org.gradle.tooling.internal.provider.ServicesSetupBuildActionExecuter.execute(ServicesSetupBuildActionExecuter.java:34) 06:14:13.318 [ERROR] [org.gradle.internal.buildevents.BuildExceptionReporter] at org.gradle.tooling.internal.provider.GradleThreadBuildActionExecuter.execute(GradleThreadBuildActionExecuter.java:36) 06:14:13.318 [ERROR] [org.gradle.internal.buildevents.BuildExceptionReporter] at org.gradle.tooling.internal.provider.GradleThreadBuildActionExecuter.execute(GradleThreadBuildActionExecuter.java:25) 06:14:13.318 [ERROR] [org.gradle.internal.buildevents.BuildExceptionReporter] at org.gradle.tooling.internal.provider.ParallelismConfigurationBuildActionExecuter.execute(ParallelismConfigurationBuildActionExecuter.java:43) 06:14:13.318 [ERROR] [org.gradle.internal.buildevents.BuildExceptionReporter] at org.gradle.tooling.internal.provider.ParallelismConfigurationBuildActionExecuter.execute(ParallelismConfigurationBuildActionExecuter.java:29) 06:14:13.318 [ERROR] [org.gradle.internal.buildevents.BuildExceptionReporter] at org.gradle.tooling.internal.provider.StartParamsValidatingActionExecuter.execute(StartParamsValidatingActionExecuter.java:59) 06:14:13.318 [ERROR] [org.gradle.internal.buildevents.BuildExceptionReporter] at org.gradle.tooling.internal.provider.StartParamsValidatingActionExecuter.execute(StartParamsValidatingActionExecuter.java:31) 06:14:13.318 [ERROR] [org.gradle.internal.buildevents.BuildExceptionReporter] at org.gradle.tooling.internal.provider.SessionFailureReportingActionExecuter.execute(SessionFailureReportingActionExecuter.java:59) 06:14:13.318 [ERROR] [org.gradle.internal.buildevents.BuildExceptionReporter] at org.gradle.tooling.internal.provider.SessionFailureReportingActionExecuter.execute(SessionFailureReportingActionExecuter.java:44) 06:14:13.318 [ERROR] [org.gradle.internal.buildevents.BuildExceptionReporter] at org.gradle.tooling.internal.provider.SetupLoggingActionExecuter.execute(SetupLoggingActionExecuter.java:46) 06:14:13.318 [ERROR] [org.gradle.internal.buildevents.BuildExceptionReporter] at org.gradle.tooling.internal.provider.SetupLoggingActionExecuter.execute(SetupLoggingActionExecuter.java:30) 06:14:13.318 [ERROR] [org.gradle.internal.buildevents.BuildExceptionReporter] at org.gradle.launcher.daemon.server.exec.ExecuteBuild.doBuild(ExecuteBuild.java:67) 06:14:13.318 [ERROR] [org.gradle.internal.buildevents.BuildExceptionReporter] at org.gradle.launcher.daemon.server.exec.BuildCommandOnly.execute(BuildCommandOnly.java:36) 06:14:13.318 [ERROR] [org.gradle.internal.buildevents.BuildExceptionReporter] at org.gradle.launcher.daemon.server.api.DaemonCommandExecution.proceed(DaemonCommandExecution.java:122) 06:14:13.318 [ERROR] [org.gradle.internal.buildevents.BuildExceptionReporter] at org.gradle.launcher.daemon.server.exec.WatchForDisconnection.execute(WatchForDisconnection.java:37) 06:14:13.318 [ERROR] [org.gradle.internal.buildevents.BuildExceptionReporter] at org.gradle.launcher.daemon.server.api.DaemonCommandExecution.proceed(DaemonCommandExecution.java:122) 06:14:13.318 [ERROR] [org.gradle.internal.buildevents.BuildExceptionReporter] at org.gradle.launcher.daemon.server.exec.ResetDeprecationLogger.execute(ResetDeprecationLogger.java:26) 06:14:13.318 [ERROR] [org.gradle.internal.buildevents.BuildExceptionReporter] at org.gradle.launcher.daemon.server.api.DaemonCommandExecution.proceed(DaemonCommandExecution.java:122) 06:14:13.318 [ERROR] [org.gradle.internal.buildevents.BuildExceptionReporter] at org.gradle.launcher.daemon.server.exec.RequestStopIfSingleUsedDaemon.execute(RequestStopIfSingleUsedDaemon.java:34) 06:14:13.318 [ERROR] [org.gradle.internal.buildevents.BuildExceptionReporter] at org.gradle.launcher.daemon.server.api.DaemonCommandExecution.proceed(DaemonCommandExecution.java:122) 06:14:13.318 [ERROR] [org.gradle.internal.buildevents.BuildExceptionReporter] at org.gradle.launcher.daemon.server.exec.ForwardClientInput$2.call(ForwardClientInput.java:74) 06:14:13.318 [ERROR] [org.gradle.internal.buildevents.BuildExceptionReporter] at org.gradle.launcher.daemon.server.exec.ForwardClientInput$2.call(ForwardClientInput.java:72) 06:14:13.318 [ERROR] [org.gradle.internal.buildevents.BuildExceptionReporter] at org.gradle.util.Swapper.swap(Swapper.java:38) 06:14:13.318 [ERROR] [org.gradle.internal.buildevents.BuildExceptionReporter] at org.gradle.launcher.daemon.server.exec.ForwardClientInput.execute(ForwardClientInput.java:72) 06:14:13.318 [ERROR] [org.gradle.internal.buildevents.BuildExceptionReporter] at org.gradle.launcher.daemon.server.api.DaemonCommandExecution.proceed(DaemonCommandExecution.java:122) 06:14:13.318 [ERROR] [org.gradle.internal.buildevents.BuildExceptionReporter] at org.gradle.launcher.daemon.server.exec.LogAndCheckHealth.execute(LogAndCheckHealth.java:55) 06:14:13.319 [ERROR] [org.gradle.internal.buildevents.BuildExceptionReporter] at org.gradle.launcher.daemon.server.api.DaemonCommandExecution.proceed(DaemonCommandExecution.java:122) 06:14:13.331 [ERROR] [org.gradle.internal.buildevents.BuildExceptionReporter] at org.gradle.launcher.daemon.server.exec.LogToClient.doBuild(LogToClient.java:62) 06:14:13.331 [ERROR] [org.gradle.internal.buildevents.BuildExceptionReporter] at org.gradle.launcher.daemon.server.exec.BuildCommandOnly.execute(BuildCommandOnly.java:36) 06:14:13.332 [ERROR] [org.gradle.internal.buildevents.BuildExceptionReporter] at org.gradle.launcher.daemon.server.api.DaemonCommandExecution.proceed(DaemonCommandExecution.java:122) 06:14:13.332 [ERROR] [org.gradle.internal.buildevents.BuildExceptionReporter] at org.gradle.launcher.daemon.server.exec.EstablishBuildEnvironment.doBuild(EstablishBuildEnvironment.java:81) 06:14:13.332 [ERROR] [org.gradle.internal.buildevents.BuildExceptionReporter] at org.gradle.launcher.daemon.server.exec.BuildCommandOnly.execute(BuildCommandOnly.java:36) 06:14:13.332 [ERROR] [org.gradle.internal.buildevents.BuildExceptionReporter] at org.gradle.launcher.daemon.server.api.DaemonCommandExecution.proceed(DaemonCommandExecution.java:122) 06:14:13.332 [ERROR] [org.gradle.internal.buildevents.BuildExceptionReporter] at org.gradle.launcher.daemon.server.exec.StartBuildOrRespondWithBusy$1.run(StartBuildOrRespondWithBusy.java:50) 06:14:13.332 [ERROR] [org.gradle.internal.buildevents.BuildExceptionReporter] at org.gradle.launcher.daemon.server.DaemonStateCoordinator$1.run(DaemonStateCoordinator.java:295) 06:14:13.332 [ERROR] [org.gradle.internal.buildevents.BuildExceptionReporter] at org.gradle.internal.concurrent.ExecutorPolicy$CatchAndRecordFailures.onExecute(ExecutorPolicy.java:63) 06:14:13.332 [ERROR] [org.gradle.internal.buildevents.BuildExceptionReporter] at org.gradle.internal.concurrent.ManagedExecutorImpl$1.run(ManagedExecutorImpl.java:46) 06:14:13.332 [ERROR] [org.gradle.internal.buildevents.BuildExceptionReporter] at org.gradle.internal.concurrent.ThreadFactoryImpl$ManagedThreadRunnable.run(ThreadFactoryImpl.java:55) 06:14:13.332 [ERROR] [org.gradle.internal.buildevents.BuildExceptionReporter] Caused by: org.gradle.api.GradleException: The execution of the download was interrupted 06:14:13.332 [ERROR] [org.gradle.internal.buildevents.BuildExceptionReporter] at java.base/jdk.internal.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) 06:14:13.332 [ERROR] [org.gradle.internal.buildevents.BuildExceptionReporter] at java.base/jdk.internal.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) 06:14:13.332 [ERROR] [org.gradle.internal.buildevents.BuildExceptionReporter] at java.base/jdk.internal.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) 06:14:13.332 [ERROR] [org.gradle.internal.buildevents.BuildExceptionReporter] at org.owasp.dependencycheck.gradle.tasks.Update.update(Update.groovy:82) 06:14:13.332 [ERROR] [org.gradle.internal.buildevents.BuildExceptionReporter] at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) 06:14:13.332 [ERROR] [org.gradle.internal.buildevents.BuildExceptionReporter] at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) 06:14:13.332 [ERROR] [org.gradle.internal.buildevents.BuildExceptionReporter] at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) 06:14:13.332 [ERROR] [org.gradle.internal.buildevents.BuildExceptionReporter] at org.gradle.internal.reflect.JavaMethod.invoke(JavaMethod.java:73) 06:14:13.332 [ERROR] [org.gradle.internal.buildevents.BuildExceptionReporter] at org.gradle.api.internal.project.taskfactory.StandardTaskAction.doExecute(StandardTaskAction.java:48) 06:14:13.332 [ERROR] [org.gradle.internal.buildevents.BuildExceptionReporter] at org.gradle.api.internal.project.taskfactory.StandardTaskAction.execute(StandardTaskAction.java:41) 06:14:13.332 [ERROR] [org.gradle.internal.buildevents.BuildExceptionReporter] at org.gradle.api.internal.project.taskfactory.StandardTaskAction.execute(StandardTaskAction.java:28) 06:14:13.332 [ERROR] [org.gradle.internal.buildevents.BuildExceptionReporter] at org.gradle.api.internal.AbstractTask$TaskActionWrapper.execute(AbstractTask.java:704) 06:14:13.332 [ERROR] [org.gradle.internal.buildevents.BuildExceptionReporter] at org.gradle.api.internal.AbstractTask$TaskActionWrapper.execute(AbstractTask.java:671) 06:14:13.332 [ERROR] [org.gradle.internal.buildevents.BuildExceptionReporter] at org.gradle.api.internal.tasks.execution.ExecuteActionsTaskExecuter$1.run(ExecuteActionsTaskExecuter.java:117) 06:14:13.332 [ERROR] [org.gradle.internal.buildevents.BuildExceptionReporter] at org.gradle.internal.operations.DefaultBuildOperationExecutor$RunnableBuildOperationWorker.execute(DefaultBuildOperationExecutor.java:301) 06:14:13.332 [ERROR] [org.gradle.internal.buildevents.BuildExceptionReporter] at org.gradle.internal.operations.DefaultBuildOperationExecutor$RunnableBuildOperationWorker.execute(DefaultBuildOperationExecutor.java:293) 06:14:13.332 [ERROR] [org.gradle.internal.buildevents.BuildExceptionReporter] at org.gradle.internal.operations.DefaultBuildOperationExecutor.execute(DefaultBuildOperationExecutor.java:175) 06:14:13.332 [ERROR] [org.gradle.internal.buildevents.BuildExceptionReporter] at org.gradle.internal.operations.DefaultBuildOperationExecutor.run(DefaultBuildOperationExecutor.java:91) 06:14:13.332 [ERROR] [org.gradle.internal.buildevents.BuildExceptionReporter] at org.gradle.internal.operations.DelegatingBuildOperationExecutor.run(DelegatingBuildOperationExecutor.java:31) 06:14:13.332 [ERROR] [org.gradle.internal.buildevents.BuildExceptionReporter] at org.gradle.api.internal.tasks.execution.ExecuteActionsTaskExecuter.executeAction(ExecuteActionsTaskExecuter.java:106) 06:14:13.332 [ERROR] [org.gradle.internal.buildevents.BuildExceptionReporter] at org.gradle.api.internal.tasks.execution.ExecuteActionsTaskExecuter.executeActions(ExecuteActionsTaskExecuter.java:85) 06:14:13.332 [ERROR] [org.gradle.internal.buildevents.BuildExceptionReporter] ... 118 more 06:14:13.332 [ERROR] [org.gradle.internal.buildevents.BuildExceptionReporter] Caused by: org.owasp.dependencycheck.data.update.exception.UpdateException: The execution of the download was interrupted 06:14:13.332 [ERROR] [org.gradle.internal.buildevents.BuildExceptionReporter] at org.owasp.dependencycheck.data.update.NvdCveUpdater.performUpdate(NvdCveUpdater.java:317) 06:14:13.332 [ERROR] [org.gradle.internal.buildevents.BuildExceptionReporter] at org.owasp.dependencycheck.data.update.NvdCveUpdater.update(NvdCveUpdater.java:125) 06:14:13.332 [ERROR] [org.gradle.internal.buildevents.BuildExceptionReporter] at org.owasp.dependencycheck.Engine.doUpdates(Engine.java:922) 06:14:13.332 [ERROR] [org.gradle.internal.buildevents.BuildExceptionReporter] at org.owasp.dependencycheck.Engine.doUpdates(Engine.java:889) 06:14:13.332 [ERROR] [org.gradle.internal.buildevents.BuildExceptionReporter] at org.owasp.dependencycheck.Engine$doUpdates.call(Unknown Source) 06:14:13.332 [ERROR] [org.gradle.internal.buildevents.BuildExceptionReporter] at org.owasp.dependencycheck.gradle.tasks.Update.update(Update.groovy:72) 06:14:13.332 [ERROR] [org.gradle.internal.buildevents.BuildExceptionReporter] ... 135 more 06:14:13.332 [ERROR] [org.gradle.internal.buildevents.BuildExceptionReporter] Caused by: java.util.concurrent.ExecutionException: org.owasp.dependencycheck.analyzer.exception.UnexpectedAnalysisException: java.sql.SQLDataException: (conn=24) Incorrect string value: '\xEF\xBF\xBDno ...' for columnnvd.vulnerability.descriptionat row 1 06:14:13.333 [ERROR] [org.gradle.internal.buildevents.BuildExceptionReporter] at org.owasp.dependencycheck.data.update.NvdCveUpdater.performUpdate(NvdCveUpdater.java:307) 06:14:13.333 [ERROR] [org.gradle.internal.buildevents.BuildExceptionReporter] ... 140 more 06:14:13.333 [ERROR] [org.gradle.internal.buildevents.BuildExceptionReporter] Caused by: org.owasp.dependencycheck.analyzer.exception.UnexpectedAnalysisException: java.sql.SQLDataException: (conn=24) Incorrect string value: '\xEF\xBF\xBDno ...' for columnnvd.vulnerability.descriptionat row 1 06:14:13.333 [ERROR] [org.gradle.internal.buildevents.BuildExceptionReporter] at org.owasp.dependencycheck.data.nvdcve.CveDB.updateVulnerabilityUpdateVulnerability(CveDB.java:1165) 06:14:13.333 [ERROR] [org.gradle.internal.buildevents.BuildExceptionReporter] at org.owasp.dependencycheck.data.nvdcve.CveDB.updateVulnerability(CveDB.java:937) 06:14:13.333 [ERROR] [org.gradle.internal.buildevents.BuildExceptionReporter] at org.owasp.dependencycheck.data.update.nvd.NvdCveParser.parse(NvdCveParser.java:99) 06:14:13.333 [ERROR] [org.gradle.internal.buildevents.BuildExceptionReporter] at org.owasp.dependencycheck.data.update.nvd.ProcessTask.importJSON(ProcessTask.java:139) 06:14:13.333 [ERROR] [org.gradle.internal.buildevents.BuildExceptionReporter] at org.owasp.dependencycheck.data.update.nvd.ProcessTask.processFiles(ProcessTask.java:152) 06:14:13.333 [ERROR] [org.gradle.internal.buildevents.BuildExceptionReporter] at org.owasp.dependencycheck.data.update.nvd.ProcessTask.call(ProcessTask.java:113) 06:14:13.333 [ERROR] [org.gradle.internal.buildevents.BuildExceptionReporter] at org.owasp.dependencycheck.data.update.nvd.ProcessTask.call(ProcessTask.java:40) 06:14:13.333 [ERROR] [org.gradle.internal.buildevents.BuildExceptionReporter] Caused by: java.sql.SQLDataException: (conn=24) Incorrect string value: '\xEF\xBF\xBDno ...' for columnnvd.vulnerability.descriptionat row 1 06:14:13.333 [ERROR] [org.gradle.internal.buildevents.BuildExceptionReporter] at org.mariadb.jdbc.internal.util.exceptions.ExceptionMapper.get(ExceptionMapper.java:232) 06:14:13.333 [ERROR] [org.gradle.internal.buildevents.BuildExceptionReporter] at org.mariadb.jdbc.internal.util.exceptions.ExceptionMapper.getException(ExceptionMapper.java:164) 06:14:13.333 [ERROR] [org.gradle.internal.buildevents.BuildExceptionReporter] at org.mariadb.jdbc.MariaDbStatement.executeExceptionEpilogue(MariaDbStatement.java:258) 06:14:13.333 [ERROR] [org.gradle.internal.buildevents.BuildExceptionReporter] at org.mariadb.jdbc.ClientSidePreparedStatement.executeInternal(ClientSidePreparedStatement.java:225) 06:14:13.333 [ERROR] [org.gradle.internal.buildevents.BuildExceptionReporter] at org.mariadb.jdbc.ClientSidePreparedStatement.execute(ClientSidePreparedStatement.java:145) 06:14:13.333 [ERROR] [org.gradle.internal.buildevents.BuildExceptionReporter] at org.mariadb.jdbc.ClientSidePreparedStatement.executeUpdate(ClientSidePreparedStatement.java:176) 06:14:13.333 [ERROR] [org.gradle.internal.buildevents.BuildExceptionReporter] at org.owasp.dependencycheck.data.nvdcve.CveDB.updateVulnerabilityUpdateVulnerability(CveDB.java:1163) 06:14:13.333 [ERROR] [org.gradle.internal.buildevents.BuildExceptionReporter] ... 6 more 06:14:13.333 [ERROR] [org.gradle.internal.buildevents.BuildExceptionReporter] Caused by: java.sql.SQLException: Incorrect string value: '\xEF\xBF\xBDno ...' for columnnvd.vulnerability.descriptionat row 1 06:14:13.333 [ERROR] [org.gradle.internal.buildevents.BuildExceptionReporter] at org.mariadb.jdbc.internal.protocol.AbstractQueryProtocol.readErrorPacket(AbstractQueryProtocol.java:1599) 06:14:13.333 [ERROR] [org.gradle.internal.buildevents.BuildExceptionReporter] at org.mariadb.jdbc.internal.protocol.AbstractQueryProtocol.readPacket(AbstractQueryProtocol.java:1461) 06:14:13.333 [ERROR] [org.gradle.internal.buildevents.BuildExceptionReporter] at org.mariadb.jdbc.internal.protocol.AbstractQueryProtocol.getResult(AbstractQueryProtocol.java:1424) 06:14:13.333 [ERROR] [org.gradle.internal.buildevents.BuildExceptionReporter] at org.mariadb.jdbc.internal.protocol.AbstractQueryProtocol.executeQuery(AbstractQueryProtocol.java:240) 06:14:13.333 [ERROR] [org.gradle.internal.buildevents.BuildExceptionReporter] at org.mariadb.jdbc.ClientSidePreparedStatement.executeInternal(ClientSidePreparedStatement.java:216) 06:14:13.333 [ERROR] [org.gradle.internal.buildevents.BuildExceptionReporter] ... 9 more 06:14:13.333 [ERROR] [org.gradle.internal.buildevents.BuildExceptionReporter] 06:14:13.333 [ERROR] [org.gradle.internal.buildevents.BuildExceptionReporter] 06:14:13.333 [ERROR] [org.gradle.internal.buildevents.BuildExceptionReporter] * Get more help at https://help.gradle.org 06:14:13.333 [ERROR] [org.gradle.internal.buildevents.BuildResultLogger] 06:14:13.333 [ERROR] [org.gradle.internal.buildevents.BuildResultLogger] BUILD FAILED in 2m 0s

To Reproduce Steps to reproduce the behavior:

  1. Try to perform a fresh population of a local mariadb NVD CVE database, from NIST NVD CVE json feed

Expected behavior NVD DB update using NIST NVD CVE json feed as source, successfully completes

Additional context 1) I think adding an input sanitization method to https://github.com/jeremylong/DependencyCheck/blob/master/core/src/main/java/org/owasp/dependencycheck/data/nvdcve/CveDB.java#L929 would prevent this from happening again 2) Converting the character set for all of the tables (except for cpeEntry) fixes this issue as well. If you convert the cpeEntry table, you end up with "non-fatal" errors in the stacktrace showing java.sql.SQLSyntaxErrorException: (conn=11) Table 'nvd.CPEENTRY' doesn't exist (casing issues?):

SET foreign_key_checks = 0; ALTER TABLE cweEntry CONVERT TO CHARACTER SET utf8 COLLATE utf8_general_ci; SET foreign_key_checks = 1;
SET foreign_key_checks = 0; ALTER TABLE properties CONVERT TO CHARACTER SET utf8 COLLATE utf8_general_ci; SET foreign_key_checks = 1; 
SET foreign_key_checks = 0; ALTER TABLE reference CONVERT TO CHARACTER SET utf8 COLLATE utf8_general_ci; SET foreign_key_checks = 1; 
SET foreign_key_checks = 0; ALTER TABLE software CONVERT TO CHARACTER SET utf8 COLLATE utf8_general_ci; SET foreign_key_checks = 1; 
SET foreign_key_checks = 0; ALTER TABLE vulnerability CONVERT TO CHARACTER SET utf8 COLLATE utf8_general_ci; SET foreign_key_checks = 1; 
ALTER DATABASE CHARACTER SET utf8 COLLATE utf8_general_ci;
hoerup commented 1 year ago

I ran into the same problem Applied ALTER DATABASE CHARACTER SET utf8 COLLATE utf8_general_ci; and recreated all tables etc from https://github.com/jeremylong/DependencyCheck/blob/main/core/src/main/resources/data/initialize_mysql.sql

And now import ran fine