lucidworks / spark-solr

Tools for reading data from Solr as a Spark RDD and indexing objects from Spark into Solr using SolrJ.
Apache License 2.0
446 stars 250 forks source link

improve retries by adding parameters #317

Closed nddipiazza closed 3 years ago

nddipiazza commented 3 years ago

New retry parameters:

==== retry_backoff_delay_ms

The retry_backoff_delay_ms option, when doing retries is the amount to backoff between retries, in milliseconds.

Usage: option("retry_backoff_delay_ms", "1000")

Default: 2500

==== retry_max_delay_ms

The retry_max_delay_ms option, when doing retries is the maximum amount of delay for a single backoff, in milliseconds.

Usage: option("retry_max_delay_ms", "5000")

Default: 10000

==== retry_max_duration_ms

The retry_max_duration_ms option, when doing retries is the maximum duration of a retry attempt, in milliseconds.

Usage: option("retry_max_duration_ms", "120000")

Default: 60000