search

jcustenborder / kafka-connect-solr

Kafka Connect connector for writing to Solr.
Apache License 2.0
43 stars 28 forks source link

Timeout configuration ?? #40

Closed ramyogi closed 4 years ago

ramyogi commented 4 years ago

While indexing large document we get timeout is,

Caused by: org.apache.solr.client.solrj.impl.CloudSolrClient$RouteException: Timeout occurred while waiting response from server at: http://<>/_shard7_replica_n52 at org.apache.solr.client.solrj.impl.CloudSolrClient.getRouteException(CloudSolrClient.java:125) at org.apache.solr.client.solrj.impl.CloudSolrClient.getRouteException(CloudSolrClient.java:46) at org.apache.solr.client.solrj.impl.BaseCloudSolrClient.directUpdate(BaseCloudSolrClient.java:551) at org.apache.solr.client.solrj.impl.BaseCloudSolrClient.sendRequest(BaseCloudSolrClient.java:1037) at org.apache.solr.client.solrj.impl.BaseCloudSolrClient.requestWithRetryOnStaleState(BaseCloudSolrClient.java:897) at org.apache.solr.client.solrj.impl.BaseCloudSolrClient.request(BaseCloudSolrClient.java:829) at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:211) at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:228) at com.github.jcustenborder.kafka.connect.solr.CloudSolrSinkTask.process(CloudSolrSinkTask.java:53) at com.github.jcustenborder.kafka.connect.solr.SolrSinkTask.put(SolrSinkTask.java:75) at org.apache.kafka.connect.runtime.WorkerSinkTask.deliverMessages(WorkerSinkTask.java:538) ... 10 more Caused by: org.apache.solr.client.solrj.SolrServerException: Timeout occurred while waiting response from server at: http://<>/shard7_replica_n52 at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:667) at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:262) at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:245) at org.apache.solr.client.solrj.impl.LBSolrClient.doRequest(LBSolrClient.java:368) at org.apache.solr.client.solrj.impl.LBSolrClient.request(LBSolrClient.java:296) at org.apache.solr.client.solrj.impl.BaseCloudSolrClient.lambda$directUpdate$0(BaseCloudSolrClient.java:525) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:209) ... 3 more

is it possible to introduce timeout parameter for Configuration like what we did for ZK connection timeout .

ramyogi commented 4 years ago

@jcustenborder if you can provide some permission. I can submit pull request for review.

$ git push --set-upstream origin issue-40 Username for 'https://github.com': ramyogi Password for 'https://ramyogi@github.com': remote: Permission to jcustenborder/kafka-connect-solr.git denied to ramyogi. fatal: unable to access 'https://github.com/jcustenborder/kafka-connect-solr/': The requested URL returned error: 403

jcustenborder commented 4 years ago

@ramyogi That's not a pull request. That's pushing to the repo. You need to fork the repo. Push your changes to the fork, then create a pull request.

ramyogi7283 commented 4 years ago

https://github.com/jcustenborder/kafka-connect-solr/pull/41

ramyogi7283 commented 4 years ago

Thanks @jcustenborder Please review the PR and let me know your comments.