jcustenborder / kafka-connect-solr

Kafka Connect connector for writing to Solr.
Apache License 2.0
44 stars 28 forks source link

CloudSolrSinkConnector seems to read topics as solr collection #13

Closed copmir closed 6 years ago

copmir commented 6 years ago

Hi Jeremy,

i use the HttpSolrSinkConnector and all rights, it's fine, works. I want use the CloudSolrSinkConnector with this configuration too:

name=cloudsolr topics=source-db-11 tasks.max=2 connector.class=com.github.jcustenborder.kafka.connect.solr.CloudSolrSinkConnector solr.collection.name=solrCollection solr.zookeeper.hosts=...list of zookeeper nodes.... solr.commit.within=5000

but i have the error below. Can you help me please? Many thanks

[2017-12-11 15:42:56,113] ERROR Task cloudsolr-1 threw an uncaught and unrecover able exception (org.apache.kafka.connect.runtime.WorkerSinkTask:482) org.apache.solr.common.SolrException: Collection not found: source-db-11 at org.apache.solr.client.solrj.impl.CloudSolrClient.getCollectionNames( CloudSolrClient.java:1139) at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnS taleState(CloudSolrClient.java:822) at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrCl ient.java:793) at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:178 ) at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:195 ) at com.github.jcustenborder.kafka.connect.solr.CloudSolrSinkTask.process (CloudSolrSinkTask.java:53) at com.github.jcustenborder.kafka.connect.solr.SolrSinkTask.put(SolrSink Task.java:74) at org.apache.kafka.connect.runtime.WorkerSinkTask.deliverMessages(Worke rSinkTask.java:464) at org.apache.kafka.connect.runtime.WorkerSinkTask.poll(WorkerSinkTask.j ava:265) at org.apache.kafka.connect.runtime.WorkerSinkTask.iteration(WorkerSinkT ask.java:182) at org.apache.kafka.connect.runtime.WorkerSinkTask.execute(WorkerSinkTas k.java:150) at org.apache.kafka.connect.runtime.WorkerTask.doRun(WorkerTask.java:146 ) at org.apache.kafka.connect.runtime.WorkerTask.run(WorkerTask.java:190)

jcustenborder commented 6 years ago

This is by design. Change the topic name using a Transformation