search

buddycloud / channel-directory

The buddycloud search engine. Search and recommendations based on solr and mahaut.
https://buddycloud.org/wiki/Channel_Directory_Project
Apache License 2.0
21 stars 7 forks source link

Parsing error when crawling some nodes #23

Closed abmargb closed 10 years ago

abmargb commented 12 years ago

2012-03-27 17:47:18,653 [main] WARN com.buddycloud.channeldirectory.crawler.PubSubServerCrawler - Could not crawl node [/user/report_bugs@topics.buddycloud.org/posts] from server [topics.zemarov.org] org.dom4j.DocumentException: Error on line 1 of document : The entity name must immediately follow the '&' in the entity reference. Nested exception: The entity name must immediately follow the '&' in the entity reference. at org.dom4j.io.SAXReader.read(SAXReader.java:350) at org.dom4j.DocumentHelper.parseText(DocumentHelper.java:216) at com.buddycloud.channeldirectory.crawler.node.PostCrawler.crawl(PostCrawler.java:80) at com.buddycloud.channeldirectory.crawler.PubSubServerCrawler.crawl(PubSubServerCrawler.java:163) at com.buddycloud.channeldirectory.crawler.PubSubServerCrawler.fetchAndCrawl(PubSubServerCrawler.java:192) at com.buddycloud.channeldirectory.crawler.PubSubServerCrawler.fetch(PubSubServerCrawler.java:137) at com.buddycloud.channeldirectory.crawler.PubSubServerCrawler.start(PubSubServerCrawler.java:91) at com.buddycloud.channeldirectory.crawler.Main.main(Main.java:63) Nested exception: org.xml.sax.SAXParseException; lineNumber: 1; columnNumber: 60; The entity name must immediately follow the '&' in the entity reference. at com.sun.org.apache.xerces.internal.util.ErrorHandlerWrapper.createSAXParseException(ErrorHandlerWrapper.java:198) at com.sun.org.apache.xerces.internal.util.ErrorHandlerWrapper.fatalError(ErrorHandlerWrapper.java:177) at com.sun.org.apache.xerces.internal.impl.XMLErrorReporter.reportError(XMLErrorReporter.java:391) at com.sun.org.apache.xerces.internal.impl.XMLScanner.reportFatalError(XMLScanner.java:1391) at com.sun.org.apache.xerces.internal.impl.XMLDocumentFragmentScannerImpl.scanEntityReference(XMLDocumentFragmentScannerImpl.java:1823) at com.sun.org.apache.xerces.internal.impl.XMLDocumentFragmentScannerImpl$FragmentContentDriver.next(XMLDocumentFragmentScannerImpl.java:3009) at com.sun.org.apache.xerces.internal.impl.XMLDocumentScannerImpl.next(XMLDocumentScannerImpl.java:625) at com.sun.org.apache.xerces.internal.impl.XMLNSDocumentScannerImpl.next(XMLNSDocumentScannerImpl.java:116) at com.sun.org.apache.xerces.internal.impl.XMLDocumentFragmentScannerImpl.scanDocument(XMLDocumentFragmentScannerImpl.java:488) at com.sun.org.apache.xerces.internal.parsers.XML11Configuration.parse(XML11Configuration.java:819) at com.sun.org.apache.xerces.internal.parsers.XML11Configuration.parse(XML11Configuration.java:748) at com.sun.org.apache.xerces.internal.parsers.XMLParser.parse(XMLParser.java:123) at com.sun.org.apache.xerces.internal.parsers.AbstractSAXParser.parse(AbstractSAXParser.java:1208) at com.sun.org.apache.xerces.internal.jaxp.SAXParserImpl$JAXPSAXParser.parse(SAXParserImpl.java:525) at org.dom4j.io.SAXReader.read(SAXReader.java:334) at org.dom4j.DocumentHelper.parseText(DocumentHelper.java:216) at com.buddycloud.channeldirectory.crawler.node.PostCrawler.crawl(PostCrawler.java:80) at com.buddycloud.channeldirectory.crawler.PubSubServerCrawler.crawl(PubSubServerCrawler.java:163) at com.buddycloud.channeldirectory.crawler.PubSubServerCrawler.fetchAndCrawl(PubSubServerCrawler.java:192) at com.buddycloud.channeldirectory.crawler.PubSubServerCrawler.fetch(PubSubServerCrawler.java:137) at com.buddycloud.channeldirectory.crawler.PubSubServerCrawler.start(PubSubServerCrawler.java:91) at com.buddycloud.channeldirectory.crawler.Main.main(Main.java:63)

imaginator commented 12 years ago

Looks like it is crawling the wrong server for a channel:

2012-03-27 17:47:18,653 [main] WARN com.buddycloud.channeldirectory.crawler.PubSubServerCrawler - Could not crawl node [/user/report_bugs@topics.buddycloud.org/posts] from server [topics.zemarov.org]

S.

Simon Tennant simon@buddycloud.com +49 17 8545 0880

On 27 Mar 2012, at 20:05, Abmar Barros wrote:

2012-03-27 17:47:18,653 [main] WARN com.buddycloud.channeldirectory.crawler.PubSubServerCrawler - Could not crawl node [/user/report_bugs@topics.buddycloud.org/posts] from server [topics.zemarov.org]

abmargb commented 12 years ago

Yes, it seems to be some problem with the discovery itself.

abmargb commented 10 years ago

Duplicate. See https://github.com/buddycloud/channel-directory/issues/37.