search

delphi-hub / delphi-crawler

Delphi's crawling and processing engine to extract facts on open-source software
https://delphi.cs.uni-paderborn.de/
Apache License 2.0
5 stars 11 forks source link

Source fails when u-value is not splittable #29

Closed bhermann closed 6 years ago

bhermann commented 6 years ago

Describe the bug At some point in the source processing the split operation fails while reading the index.

To Reproduce Read index until the end. The following error occurs:

[2018-10-23 23:26:41,627]  a.s.s.RestartWithBackoffSource - Restarting graph due to failure. stack_trace: ,
java.lang.NullPointerException,
    at scala.collection.immutable.StringLike.split$(StringLike.scala:261),
    at scala.collection.immutable.StringLike.split(StringLike.scala:263),
    at scala.collection.immutable.StringOps.split(StringOps.scala:29),
    at de.upb.cs.swt.delphi.crawler.discovery.maven.IndexProcessing.$anonfun$createSource$4(IndexProcessing.scala:46),
    at akka.stream.impl.fusing.ActorGraphInterpreter$SimpleBoundaryEvent.execute$(ActorGraphInterpreter.scala:41),
    at akka.stream.impl.UnfoldResourceSource$$anon$1.onPull(UnfoldResourceSource.scala:42),
    at akka.stream.impl.fusing.GraphInterpreter.processPull(GraphInterpreter.scala:526),
    at akka.stream.impl.fusing.GraphInterpreter.execute(GraphInterpreter.scala:422),
    at akka.stream.impl.fusing.GraphInterpreterShell.runBatch(ActorGraphInterpreter.scala:588),
    at akka.stream.impl.fusing.ActorGraphInterpreter$SimpleBoundaryEvent.execute(ActorGraphInterpreter.scala:45),
    at akka.stream.impl.fusing.ActorGraphInterpreter$RequestMore.execute(ActorGraphInterpreter.scala:252),
    at akka.stream.impl.fusing.GraphInterpreterShell.processEvent(ActorGraphInterpreter.scala:563),
    at akka.stream.impl.fusing.ActorGraphInterpreter.akka$stream$impl$fusing$ActorGraphInterpreter$$processEvent(ActorGraphInterpreter.scala:745),
    at akka.actor.Actor.aroundReceive(Actor.scala:517),
    at akka.stream.impl.fusing.ActorGraphInterpreter$$anonfun$receive$1.applyOrElse(ActorGraphInterpreter.scala:760),
    at akka.stream.impl.fusing.ActorGraphInterpreter.aroundReceive(ActorGraphInterpreter.scala:670),
    at akka.actor.Actor.aroundReceive$(Actor.scala:515),
    at akka.actor.ActorCell.receiveMessage(ActorCell.scala:588),
    at akka.actor.ActorCell.invoke(ActorCell.scala:557),
    at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:258),
    at akka.dispatch.Mailbox.run(Mailbox.scala:225),
    at java.lang.Thread.run(Thread.java:748),
    at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624),
    at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)

Expected behavior A clear and concise description of what you expected to happen.

Screenshots If applicable, add screenshots to help explain your problem.

Affected components (if known) crawler

Desktop (please complete the following information, if relevant): n/a

Smartphone (please complete the following information, if relevant): n/a

Additional context None