search

Hydrospheredata / mist

Serverless proxy for Spark cluster
http://hydrosphere.io/mist/
Apache License 2.0
326 stars 68 forks source link

Starting child for FunctionInfoProvider failed #554

Open daffydee13 opened 4 years ago

daffydee13 commented 4 years ago

It shows error starting child for Initialization of FunctionInfoProvider failed of timeout

2020-01-18 23:38:50 ERROR RestartSupervisor:159 - Starting child for FunctionInfoProvider failed java.lang.IllegalStateException: Initialization of FunctionInfoProvider failed of timeout at io.hydrosphere.mist.master.jobs.ActorRefWaiter$IdentityActor$$anonfun$receive$1.apply$ at akka.actor.Actor$class.aroundReceive(Actor.scala:517) at io.hydrosphere.mist.master.jobs.ActorRefWaiter$IdentityActor.aroundReceive(FunctionIn$ at akka.actor.ActorCell.receiveMessage(ActorCell.scala:527) at akka.actor.ActorCell.invoke(ActorCell.scala:496) at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:257) at akka.dispatch.Mailbox.run(Mailbox.scala:224) at akka.dispatch.Mailbox.exec(Mailbox.scala:234) at akka.dispatch.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260) at akka.dispatch.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1339) at akka.dispatch.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979) at akka.dispatch.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107)

daffydee13 commented 4 years ago

How can I increase timeout value??

dos65 commented 4 years ago

Probably this problem is not related to timeout. FunctionInfoProvider fails for some reason. The best way to find out what is happening is to check the logs directory. There should be a file named infoprovider.log or something like that.

daffydee13 commented 4 years ago

Thanks dos65 for your quick response, after going through log carefully I noticed actual error was java.lang.NoSuchMethodError: scala.runtime.IntRef.create(I)Lscala/runtime/IntRef This is solved by using older version of mist i.e. mist-0.12.2-2.1.1.tar.gz

dos65 commented 4 years ago

0.12.2 is so old. Which version of spark/scala do you use?

The message above probably means that you have spark compiled against scala 2.10. The recent version of mist don't support this scala version.

daffydee13 commented 4 years ago

I am using scala 2.11.8, what could be the possible version of mist that I can use to avoid above error

dos65 commented 4 years ago

@daffydee13 I can't reproduce this problem using the latest version. I tried to run mist on spark 2.0.0 and it works. Are you sure that there is no scala-2.10 in the classpath?

Maybe you have a suggestion about how to reproduce it?