From this, you can see the same library is installed twice and then it uses the wrong one when opening the session with Spark master, causing a version mismatch and therefore failing the connection:
24/02/29 16:13:46 ERROR TransportRequestHandler: Error while invoking RpcHandler#receive() for one-way message.
java.io.InvalidClassException: scala.concurrent.duration.FiniteDuration; local class incompatible: stream classdesc serialVersionUID = -6513803676778706429,
local class serialVersionUID = -4594686286536372853
This means that the version I specify, RC8 is not respected.
How do I enforce this?
I am installing Almond as in here
Then, on my notebook that used to work with older versions I have the following:
As you see it downloads RC3 related libraries instead of RC8.
And when running the session building this is again showing on the logs:
From this, you can see the same library is installed twice and then it uses the wrong one when opening the session with Spark master, causing a version mismatch and therefore failing the connection:
This means that the version I specify, RC8 is not respected. How do I enforce this?