search

plaa / mongo-spark

Example application on how to use mongo-hadoop connector with Spark
90 stars 58 forks source link

Does this support mongos #1

Open RLily opened 9 years ago

RLily commented 9 years ago

When I run the wordcount program , I got an error "Exception in thread "main" java.io.IOException: com.mongodb.hadoop.splitter.SplitFailedException: Unable to calculate input splits: doing a splitVector across dbs isn't supported via mongos"

plaa commented 9 years ago

I don't know. You should find out / ask whether the mongo-hadoop connector supports mongos or not.

RLily commented 9 years ago

The latest edition 1.3.1 supports replica set and shard cluster; But when I run your wordcount program I got another error "Exception in thread "main" org.apache.spark.SparkException: Job aborted due to stage failure: Task 0 in stage 0.0 failed 4 times, most recent failure: Lost task 0.3 in stage 0.0 (TID 3, slavetest1): java.lang.IllegalStateException: unread block data"

yeyimilk commented 9 years ago

Hi, I have a program uses your mongo-hadoop connector connects to mongos with local modal and it runs well, however , if I uses standalone cluster modal, it throws 'java.lang.IllegalSateException: open'