Open GoogleCodeExporter opened 8 years ago
Sorry people.
I finally make it work but now i have other problems.
As you said last line at permissions make it fail.
now i have that out:
chema@debian:~/workspace/markcraw/dist/lib$ java -jar crawler.jar --package
../../data/pkgreduced
Feb 06, 2012 3:52:32 PM com.marketplace.Main createPackageThread
INFO: Creating threads for fetching apps via packages.
Feb 06, 2012 3:52:32 PM com.marketplace.io.Fetcher readFile
INFO: Read 1 lines
Feb 06, 2012 3:52:32 PM com.marketplace.service.PackageThread run
INFO: Creating thread for package: com.whatsapp API Level: 1
Feb 06, 2012 3:52:32 PM com.marketplace.service.PackageThread run
INFO: Creating thread for package: com.whatsapp API Level: 2
Feb 06, 2012 3:52:32 PM com.marketplace.service.PackageThread run
INFO: Creating thread for package: com.whatsapp API Level: 3
Feb 06, 2012 3:52:32 PM com.marketplace.io.Fetcher getAppsByPackageName
INFO: Getting package: com.whatsapp
Feb 06, 2012 3:52:32 PM com.marketplace.service.PackageThread run
INFO: Creating thread for package: com.whatsapp API Level: 11
Feb 06, 2012 3:52:32 PM com.marketplace.service.PackageThread run
INFO: Creating thread for package: com.whatsapp API Level: 4
Feb 06, 2012 3:52:32 PM com.marketplace.service.PackageThread run
INFO: Creating thread for package: com.whatsapp API Level: 5
Feb 06, 2012 3:52:32 PM com.marketplace.service.PackageThread run
INFO: Creating thread for package: com.whatsapp API Level: 6
Feb 06, 2012 3:52:32 PM com.marketplace.service.PackageThread run
INFO: Creating thread for package: com.whatsapp API Level: 7
Feb 06, 2012 3:52:32 PM com.marketplace.service.PackageThread run
INFO: Creating thread for package: com.whatsapp API Level: 8
Feb 06, 2012 3:52:32 PM com.marketplace.service.PackageThread run
INFO: Creating thread for package: com.whatsapp API Level: 9
Feb 06, 2012 3:52:32 PM com.marketplace.service.PackageThread run
INFO: Creating thread for package: com.whatsapp API Level: 10
Feb 06, 2012 3:52:32 PM com.marketplace.io.Fetcher getAppsByPackageName
INFO: Getting package: com.whatsapp
Feb 06, 2012 3:52:32 PM com.marketplace.Utils$Permission <init>
INFO: Loading permissions
Feb 06, 2012 3:52:33 PM com.marketplace.io.Fetcher getAppsByPackageName
INFO: Getting package: com.whatsapp
Feb 06, 2012 3:52:33 PM com.marketplace.io.Fetcher getAppsByPackageName
INFO: Getting package: com.whatsapp
Feb 06, 2012 3:52:34 PM com.marketplace.io.Fetcher getAppsByPackageName
INFO: Getting package: com.whatsapp
Feb 06, 2012 3:52:34 PM com.marketplace.io.Fetcher getAppsByPackageName
INFO: Getting package: com.whatsapp
Feb 06, 2012 3:52:34 PM com.marketplace.io.Fetcher getAppsByPackageName
INFO: Getting package: com.whatsapp
Feb 06, 2012 3:52:34 PM com.marketplace.io.Fetcher getAppsByPackageName
INFO: Getting package: com.whatsapp
com.google.gson.JsonSyntaxException:
com.google.gson.stream.MalformedJsonException: invalid number or unquoted
string near <html xmlns="http://www.w
at com.google.gson.Streams.parse(Streams.java:51)
at com.google.gson.Gson.fromJson(Gson.java:514)
at com.google.gson.Gson.fromJson(Gson.java:458)
at com.marketplace.io.Sender.appExists(Sender.java:123)
at com.marketplace.io.Sender.addAppToCollection(Sender.java:282)
at com.marketplace.service.PackageThread.run(PackageThread.java:102)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
at java.util.concurrent.FutureTask.run(FutureTask.java:166)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:722)
Caused by: com.google.gson.stream.MalformedJsonException: invalid number or
unquoted string near <html xmlns="http://www.w
at com.google.gson.stream.JsonReader.syntaxError(JsonReader.java:1110)
at com.google.gson.stream.JsonReader.decodeLiteral(JsonReader.java:1100)
at com.google.gson.stream.JsonReader.peek(JsonReader.java:343)
at com.google.gson.Streams.parse(Streams.java:38)
... 11 more
Feb 06, 2012 3:52:35 PM com.marketplace.io.Fetcher getAppsByPackageName
INFO: Getting package: com.whatsapp
com.google.gson.JsonSyntaxException:
com.google.gson.stream.MalformedJsonException: invalid number or unquoted
string near <html xmlns="http://www.w
at com.google.gson.Streams.parse(Streams.java:51)
at com.google.gson.Gson.fromJson(Gson.java:514)
at com.google.gson.Gson.fromJson(Gson.java:458)
at com.marketplace.io.Sender.appExists(Sender.java:123)
at com.marketplace.io.Sender.addAppToCollection(Sender.java:282)
at com.marketplace.service.PackageThread.run(PackageThread.java:102)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
at java.util.concurrent.FutureTask.run(FutureTask.java:166)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:722)
Caused by: com.google.gson.stream.MalformedJsonException: invalid number or
unquoted string near <html xmlns="http://www.w
at com.google.gson.stream.JsonReader.syntaxError(JsonReader.java:1110)
at com.google.gson.stream.JsonReader.decodeLiteral(JsonReader.java:1100)
at com.google.gson.stream.JsonReader.peek(JsonReader.java:343)
at com.google.gson.Streams.parse(Streams.java:38)
... 11 more
Feb 06, 2012 3:52:35 PM com.marketplace.io.Fetcher getAppsByPackageName
INFO: Getting package: com.whatsapp
com.google.gson.JsonSyntaxException:
com.google.gson.stream.MalformedJsonException: invalid number or unquoted
string near <html xmlns="http://www.w
at com.google.gson.Streams.parse(Streams.java:51)
at com.google.gson.Gson.fromJson(Gson.java:514)
at com.google.gson.Gson.fromJson(Gson.java:458)
at com.marketplace.io.Sender.appExists(Sender.java:123)
at com.marketplace.io.Sender.addAppToCollection(Sender.java:282)
at com.marketplace.service.PackageThread.run(PackageThread.java:102)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
at java.util.concurrent.FutureTask.run(FutureTask.java:166)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:722)
Caused by: com.google.gson.stream.MalformedJsonException: invalid number or
unquoted string near <html xmlns="http://www.w
at com.google.gson.stream.JsonReader.syntaxError(JsonReader.java:1110)
at com.google.gson.stream.JsonReader.decodeLiteral(JsonReader.java:1100)
at com.google.gson.stream.JsonReader.peek(JsonReader.java:343)
at com.google.gson.Streams.parse(Streams.java:38)
... 11 more
java.util.concurrent.ExecutionException: java.lang.NullPointerException
at java.util.concurrent.FutureTask$Sync.innerGet(FutureTask.java:252)
at java.util.concurrent.FutureTask.get(FutureTask.java:111)
at com.marketplace.Main.execute(Main.java:283)
at com.marketplace.Main.resolveArgs(Main.java:327)
at com.marketplace.Main.main(Main.java:338)
Caused by: java.lang.NullPointerException
at com.marketplace.io.Sender.addAppToCollection(Sender.java:285)
at com.marketplace.service.PackageThread.run(PackageThread.java:102)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
at java.util.concurrent.FutureTask.run(FutureTask.java:166)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:722)
Feb 06, 2012 3:52:35 PM com.marketplace.io.Fetcher getAppsByPackageName
INFO: Getting package: com.whatsapp
com.google.gson.JsonSyntaxException:
com.google.gson.stream.MalformedJsonException: invalid number or unquoted
string near <html xmlns="http://www.w
at com.google.gson.Streams.parse(Streams.java:51)
at com.google.gson.Gson.fromJson(Gson.java:514)
at com.google.gson.Gson.fromJson(Gson.java:458)
at com.marketplace.io.Sender.appExists(Sender.java:123)
at com.marketplace.io.Sender.addAppToCollection(Sender.java:282)
at com.marketplace.service.PackageThread.run(PackageThread.java:102)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
at java.util.concurrent.FutureTask.run(FutureTask.java:166)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:722)
Caused by: com.google.gson.stream.MalformedJsonException: invalid number or
unquoted string near <html xmlns="http://www.w
at com.google.gson.stream.JsonReader.syntaxError(JsonReader.java:1110)
at com.google.gson.stream.JsonReader.decodeLiteral(JsonReader.java:1100)
at com.google.gson.stream.JsonReader.peek(JsonReader.java:343)
at com.google.gson.Streams.parse(Streams.java:38)
... 11 more
com.google.gson.JsonSyntaxException:
com.google.gson.stream.MalformedJsonException: invalid number or unquoted
string near <html xmlns="http://www.w
at com.google.gson.Streams.parse(Streams.java:51)
at com.google.gson.Gson.fromJson(Gson.java:514)
at com.google.gson.Gson.fromJson(Gson.java:458)
at com.marketplace.io.Sender.appExists(Sender.java:123)
at com.marketplace.io.Sender.addAppToCollection(Sender.java:282)
at com.marketplace.service.PackageThread.run(PackageThread.java:102)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
at java.util.concurrent.FutureTask.run(FutureTask.java:166)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:722)
Caused by: com.google.gson.stream.MalformedJsonException: invalid number or
unquoted string near <html xmlns="http://www.w
at com.google.gson.stream.JsonReader.syntaxError(JsonReader.java:1110)
at com.google.gson.stream.JsonReader.decodeLiteral(JsonReader.java:1100)
at com.google.gson.stream.JsonReader.peek(JsonReader.java:343)
at com.google.gson.Streams.parse(Streams.java:38)
... 11 more
com.google.gson.JsonSyntaxException:
com.google.gson.stream.MalformedJsonException: invalid number or unquoted
string near <html xmlns="http://www.w
at com.google.gson.Streams.parse(Streams.java:51)
at com.google.gson.Gson.fromJson(Gson.java:514)
at com.google.gson.Gson.fromJson(Gson.java:458)
at com.marketplace.io.Sender.appExists(Sender.java:123)
at com.marketplace.io.Sender.addAppToCollection(Sender.java:282)
at com.marketplace.service.PackageThread.run(PackageThread.java:102)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
at java.util.concurrent.FutureTask.run(FutureTask.java:166)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:722)
Caused by: com.google.gson.stream.MalformedJsonException: invalid number or
unquoted string near <html xmlns="http://www.w
at com.google.gson.stream.JsonReader.syntaxError(JsonReader.java:1110)
at com.google.gson.stream.JsonReader.decodeLiteral(JsonReader.java:1100)
at com.google.gson.stream.JsonReader.peek(JsonReader.java:343)
at com.google.gson.Streams.parse(Streams.java:38)
... 11 more
com.google.gson.JsonSyntaxException:
com.google.gson.stream.MalformedJsonException: invalid number or unquoted
string near <html xmlns="http://www.w
at com.google.gson.Streams.parse(Streams.java:51)
at com.google.gson.Gson.fromJson(Gson.java:514)
at com.google.gson.Gson.fromJson(Gson.java:458)
at com.marketplace.io.Sender.appExists(Sender.java:123)
at com.marketplace.io.Sender.addAppToCollection(Sender.java:282)
at com.marketplace.service.PackageThread.run(PackageThread.java:102)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
at java.util.concurrent.FutureTask.run(FutureTask.java:166)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:722)
Caused by: com.google.gson.stream.MalformedJsonException: invalid number or
unquoted string near <html xmlns="http://www.w
at com.google.gson.stream.JsonReader.syntaxError(JsonReader.java:1110)
at com.google.gson.stream.JsonReader.decodeLiteral(JsonReader.java:1100)
at com.google.gson.stream.JsonReader.peek(JsonReader.java:343)
at com.google.gson.Streams.parse(Streams.java:38)
... 11 more
com.google.gson.JsonSyntaxException:
com.google.gson.stream.MalformedJsonException: invalid number or unquoted
string near <html xmlns="http://www.w
at com.google.gson.Streams.parse(Streams.java:51)
at com.google.gson.Gson.fromJson(Gson.java:514)
at com.google.gson.Gson.fromJson(Gson.java:458)
at com.marketplace.io.Sender.appExists(Sender.java:123)
at com.marketplace.io.Sender.addAppToCollection(Sender.java:282)
at com.marketplace.service.PackageThread.run(PackageThread.java:102)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
at java.util.concurrent.FutureTask.run(FutureTask.java:166)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:722)
Caused by: com.google.gson.stream.MalformedJsonException: invalid number or
unquoted string near <html xmlns="http://www.w
at com.google.gson.stream.JsonReader.syntaxError(JsonReader.java:1110)
at com.google.gson.stream.JsonReader.decodeLiteral(JsonReader.java:1100)
at com.google.gson.stream.JsonReader.peek(JsonReader.java:343)
at com.google.gson.Streams.parse(Streams.java:38)
... 11 more
com.google.gson.JsonSyntaxException:
com.google.gson.stream.MalformedJsonException: invalid number or unquoted
string near <html xmlns="http://www.w
at com.google.gson.Streams.parse(Streams.java:51)
at com.google.gson.Gson.fromJson(Gson.java:514)
at com.google.gson.Gson.fromJson(Gson.java:458)
at com.marketplace.io.Sender.appExists(Sender.java:123)
at com.marketplace.io.Sender.addAppToCollection(Sender.java:282)
at com.marketplace.service.PackageThread.run(PackageThread.java:102)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
at java.util.concurrent.FutureTask.run(FutureTask.java:166)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:722)
Caused by: com.google.gson.stream.MalformedJsonException: invalid number or
unquoted string near <html xmlns="http://www.w
at com.google.gson.stream.JsonReader.syntaxError(JsonReader.java:1110)
at com.google.gson.stream.JsonReader.decodeLiteral(JsonReader.java:1100)
at com.google.gson.stream.JsonReader.peek(JsonReader.java:343)
at com.google.gson.Streams.parse(Streams.java:38)
... 11 more
com.google.gson.JsonSyntaxException:
com.google.gson.stream.MalformedJsonException: invalid number or unquoted
string near <html xmlns="http://www.w
at com.google.gson.Streams.parse(Streams.java:51)
at com.google.gson.Gson.fromJson(Gson.java:514)
at com.google.gson.Gson.fromJson(Gson.java:458)
at com.marketplace.io.Sender.appExists(Sender.java:123)
at com.marketplace.io.Sender.addAppToCollection(Sender.java:282)
at com.marketplace.service.PackageThread.run(PackageThread.java:102)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
at java.util.concurrent.FutureTask.run(FutureTask.java:166)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:722)
Caused by: com.google.gson.stream.MalformedJsonException: invalid number or
unquoted string near <html xmlns="http://www.w
at com.google.gson.stream.JsonReader.syntaxError(JsonReader.java:1110)
at com.google.gson.stream.JsonReader.decodeLiteral(JsonReader.java:1100)
at com.google.gson.stream.JsonReader.peek(JsonReader.java:343)
at com.google.gson.Streams.parse(Streams.java:38)
... 11 more
com.google.gson.JsonSyntaxException:
com.google.gson.stream.MalformedJsonException: invalid number or unquoted
string near <html xmlns="http://www.w
at com.google.gson.Streams.parse(Streams.java:51)
at com.google.gson.Gson.fromJson(Gson.java:514)
at com.google.gson.Gson.fromJson(Gson.java:458)
at com.marketplace.io.Sender.appExists(Sender.java:123)
at com.marketplace.io.Sender.addAppToCollection(Sender.java:282)
at com.marketplace.service.PackageThread.run(PackageThread.java:102)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
at java.util.concurrent.FutureTask.run(FutureTask.java:166)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:722)
Caused by: com.google.gson.stream.MalformedJsonException: invalid number or
unquoted string near <html xmlns="http://www.w
at com.google.gson.stream.JsonReader.syntaxError(JsonReader.java:1110)
at com.google.gson.stream.JsonReader.decodeLiteral(JsonReader.java:1100)
at com.google.gson.stream.JsonReader.peek(JsonReader.java:343)
at com.google.gson.Streams.parse(Streams.java:38)
... 11 more
Original comment by masterbo...@gmail.com
on 6 Feb 2012 at 9:57
Original issue reported on code.google.com by
masterbo...@gmail.com
on 6 Feb 2012 at 9:09