Closed chobeat closed 7 years ago
holdenk
commented
7 years ago Their might be a missing step in the build instructions. If you run package before test does it work?
If not the jar search logic could need some improving (it's based on what we did in sparklingpandas awhile back).
Thanks for opening the issue :)
chobeat
commented
7 years ago Actually it's already like that in the provided build_and_package.sh or am I wrong?
juanrh
commented
7 years ago I have the same problem here. All the commands in build_and_package.sh work for me except for sbt test and nosetests --logging-level=INFO --detailed-errors --verbosity=2 --with-coverage --cover-html-dir=./htmlcov --cover-package=sparklingml --with-doctest --doctest-options=+ELLIPSIS the following commands are successful
./build/sbt scalastyle
pep8 --ignore=E402 sparklingml/
./build/sbt clean compile packageAnd sbt test fails in StrLenPlusKPythonSuite and SpacyTokenizePythonSuite
export SPARK_HOME= path to spark-2.2.0-bin-hadoop2.7
./build/sbt clean compile package test
...
[info] StrLenPlusKPythonSuite:
Could not resolve resource file No module named jar
Traceback (most recent call last):
File "/usr/lib/python2.7/runpy.py", line 174, in _run_module_as_main
"__main__", fname, loader, pkg_name)
File "/usr/lib/python2.7/runpy.py", line 72, in _run_code
exec code in run_globals
File "/home/local/ANT/hortala/git/github/sparklingml/sparklingml/startup.py", line 88, in <module>
auto_convert=True)
File "/usr/local/lib/python2.7/dist-packages/py4j/java_gateway.py", line 1290, in __init__
self.start_callback_server(self.callback_server_parameters)
File "/usr/local/lib/python2.7/dist-packages/py4j/java_gateway.py", line 1344, in start_callback_server
self._callback_server.start()
File "/usr/local/lib/python2.7/dist-packages/py4j/java_gateway.py", line 1595, in start
raise Py4JNetworkError(msg, e)
py4j.protocol.Py4JNetworkError: An error occurred while trying to start the callback server
Exception in thread "python-udf-registrationProvider-thread" java.lang.Exception: Exit code 1
at com.sparklingpandas.sparklingml.util.python.PythonRegistration$$anon$2.run(Initialize.scala:178)
at java.lang.Thread.run(Thread.java:748)
[info] - verify that the transformer runs *** FAILED ***
[info] java.util.concurrent.TimeoutException: Futures timed out after [10 seconds]
[info] at scala.concurrent.impl.Promise$DefaultPromise.ready(Promise.scala:219)
[info] at scala.concurrent.impl.Promise$DefaultPromise.result(Promise.scala:223)
[info] at scala.concurrent.Await$$anonfun$result$1.apply(package.scala:190)
[info] at scala.concurrent.BlockContext$DefaultBlockContext$.blockOn(BlockContext.scala:53)
[info] at scala.concurrent.Await$.result(package.scala:190)
[info] at com.sparklingpandas.sparklingml.util.python.PythonTransformer$class.constructUDF(PythonTransformer.scala:25)
[info] at com.sparklingpandas.sparklingml.feature.StrLenPlusKPython.constructUDF(BasicPython.scala:10)
[info] at com.sparklingpandas.sparklingml.util.python.PythonTransformer$class.transform(PythonTransformer.scala:38)
[info] at com.sparklingpandas.sparklingml.feature.StrLenPlusKPython.transform(BasicPython.scala:10)
[info] at com.sparklingpandas.sparklingml.feature.StrLenPlusKPythonSuite$$anonfun$1.apply(BasicPython.scala:25)
[info] ...
2017-08-21 09:30:59,024 [pool-1-thread-1] WARN SparkContext - Using an existing SparkContext; some configuration may not take effect.
[info] SpacyTokenizePythonSuite:
[info] - verify spacy tokenization works *** FAILED ***
[info] java.util.concurrent.TimeoutException: Futures timed out after [10 seconds]
[info] at scala.concurrent.impl.Promise$DefaultPromise.ready(Promise.scala:219)
[info] at scala.concurrent.impl.Promise$DefaultPromise.result(Promise.scala:223)
[info] at scala.concurrent.Await$$anonfun$result$1.apply(package.scala:190)
[info] at scala.concurrent.BlockContext$DefaultBlockContext$.blockOn(BlockContext.scala:53)
[info] at scala.concurrent.Await$.result(package.scala:190)
[info] at com.sparklingpandas.sparklingml.util.python.PythonTransformer$class.constructUDF(PythonTransformer.scala:25)
[info] at com.sparklingpandas.sparklingml.feature.SpacyTokenizePython.constructUDF(BasicPython.scala:39)
[info] at com.sparklingpandas.sparklingml.util.python.PythonTransformer$class.transform(PythonTransformer.scala:38)
[info] at com.sparklingpandas.sparklingml.feature.SpacyTokenizePython.transform(BasicPython.scala:39)
[info] at com.sparklingpandas.sparklingml.feature.SpacyTokenizePythonSuite$$anonfun$2.apply(BasicPython.scala:49)
[info] ...
[info] SharedParamsCodeGenTest:
[info] - verify the generated code is up to date
[info] ScalaTest
[info] Run completed in 32 seconds, 499 milliseconds.
[info] Total number of tests run: 83
[info] Suites: completed 47, aborted 0
[info] Tests: succeeded 81, failed 2, canceled 0, ignored 0, pending 0
[info] *** 2 TESTS FAILED ***
[error] Failed: Total 83, Failed 2, Errors 0, Passed 81
[error] Failed tests:
[error] com.sparklingpandas.sparklingml.feature.SpacyTokenizePythonSuite
[error] com.sparklingpandas.sparklingml.feature.StrLenPlusKPythonSuite
[error] (test:test) sbt.TestsFailedException: Tests unsuccessful
[error] Total time: 39 s, completed Aug 21, 2017 9:31:09 AMspacy seems to be correctly installed
hortala@ufc3fdb42a6ce5882832c:~/git/github/sparklingml$ python
Python 2.7.12 (default, Nov 19 2016, 06:48:10)
[GCC 5.4.0 20160609] on linux2
Type "help", "copyright", "credits" or "license" for more information.
>>> import spacy
>>> dir(spacy)
['__builtins__', '__doc__', '__file__', '__name__', '__package__', '__path__', '__version__', '_lang', '_languages', 'about', 'attrs', 'bn', 'cfile', 'cli', 'compat', 'de', 'deprecated', 'en', 'es', 'explain', 'fi', 'fr', 'glossary', 'gold', 'he', 'hu', 'info', 'it', 'ja', 'language', 'language_data', 'lemmatizer', 'lexeme', 'load', 'matcher', 'morphology', 'nb', 'nl', 'orth', 'parts_of_speech', 'pipeline', 'pt', 'resolve_model_name', 'scorer', 'serialize', 'strings', 'sv', 'symbols', 'syntax', 'tagger', 'tokenizer', 'tokens', 'train', 'unicode_literals', 'util', 'vocab', 'zh']It looks like val pythonThread is not starting correctly in PythonRegistration. Also in the definition of gatewayServer I see
pythonPath += Seq(sparkHome,
"python", "lib", "py4j-0.10.6-src.zip").mkString(File.separator)but I have py4j-0.10.4-src.zip in python/lib/ form my Spark installation. I downloaded py4j-0.10.6.zip and copied it to that path as py4j-0.10.6-src.zip but it fails in the same way. Also SparkContext.jarOfObject(this) is returning None when I debug this. Might this be related to #12?
holdenk
commented
7 years ago @chobeat : it is , but I was hoping maybe it was built manually instead.
The dynamnic call back should only matter if the old Python process is hanging around (and we should see a clearer error message).
I think the root issue is finding the jars correctly. Can y'all run find ./ for me in the root of the directory so I can see what path is being generated in your builds?
holdenk
commented
7 years ago Ok so the dynamic callback server issue should be fixed.
holdenk
commented
7 years ago But I'd still like to verify the JAR issue (e.g. https://github.com/sparklingpandas/sparklingml/issues/27 )
juanrh
commented
7 years ago After a successful ./build/sbt clean compile package I get
$ find ./
./
./LICENSE
./CODE_OF_CONDUCT.md
./requirements.txt
./build.sbt
./sparklingml
./sparklingml/python_pipelines.py
./sparklingml/__init__.py
./sparklingml/startup.py
./sparklingml/transformation_functions.pyc
./sparklingml/__init__.pyc
./sparklingml/python_pipelines.pyc
./sparklingml/transformation_functions.py
./sparklingml/startup.pyc
./target
./target/resolution-cache
./target/resolution-cache/reports
./target/resolution-cache/reports/com.sparklingpandas-sparklingml_2.11-pom.xml
./target/resolution-cache/reports/com.sparklingpandas-sparklingml_2.11-test.xml
./target/resolution-cache/reports/com.sparklingpandas-sparklingml_2.11-test-internal.xml
./target/resolution-cache/reports/com.sparklingpandas-sparklingml_2.11-compile-internal.xml
./target/resolution-cache/reports/com.sparklingpandas-sparklingml_2.11-runtime-internal.xml
./target/resolution-cache/reports/com.sparklingpandas-sparklingml_2.11-runtime.xml
./target/resolution-cache/reports/com.sparklingpandas-sparklingml_2.11-sources.xml
./target/resolution-cache/reports/com.sparklingpandas-sparklingml_2.11-scoveragePlugin.xml
./target/resolution-cache/reports/com.sparklingpandas-sparklingml_2.11-scala-tool.xml
./target/resolution-cache/reports/com.sparklingpandas-sparklingml_2.11-provided.xml
./target/resolution-cache/reports/ivy-report.css
./target/resolution-cache/reports/ivy-report.xsl
./target/resolution-cache/reports/com.sparklingpandas-sparklingml_2.11-compile.xml
./target/resolution-cache/reports/com.sparklingpandas-sparklingml_2.11-plugin.xml
./target/resolution-cache/reports/com.sparklingpandas-sparklingml_2.11-docs.xml
./target/resolution-cache/reports/com.sparklingpandas-sparklingml_2.11-optional.xml
./target/resolution-cache/com.sparklingpandas
./target/resolution-cache/com.sparklingpandas/sparklingml_2.11
./target/resolution-cache/com.sparklingpandas/sparklingml_2.11/0.0.1-SNAPSHOT
./target/resolution-cache/com.sparklingpandas/sparklingml_2.11/0.0.1-SNAPSHOT/resolved.xml.xml
./target/resolution-cache/com.sparklingpandas/sparklingml_2.11/0.0.1-SNAPSHOT/resolved.xml.properties
./target/.history
./target/scala-2.11
./target/scala-2.11/scoverage-data
./target/scala-2.11/scoverage-data/scoverage.coverage.xml
./target/scala-2.11/classes
./target/scala-2.11/classes/com
./target/scala-2.11/classes/com/sparklingpandas
./target/scala-2.11/classes/com/sparklingpandas/sparklingml
./target/scala-2.11/classes/com/sparklingpandas/sparklingml/CodeGenerator.class
./target/scala-2.11/classes/com/sparklingpandas/sparklingml/util
./target/scala-2.11/classes/com/sparklingpandas/sparklingml/util/python
./target/scala-2.11/classes/com/sparklingpandas/sparklingml/util/python/PythonRegistration$$anonfun$6.class
./target/scala-2.11/classes/com/sparklingpandas/sparklingml/util/python/PythonRegistration$$anonfun$3.class
./target/scala-2.11/classes/com/sparklingpandas/sparklingml/util/python/PythonRegistration$$anon$1.class
./target/scala-2.11/classes/com/sparklingpandas/sparklingml/util/python/RedirectThread$$anonfun$run$1$$anonfun$apply$mcV$sp$1$$anonfun$apply$mcV$sp$2.class
./target/scala-2.11/classes/com/sparklingpandas/sparklingml/util/python/PythonRegistration$$anonfun$mergePythonPaths$1$1.class
./target/scala-2.11/classes/com/sparklingpandas/sparklingml/util/python/RedirectThread$.class
./target/scala-2.11/classes/com/sparklingpandas/sparklingml/util/python/PythonRegistration$$anonfun$4.class
./target/scala-2.11/classes/com/sparklingpandas/sparklingml/util/python/PythonTransformer$$anonfun$constructUDF$1.class
./target/scala-2.11/classes/com/sparklingpandas/sparklingml/util/python/RedirectThread$$anonfun$run$1$$anonfun$apply$mcV$sp$5.class
./target/scala-2.11/classes/com/sparklingpandas/sparklingml/util/python/RedirectThread$$anonfun$run$1.class
./target/scala-2.11/classes/com/sparklingpandas/sparklingml/util/python/PythonRegistration.class
./target/scala-2.11/classes/com/sparklingpandas/sparklingml/util/python/PythonTransformer$$anonfun$constructUDF$2.class
./target/scala-2.11/classes/com/sparklingpandas/sparklingml/util/python/PythonRegistration$.class
./target/scala-2.11/classes/com/sparklingpandas/sparklingml/util/python/PythonRegistration$$anonfun$sparkPythonPath$1$1.class
./target/scala-2.11/classes/com/sparklingpandas/sparklingml/util/python/RedirectThread$$anonfun$run$1$$anonfun$apply$mcV$sp$1.class
./target/scala-2.11/classes/com/sparklingpandas/sparklingml/util/python/PythonRegistration$$anonfun$2.class
./target/scala-2.11/classes/com/sparklingpandas/sparklingml/util/python/PythonRegistration$$anon$2.class
./target/scala-2.11/classes/com/sparklingpandas/sparklingml/util/python/RedirectThread$$anonfun$run$1$$anonfun$apply$mcV$sp$1$$anonfun$apply$mcV$sp$4.class
./target/scala-2.11/classes/com/sparklingpandas/sparklingml/util/python/PythonRegistration$$anonfun$1.class
./target/scala-2.11/classes/com/sparklingpandas/sparklingml/util/python/PythonTransformer$class.class
./target/scala-2.11/classes/com/sparklingpandas/sparklingml/util/python/RedirectThread.class
./target/scala-2.11/classes/com/sparklingpandas/sparklingml/util/python/PythonTransformer.class
./target/scala-2.11/classes/com/sparklingpandas/sparklingml/util/python/PythonRegistration$$anonfun$5.class
./target/scala-2.11/classes/com/sparklingpandas/sparklingml/util/python/PythonRegisterationProvider.class
./target/scala-2.11/classes/com/sparklingpandas/sparklingml/util/python/RedirectThread$$anonfun$run$1$$anonfun$apply$mcV$sp$1$$anonfun$apply$mcV$sp$3.class
./target/scala-2.11/classes/com/sparklingpandas/sparklingml/feature
./target/scala-2.11/classes/com/sparklingpandas/sparklingml/feature/LuceneAnalyzerGenerators$$anonfun$13$$anonfun$apply$1.class
./target/scala-2.11/classes/com/sparklingpandas/sparklingml/feature/SoraniAnalyzerLucene.class
./target/scala-2.11/classes/com/sparklingpandas/sparklingml/feature/CzechAnalyzerLucene.class
./target/scala-2.11/classes/com/sparklingpandas/sparklingml/feature/StandardAnalyzerLucene.class
./target/scala-2.11/classes/com/sparklingpandas/sparklingml/feature/JapaneseAnalyzerLucene.class
./target/scala-2.11/classes/com/sparklingpandas/sparklingml/feature/WhitespaceAnalyzerLucene.class
./target/scala-2.11/classes/com/sparklingpandas/sparklingml/feature/LuceneAnalyzerGenerators.class
./target/scala-2.11/classes/com/sparklingpandas/sparklingml/feature/LuceneHelpers.class
./target/scala-2.11/classes/com/sparklingpandas/sparklingml/feature/UAX29URLEmailAnalyzerLucene.class
./target/scala-2.11/classes/com/sparklingpandas/sparklingml/feature/PersianAnalyzerLucene.class
./target/scala-2.11/classes/com/sparklingpandas/sparklingml/feature/LuceneAnalyzerGenerators$$anonfun$10.class
./target/scala-2.11/classes/com/sparklingpandas/sparklingml/feature/FrenchAnalyzerLucene.class
./target/scala-2.11/classes/com/sparklingpandas/sparklingml/feature/LuceneAnalyzerGenerators$$anonfun$3.class
./target/scala-2.11/classes/com/sparklingpandas/sparklingml/feature/LuceneAnalyzerGenerators$$anonfun$8.class
./target/scala-2.11/classes/com/sparklingpandas/sparklingml/feature/HindiAnalyzerLucene.class
./target/scala-2.11/classes/com/sparklingpandas/sparklingml/feature/StopAnalyzerLucene.class
./target/scala-2.11/classes/com/sparklingpandas/sparklingml/feature/LuceneAnalyzerGenerators$$anonfun$12.class
./target/scala-2.11/classes/com/sparklingpandas/sparklingml/feature/SpanishAnalyzerLucene.class
./target/scala-2.11/classes/com/sparklingpandas/sparklingml/feature/GermanAnalyzerLucene.class
./target/scala-2.11/classes/com/sparklingpandas/sparklingml/feature/ArmenianAnalyzerLucene.class
./target/scala-2.11/classes/com/sparklingpandas/sparklingml/feature/SpacyTokenizePython.class
./target/scala-2.11/classes/com/sparklingpandas/sparklingml/feature/IndonesianAnalyzerLucene.class
./target/scala-2.11/classes/com/sparklingpandas/sparklingml/feature/LuceneTransformer$$anonfun$validateInputType$1.class
./target/scala-2.11/classes/com/sparklingpandas/sparklingml/feature/LuceneTransformer$class.class
./target/scala-2.11/classes/com/sparklingpandas/sparklingml/feature/KeywordAnalyzerLucene.class
./target/scala-2.11/classes/com/sparklingpandas/sparklingml/feature/RomanianAnalyzerLucene.class
./target/scala-2.11/classes/com/sparklingpandas/sparklingml/feature/LuceneAnalyzerGenerators$$anonfun$main$1.class
./target/scala-2.11/classes/com/sparklingpandas/sparklingml/feature/LuceneTransformer$$anonfun$createTransformFunc$1.class
./target/scala-2.11/classes/com/sparklingpandas/sparklingml/feature/CJKAnalyzerLucene.class
./target/scala-2.11/classes/com/sparklingpandas/sparklingml/feature/ArabicAnalyzerLucene.class
./target/scala-2.11/classes/com/sparklingpandas/sparklingml/feature/LuceneAnalyzerGenerators$$anonfun$11.class
./target/scala-2.11/classes/com/sparklingpandas/sparklingml/feature/BulgarianAnalyzerLucene.class
./target/scala-2.11/classes/com/sparklingpandas/sparklingml/feature/BasqueAnalyzerLucene.class
./target/scala-2.11/classes/com/sparklingpandas/sparklingml/feature/LuceneAnalyzerGenerators$$anonfun$14.class
./target/scala-2.11/classes/com/sparklingpandas/sparklingml/feature/CatalanAnalyzerLucene.class
./target/scala-2.11/classes/com/sparklingpandas/sparklingml/feature/RussianAnalyzerLucene.class
./target/scala-2.11/classes/com/sparklingpandas/sparklingml/feature/LatvianAnalyzerLucene.class
./target/scala-2.11/classes/com/sparklingpandas/sparklingml/feature/FinnishAnalyzerLucene.class
./target/scala-2.11/classes/com/sparklingpandas/sparklingml/feature/StrLenPlusKPython.class
./target/scala-2.11/classes/com/sparklingpandas/sparklingml/feature/LuceneAnalyzerGenerators$$anonfun$generate$1.class
./target/scala-2.11/classes/com/sparklingpandas/sparklingml/feature/NorwegianAnalyzerLucene.class
./target/scala-2.11/classes/com/sparklingpandas/sparklingml/feature/SwedishAnalyzerLucene.class
./target/scala-2.11/classes/com/sparklingpandas/sparklingml/feature/LuceneAnalyzerGenerators$$anonfun$9.class
./target/scala-2.11/classes/com/sparklingpandas/sparklingml/feature/LuceneAnalyzerGenerators$$anonfun$13.class
./target/scala-2.11/classes/com/sparklingpandas/sparklingml/feature/ThaiAnalyzerLucene.class
./target/scala-2.11/classes/com/sparklingpandas/sparklingml/feature/TurkishAnalyzerLucene.class
./target/scala-2.11/classes/com/sparklingpandas/sparklingml/feature/LuceneAnalyzerGenerators$.class
./target/scala-2.11/classes/com/sparklingpandas/sparklingml/feature/PortugueseAnalyzerLucene.class
./target/scala-2.11/classes/com/sparklingpandas/sparklingml/feature/LuceneAnalyzerGenerators$$anonfun$2.class
./target/scala-2.11/classes/com/sparklingpandas/sparklingml/feature/ClassicAnalyzerLucene.class
./target/scala-2.11/classes/com/sparklingpandas/sparklingml/feature/LithuanianAnalyzerLucene.class
./target/scala-2.11/classes/com/sparklingpandas/sparklingml/feature/LuceneAnalyzerGenerators$$anonfun$4.class
./target/scala-2.11/classes/com/sparklingpandas/sparklingml/feature/ShingleAnalyzerWrapperLucene.class
./target/scala-2.11/classes/com/sparklingpandas/sparklingml/feature/LuceneHelpers$.class
./target/scala-2.11/classes/com/sparklingpandas/sparklingml/feature/HungarianAnalyzerLucene.class
./target/scala-2.11/classes/com/sparklingpandas/sparklingml/feature/IrishAnalyzerLucene.class
./target/scala-2.11/classes/com/sparklingpandas/sparklingml/feature/SimpleAnalyzerLucene.class
./target/scala-2.11/classes/com/sparklingpandas/sparklingml/feature/LuceneAnalyzerGenerators$$anonfun$6.class
./target/scala-2.11/classes/com/sparklingpandas/sparklingml/feature/UnicodeWhitespaceAnalyzerLucene.class
./target/scala-2.11/classes/com/sparklingpandas/sparklingml/feature/LuceneAnalyzerGenerators$$anonfun$1.class
./target/scala-2.11/classes/com/sparklingpandas/sparklingml/feature/ItalianAnalyzerLucene.class
./target/scala-2.11/classes/com/sparklingpandas/sparklingml/feature/GalicianAnalyzerLucene.class
./target/scala-2.11/classes/com/sparklingpandas/sparklingml/feature/BrazilianAnalyzerLucene.class
./target/scala-2.11/classes/com/sparklingpandas/sparklingml/feature/LuceneAnalyzerGenerators$$anonfun$7.class
./target/scala-2.11/classes/com/sparklingpandas/sparklingml/feature/EnglishAnalyzerLucene.class
./target/scala-2.11/classes/com/sparklingpandas/sparklingml/feature/LuceneTransformer.class
./target/scala-2.11/classes/com/sparklingpandas/sparklingml/feature/GreekAnalyzerLucene.class
./target/scala-2.11/classes/com/sparklingpandas/sparklingml/feature/DutchAnalyzerLucene.class
./target/scala-2.11/classes/com/sparklingpandas/sparklingml/feature/DanishAnalyzerLucene.class
./target/scala-2.11/classes/com/sparklingpandas/sparklingml/feature/LuceneAnalyzerGenerators$$anonfun$5.class
./target/scala-2.11/classes/com/sparklingpandas/sparklingml/param
./target/scala-2.11/classes/com/sparklingpandas/sparklingml/param/HasOutputCol.class
./target/scala-2.11/classes/com/sparklingpandas/sparklingml/param/SharedParamsCodeGen$$anonfun$2.class
./target/scala-2.11/classes/com/sparklingpandas/sparklingml/param/HasLabelCol$class.class
./target/scala-2.11/classes/com/sparklingpandas/sparklingml/param/ParamDesc.class
./target/scala-2.11/classes/com/sparklingpandas/sparklingml/param/HasFeaturesCol$class.class
./target/scala-2.11/classes/com/sparklingpandas/sparklingml/param/HasStopwords$class.class
./target/scala-2.11/classes/com/sparklingpandas/sparklingml/param/HasInputCols$class.class
./target/scala-2.11/classes/com/sparklingpandas/sparklingml/param/SharedParamsCodeGen$.class
./target/scala-2.11/classes/com/sparklingpandas/sparklingml/param/ParamDesc$.class
./target/scala-2.11/classes/com/sparklingpandas/sparklingml/param/SharedParamsCodeGen$$anonfun$1.class
./target/scala-2.11/classes/com/sparklingpandas/sparklingml/param/SharedParamsCodeGen$$anonfun$4.class
./target/scala-2.11/classes/com/sparklingpandas/sparklingml/param/HasLabelCol.class
./target/scala-2.11/classes/com/sparklingpandas/sparklingml/param/HasStopwords.class
./target/scala-2.11/classes/com/sparklingpandas/sparklingml/param/ParamDesc$$anonfun$6.class
./target/scala-2.11/classes/com/sparklingpandas/sparklingml/param/HasInputCols.class
./target/scala-2.11/classes/com/sparklingpandas/sparklingml/param/HasInputCol$class.class
./target/scala-2.11/classes/com/sparklingpandas/sparklingml/param/SharedParamsCodeGen.class
./target/scala-2.11/classes/com/sparklingpandas/sparklingml/param/SharedParamsCodeGen$$anonfun$5.class
./target/scala-2.11/classes/com/sparklingpandas/sparklingml/param/HasOutputCol$class.class
./target/scala-2.11/classes/com/sparklingpandas/sparklingml/param/HasInputCol.class
./target/scala-2.11/classes/com/sparklingpandas/sparklingml/param/HasStopwordCase$class.class
./target/scala-2.11/classes/com/sparklingpandas/sparklingml/param/HasFeaturesCol.class
./target/scala-2.11/classes/com/sparklingpandas/sparklingml/param/HasStopwordCase.class
./target/scala-2.11/classes/com/sparklingpandas/sparklingml/param/SharedParamsCodeGen$$anonfun$3.class
./target/scala-2.11/sparklingml_2.11-0.0.1-SNAPSHOT.jar
./target/streams
./target/streams/compile
./target/streams/compile/copyResources
./target/streams/compile/copyResources/$global
./target/streams/compile/copyResources/$global/streams
./target/streams/compile/copyResources/$global/streams/out
./target/streams/compile/copyResources/$global/streams/copy-resources
./target/streams/compile/compileIncremental
./target/streams/compile/compileIncremental/$global
./target/streams/compile/compileIncremental/$global/streams
./target/streams/compile/compileIncremental/$global/streams/out
./target/streams/compile/compileIncremental/$global/streams/export
./target/streams/compile/managedClasspath
./target/streams/compile/managedClasspath/$global
./target/streams/compile/managedClasspath/$global/streams
./target/streams/compile/managedClasspath/$global/streams/export
./target/streams/compile/externalDependencyClasspath
./target/streams/compile/externalDependencyClasspath/$global
./target/streams/compile/externalDependencyClasspath/$global/streams
./target/streams/compile/externalDependencyClasspath/$global/streams/export
./target/streams/compile/unmanagedJars
./target/streams/compile/unmanagedJars/$global
./target/streams/compile/unmanagedJars/$global/streams
./target/streams/compile/unmanagedJars/$global/streams/export
./target/streams/compile/incCompileSetup
./target/streams/compile/incCompileSetup/$global
./target/streams/compile/incCompileSetup/$global/streams
./target/streams/compile/incCompileSetup/$global/streams/inc_compile_2.11
./target/streams/compile/internalDependencyClasspath
./target/streams/compile/internalDependencyClasspath/$global
./target/streams/compile/internalDependencyClasspath/$global/streams
./target/streams/compile/internalDependencyClasspath/$global/streams/export
./target/streams/compile/mainClass
./target/streams/compile/mainClass/$global
./target/streams/compile/mainClass/$global/streams
./target/streams/compile/mainClass/$global/streams/out
./target/streams/compile/unmanagedClasspath
./target/streams/compile/unmanagedClasspath/$global
./target/streams/compile/unmanagedClasspath/$global/streams
./target/streams/compile/unmanagedClasspath/$global/streams/export
./target/streams/compile/compile
./target/streams/compile/compile/$global
./target/streams/compile/compile/$global/streams
./target/streams/compile/compile/$global/streams/out
./target/streams/compile/packageBin
./target/streams/compile/packageBin/$global
./target/streams/compile/packageBin/$global/streams
./target/streams/compile/packageBin/$global/streams/out
./target/streams/compile/packageBin/$global/streams/inputs
./target/streams/compile/packageBin/$global/streams/output
./target/streams/compile/$global
./target/streams/compile/$global/$global
./target/streams/compile/$global/$global/discoveredMainClasses
./target/streams/compile/$global/$global/discoveredMainClasses/data
./target/streams/compile/dependencyClasspath
./target/streams/compile/dependencyClasspath/$global
./target/streams/compile/dependencyClasspath/$global/streams
./target/streams/compile/dependencyClasspath/$global/streams/export
./target/streams/$global
./target/streams/$global/ivyConfiguration
./target/streams/$global/ivyConfiguration/$global
./target/streams/$global/ivyConfiguration/$global/streams
./target/streams/$global/ivyConfiguration/$global/streams/out
./target/streams/$global/ivySbt
./target/streams/$global/ivySbt/$global
./target/streams/$global/ivySbt/$global/streams
./target/streams/$global/ivySbt/$global/streams/out
./target/streams/$global/projectDescriptors
./target/streams/$global/projectDescriptors/$global
./target/streams/$global/projectDescriptors/$global/streams
./target/streams/$global/projectDescriptors/$global/streams/out
./target/streams/$global/updateSbtClassifiers
./target/streams/$global/updateSbtClassifiers/$global
./target/streams/$global/updateSbtClassifiers/$global/streams
./target/streams/$global/updateSbtClassifiers/$global/streams/out
./target/streams/$global/dependencyPositions
./target/streams/$global/dependencyPositions/$global
./target/streams/$global/dependencyPositions/$global/streams
./target/streams/$global/dependencyPositions/$global/streams/update_cache_2.11
./target/streams/$global/dependencyPositions/$global/streams/update_cache_2.11/output_dsp
./target/streams/$global/dependencyPositions/$global/streams/update_cache_2.11/input_dsp
./target/streams/$global/clean
./target/streams/$global/clean/$global
./target/streams/$global/clean/$global/streams
./target/streams/$global/clean/$global/streams/out
./target/streams/$global/$global
./target/streams/$global/$global/$global
./target/streams/$global/$global/$global/streams
./target/streams/$global/$global/$global/streams/out
./target/streams/$global/update
./target/streams/$global/update/$global
./target/streams/$global/update/$global/streams
./target/streams/$global/update/$global/streams/out
./target/streams/$global/update/$global/streams/update_cache_2.11
./target/streams/$global/update/$global/streams/update_cache_2.11/inputs
./target/streams/$global/update/$global/streams/update_cache_2.11/output
./.git
./.git/packed-refs
./.git/branches
./.git/config
./.git/refs
./.git/refs/tags
./.git/refs/remotes
./.git/refs/remotes/origin
./.git/refs/remotes/origin/HEAD
./.git/refs/heads
./.git/refs/heads/master
./.git/hooks
./.git/hooks/commit-msg.sample
./.git/hooks/pre-rebase.sample
./.git/hooks/applypatch-msg.sample
./.git/hooks/prepare-commit-msg.sample
./.git/hooks/pre-push.sample
./.git/hooks/pre-receive.sample
./.git/hooks/update.sample
./.git/hooks/pre-applypatch.sample
./.git/hooks/post-update.sample
./.git/hooks/pre-commit.sample
./.git/objects
./.git/objects/pack
./.git/objects/pack/pack-4c18e42d95bf54fef7c10b1b564caa920985f9be.idx
./.git/objects/pack/pack-4c18e42d95bf54fef7c10b1b564caa920985f9be.pack
./.git/objects/info
./.git/HEAD
./.git/description
./.git/logs
./.git/logs/refs
./.git/logs/refs/remotes
./.git/logs/refs/remotes/origin
./.git/logs/refs/remotes/origin/HEAD
./.git/logs/refs/heads
./.git/logs/refs/heads/master
./.git/logs/HEAD
./.git/info
./.git/info/exclude
./.git/index
./imgs
./imgs/sparkling_ml.png
./imgs/sparkling_ml.jpg
./build
./build/sbt
./build/sbt-launch-0.13.15.jar
./src
./src/test
./src/test/scala
./src/test/scala/com
./src/test/scala/com/sparklingpandas
./src/test/scala/com/sparklingpandas/sparklingml
./src/test/scala/com/sparklingpandas/sparklingml/feature
./src/test/scala/com/sparklingpandas/sparklingml/feature/LuceneBaseTests.scala
./src/test/scala/com/sparklingpandas/sparklingml/feature/BasicPython.scala
./src/test/scala/com/sparklingpandas/sparklingml/feature/LuceneAnalyzerGeneratorsTest.scala
./src/test/scala/com/sparklingpandas/sparklingml/feature/LuceneAnalyzersTests.scala
./src/test/scala/com/sparklingpandas/sparklingml/param
./src/test/scala/com/sparklingpandas/sparklingml/param/SharedParamsCodeGenTest.scala
./src/main
./src/main/scala
./src/main/scala/com
./src/main/scala/com/sparklingpandas
./src/main/scala/com/sparklingpandas/sparklingml
./src/main/scala/com/sparklingpandas/sparklingml/CodeGenerator.scala
./src/main/scala/com/sparklingpandas/sparklingml/util
./src/main/scala/com/sparklingpandas/sparklingml/util/python
./src/main/scala/com/sparklingpandas/sparklingml/util/python/Initialize.scala
./src/main/scala/com/sparklingpandas/sparklingml/util/python/PythonTransformer.scala
./src/main/scala/com/sparklingpandas/sparklingml/feature
./src/main/scala/com/sparklingpandas/sparklingml/feature/LuceneAnalyzer.scala
./src/main/scala/com/sparklingpandas/sparklingml/feature/LuceneAnalyzers.scala
./src/main/scala/com/sparklingpandas/sparklingml/feature/BasicPython.scala
./src/main/scala/com/sparklingpandas/sparklingml/feature/LuceneAnalyzerGenerators.scala
./src/main/scala/com/sparklingpandas/sparklingml/feature/LuceneHelpers.scala
./src/main/scala/com/sparklingpandas/sparklingml/param
./src/main/scala/com/sparklingpandas/sparklingml/param/sharedParams.scala
./src/main/scala/com/sparklingpandas/sparklingml/param/SharedParamsCodeGen.scala
./.travis.yml
./project
./project/target
./project/target/resolution-cache
./project/target/resolution-cache/reports
./project/target/resolution-cache/reports/default-sparklingml-build-test.xml
./project/target/resolution-cache/reports/default-sparklingml-build-optional.xml
./project/target/resolution-cache/reports/default-sparklingml-build-runtime.xml
./project/target/resolution-cache/reports/default-sparklingml-build-scala-tool.xml
./project/target/resolution-cache/reports/default-sparklingml-build-runtime-internal.xml
./project/target/resolution-cache/reports/default-sparklingml-build-provided.xml
./project/target/resolution-cache/reports/default-sparklingml-build-pom.xml
./project/target/resolution-cache/reports/default-sparklingml-build-compile.xml
./project/target/resolution-cache/reports/ivy-report.css
./project/target/resolution-cache/reports/default-sparklingml-build-test-internal.xml
./project/target/resolution-cache/reports/ivy-report.xsl
./project/target/resolution-cache/reports/default-sparklingml-build-plugin.xml
./project/target/resolution-cache/reports/default-sparklingml-build-sources.xml
./project/target/resolution-cache/reports/default-sparklingml-build-compile-internal.xml
./project/target/resolution-cache/reports/default-sparklingml-build-docs.xml
./project/target/resolution-cache/default
./project/target/resolution-cache/default/sparklingml-build
./project/target/resolution-cache/default/sparklingml-build/scala_2.10
./project/target/resolution-cache/default/sparklingml-build/scala_2.10/sbt_0.13
./project/target/resolution-cache/default/sparklingml-build/scala_2.10/sbt_0.13/0.1-SNAPSHOT
./project/target/resolution-cache/default/sparklingml-build/scala_2.10/sbt_0.13/0.1-SNAPSHOT/resolved.xml.xml
./project/target/resolution-cache/default/sparklingml-build/scala_2.10/sbt_0.13/0.1-SNAPSHOT/resolved.xml.properties
./project/target/scala-2.10
./project/target/scala-2.10/sbt-0.13
./project/target/config-classes
./project/target/config-classes/$f65926f4e928e7de5bf5.cache
./project/target/config-classes/$f65926f4e928e7de5bf5.class
./project/target/config-classes/$58dcf62444262657c3a9$$anonfun$$sbtdef$1.class
./project/target/config-classes/$989c0841ea18c7ec7bc8.cache
./project/target/config-classes/$dd3efa175d7e7121f66a$$anonfun$$sbtdef$1.class
./project/target/config-classes/$61c530a44ad15d099f12$.class
./project/target/config-classes/$e25f59d82baba60cbe75.class
./project/target/config-classes/$50e4a2d7976d15c82056.class
./project/target/config-classes/$6dc34ecfb834a1ba2f91.cache
./project/target/config-classes/$9ca20488d9b0af650e7b.class
./project/target/config-classes/$966b7b9e4ab3d26f6d4a.class
./project/target/config-classes/$50e4a2d7976d15c82056$$anonfun$$sbtdef$1$$anonfun$apply$1.class
./project/target/config-classes/$a743e1ee8d6b27c7715e$$anonfun$$sbtdef$1.class
./project/target/config-classes/$dd3efa175d7e7121f66a.class
./project/target/config-classes/$14dad11e7bd1a45a625c.class
./project/target/config-classes/$81d8bf24ecf00c7ef809$.class
./project/target/config-classes/$81d8bf24ecf00c7ef809.cache
./project/target/config-classes/$14dad11e7bd1a45a625c$.class
./project/target/config-classes/$03c3f6904e9dbdcda3fb$$anonfun$$sbtdef$1.class
./project/target/config-classes/$92b35c9bd01286203ed1.class
./project/target/config-classes/$989c0841ea18c7ec7bc8$$anonfun$$sbtdef$1.class
./project/target/config-classes/$c220f521d4245f66aa52.cache
./project/target/config-classes/$0895921e17141ca4b28b$.class
./project/target/config-classes/$0895921e17141ca4b28b$$anonfun$$sbtdef$1.class
./project/target/config-classes/$a743e1ee8d6b27c7715e.class
./project/target/config-classes/$c220f521d4245f66aa52$$anonfun$$sbtdef$1.class
./project/target/config-classes/$474f73f0841805810547$$anonfun$$sbtdef$1.class
./project/target/config-classes/$58dcf62444262657c3a9$.class
./project/target/config-classes/$f65926f4e928e7de5bf5$$anonfun$$sbtdef$1.class
./project/target/config-classes/$0cd768627cb6e7267888.class
./project/target/config-classes/$0895921e17141ca4b28b.cache
./project/target/config-classes/$58dcf62444262657c3a9.cache
./project/target/config-classes/$989c0841ea18c7ec7bc8$.class
./project/target/config-classes/$ea6730b54de99563e529.class
./project/target/config-classes/$50e4a2d7976d15c82056$$anonfun$$sbtdef$1.class
./project/target/config-classes/$966b7b9e4ab3d26f6d4a$.class
./project/target/config-classes/$966b7b9e4ab3d26f6d4a$$anonfun$$sbtdef$1.class
./project/target/config-classes/$61c530a44ad15d099f12.class
./project/target/config-classes/$9ca20488d9b0af650e7b.cache
./project/target/config-classes/$ece2baec21b84c23decb.class
./project/target/config-classes/$389278c294b294bb8f2c$$anonfun$$sbtdef$1.class
./project/target/config-classes/$58dcf62444262657c3a9.class
./project/target/config-classes/$966b7b9e4ab3d26f6d4a.cache
./project/target/config-classes/$474f73f0841805810547.class
./project/target/config-classes/$389278c294b294bb8f2c.cache
./project/target/config-classes/$bfd09328ac57c459b0bc.class
./project/target/config-classes/$dd3efa175d7e7121f66a.cache
./project/target/config-classes/$0032d48c181ae4e6406b.cache
./project/target/config-classes/$bfd09328ac57c459b0bc$.class
./project/target/config-classes/$a743e1ee8d6b27c7715e$.class
./project/target/config-classes/$474f73f0841805810547$.class
./project/target/config-classes/$07ca02b6ec5749758cfe$.class
./project/target/config-classes/$bfd09328ac57c459b0bc.cache
./project/target/config-classes/$07ca02b6ec5749758cfe.class
./project/target/config-classes/$07ca02b6ec5749758cfe.cache
./project/target/config-classes/$61c530a44ad15d099f12$$anonfun$$sbtdef$1.class
./project/target/config-classes/$ea6730b54de99563e529$$anonfun$$sbtdef$1.class
./project/target/config-classes/$ea6730b54de99563e529$.class
./project/target/config-classes/$989c0841ea18c7ec7bc8.class
./project/target/config-classes/$0895921e17141ca4b28b.class
./project/target/config-classes/$ea6730b54de99563e529.cache
./project/target/config-classes/$03c3f6904e9dbdcda3fb.class
./project/target/config-classes/$6dc34ecfb834a1ba2f91$$anonfun$$sbtdef$1.class
./project/target/config-classes/$dd3efa175d7e7121f66a$.class
./project/target/config-classes/$50e4a2d7976d15c82056$.class
./project/target/config-classes/$0032d48c181ae4e6406b.class
./project/target/config-classes/$c220f521d4245f66aa52.class
./project/target/config-classes/$b3fdaf718a3aaed797bc.cache
./project/target/config-classes/$81d8bf24ecf00c7ef809$$anonfun$$sbtdef$1.class
./project/target/config-classes/$a743e1ee8d6b27c7715e.cache
./project/target/config-classes/$e25f59d82baba60cbe75$$anonfun$$sbtdef$1.class
./project/target/config-classes/$92b35c9bd01286203ed1$$anonfun$$sbtdef$1.class
./project/target/config-classes/$0032d48c181ae4e6406b$$anonfun$$sbtdef$1.class
./project/target/config-classes/$e25f59d82baba60cbe75$.class
./project/target/config-classes/$ece2baec21b84c23decb$$anonfun$$sbtdef$1.class
./project/target/config-classes/$ece2baec21b84c23decb.cache
./project/target/config-classes/$14dad11e7bd1a45a625c$$anonfun$$sbtdef$1.class
./project/target/config-classes/$b3fdaf718a3aaed797bc.class
./project/target/config-classes/$0cd768627cb6e7267888.cache
./project/target/config-classes/$9ca20488d9b0af650e7b$.class
./project/target/config-classes/$14dad11e7bd1a45a625c.cache
./project/target/config-classes/$e25f59d82baba60cbe75.cache
./project/target/config-classes/$b3fdaf718a3aaed797bc$.class
./project/target/config-classes/$81d8bf24ecf00c7ef809.class
./project/target/config-classes/$b3fdaf718a3aaed797bc$$anonfun$$sbtdef$1.class
./project/target/config-classes/$0cd768627cb6e7267888$$anonfun$$sbtdef$1.class
./project/target/config-classes/$92b35c9bd01286203ed1.cache
./project/target/config-classes/$bfd09328ac57c459b0bc$$anonfun$$sbtdef$1.class
./project/target/config-classes/$389278c294b294bb8f2c.class
./project/target/config-classes/$6dc34ecfb834a1ba2f91$.class
./project/target/config-classes/$92b35c9bd01286203ed1$.class
./project/target/config-classes/$c220f521d4245f66aa52$.class
./project/target/config-classes/$389278c294b294bb8f2c$.class
./project/target/config-classes/$474f73f0841805810547.cache
./project/target/config-classes/$ece2baec21b84c23decb$.class
./project/target/config-classes/$03c3f6904e9dbdcda3fb.cache
./project/target/config-classes/$61c530a44ad15d099f12.cache
./project/target/config-classes/$9ca20488d9b0af650e7b$$anonfun$$sbtdef$1.class
./project/target/config-classes/$0032d48c181ae4e6406b$.class
./project/target/config-classes/$6dc34ecfb834a1ba2f91.class
./project/target/config-classes/$07ca02b6ec5749758cfe$$anonfun$$sbtdef$1.class
./project/target/config-classes/$03c3f6904e9dbdcda3fb$.class
./project/target/config-classes/$f65926f4e928e7de5bf5$.class
./project/target/config-classes/$0cd768627cb6e7267888$.class
./project/target/config-classes/$50e4a2d7976d15c82056.cache
./project/target/streams
./project/target/streams/runtime
./project/target/streams/runtime/managedClasspath
./project/target/streams/runtime/managedClasspath/$global
./project/target/streams/runtime/managedClasspath/$global/streams
./project/target/streams/runtime/managedClasspath/$global/streams/export
./project/target/streams/runtime/externalDependencyClasspath
./project/target/streams/runtime/externalDependencyClasspath/$global
./project/target/streams/runtime/externalDependencyClasspath/$global/streams
./project/target/streams/runtime/externalDependencyClasspath/$global/streams/export
./project/target/streams/runtime/unmanagedJars
./project/target/streams/runtime/unmanagedJars/$global
./project/target/streams/runtime/unmanagedJars/$global/streams
./project/target/streams/runtime/unmanagedJars/$global/streams/export
./project/target/streams/runtime/fullClasspath
./project/target/streams/runtime/fullClasspath/$global
./project/target/streams/runtime/fullClasspath/$global/streams
./project/target/streams/runtime/fullClasspath/$global/streams/export
./project/target/streams/runtime/internalDependencyClasspath
./project/target/streams/runtime/internalDependencyClasspath/$global
./project/target/streams/runtime/internalDependencyClasspath/$global/streams
./project/target/streams/runtime/internalDependencyClasspath/$global/streams/export
./project/target/streams/runtime/unmanagedClasspath
./project/target/streams/runtime/unmanagedClasspath/$global
./project/target/streams/runtime/unmanagedClasspath/$global/streams
./project/target/streams/runtime/unmanagedClasspath/$global/streams/export
./project/target/streams/runtime/exportedProducts
./project/target/streams/runtime/exportedProducts/$global
./project/target/streams/runtime/exportedProducts/$global/streams
./project/target/streams/runtime/exportedProducts/$global/streams/export
./project/target/streams/runtime/dependencyClasspath
./project/target/streams/runtime/dependencyClasspath/$global
./project/target/streams/runtime/dependencyClasspath/$global/streams
./project/target/streams/runtime/dependencyClasspath/$global/streams/export
./project/target/streams/compile
./project/target/streams/compile/copyResources
./project/target/streams/compile/copyResources/$global
./project/target/streams/compile/copyResources/$global/streams
./project/target/streams/compile/copyResources/$global/streams/out
./project/target/streams/compile/copyResources/$global/streams/copy-resources
./project/target/streams/compile/compileIncremental
./project/target/streams/compile/compileIncremental/$global
./project/target/streams/compile/compileIncremental/$global/streams
./project/target/streams/compile/compileIncremental/$global/streams/out
./project/target/streams/compile/compileIncremental/$global/streams/export
./project/target/streams/compile/managedClasspath
./project/target/streams/compile/managedClasspath/$global
./project/target/streams/compile/managedClasspath/$global/streams
./project/target/streams/compile/managedClasspath/$global/streams/export
./project/target/streams/compile/externalDependencyClasspath
./project/target/streams/compile/externalDependencyClasspath/$global
./project/target/streams/compile/externalDependencyClasspath/$global/streams
./project/target/streams/compile/externalDependencyClasspath/$global/streams/export
./project/target/streams/compile/unmanagedJars
./project/target/streams/compile/unmanagedJars/$global
./project/target/streams/compile/unmanagedJars/$global/streams
./project/target/streams/compile/unmanagedJars/$global/streams/export
./project/target/streams/compile/incCompileSetup
./project/target/streams/compile/incCompileSetup/$global
./project/target/streams/compile/incCompileSetup/$global/streams
./project/target/streams/compile/internalDependencyClasspath
./project/target/streams/compile/internalDependencyClasspath/$global
./project/target/streams/compile/internalDependencyClasspath/$global/streams
./project/target/streams/compile/internalDependencyClasspath/$global/streams/export
./project/target/streams/compile/unmanagedClasspath
./project/target/streams/compile/unmanagedClasspath/$global
./project/target/streams/compile/unmanagedClasspath/$global/streams
./project/target/streams/compile/unmanagedClasspath/$global/streams/export
./project/target/streams/compile/compile
./project/target/streams/compile/compile/$global
./project/target/streams/compile/compile/$global/streams
./project/target/streams/compile/compile/$global/streams/out
./project/target/streams/compile/$global
./project/target/streams/compile/$global/$global
./project/target/streams/compile/$global/$global/discoveredMainClasses
./project/target/streams/compile/$global/$global/discoveredMainClasses/data
./project/target/streams/compile/exportedProducts
./project/target/streams/compile/exportedProducts/$global
./project/target/streams/compile/exportedProducts/$global/streams
./project/target/streams/compile/exportedProducts/$global/streams/export
./project/target/streams/compile/dependencyClasspath
./project/target/streams/compile/dependencyClasspath/$global
./project/target/streams/compile/dependencyClasspath/$global/streams
./project/target/streams/compile/dependencyClasspath/$global/streams/export
./project/target/streams/$global
./project/target/streams/$global/ivyConfiguration
./project/target/streams/$global/ivyConfiguration/$global
./project/target/streams/$global/ivyConfiguration/$global/streams
./project/target/streams/$global/ivyConfiguration/$global/streams/out
./project/target/streams/$global/ivySbt
./project/target/streams/$global/ivySbt/$global
./project/target/streams/$global/ivySbt/$global/streams
./project/target/streams/$global/ivySbt/$global/streams/out
./project/target/streams/$global/projectDescriptors
./project/target/streams/$global/projectDescriptors/$global
./project/target/streams/$global/projectDescriptors/$global/streams
./project/target/streams/$global/projectDescriptors/$global/streams/out
./project/target/streams/$global/updateSbtClassifiers
./project/target/streams/$global/updateSbtClassifiers/$global
./project/target/streams/$global/updateSbtClassifiers/$global/streams
./project/target/streams/$global/updateSbtClassifiers/$global/streams/out
./project/target/streams/$global/dependencyPositions
./project/target/streams/$global/dependencyPositions/$global
./project/target/streams/$global/dependencyPositions/$global/streams
./project/target/streams/$global/dependencyPositions/$global/streams/update_cache_2.10
./project/target/streams/$global/dependencyPositions/$global/streams/update_cache_2.10/output_dsp
./project/target/streams/$global/dependencyPositions/$global/streams/update_cache_2.10/input_dsp
./project/target/streams/$global/$global
./project/target/streams/$global/$global/$global
./project/target/streams/$global/$global/$global/streams
./project/target/streams/$global/$global/$global/streams/out
./project/target/streams/$global/update
./project/target/streams/$global/update/$global
./project/target/streams/$global/update/$global/streams
./project/target/streams/$global/update/$global/streams/out
./project/target/streams/$global/update/$global/streams/update_cache_2.10
./project/target/streams/$global/update/$global/streams/update_cache_2.10/inputs
./project/target/streams/$global/update/$global/streams/update_cache_2.10/output
./project/plugins.sbt
./project/project
./project/project/target
./project/project/target/config-classes
./project/project/target/config-classes/$c449aa92b9ed764bcfe8$.class
./project/project/target/config-classes/$61b6d93be182a8a3a291.cache
./project/project/target/config-classes/$61b6d93be182a8a3a291.class
./project/project/target/config-classes/$ccb41e21aa640e0f94ba$$anonfun$$sbtdef$1.class
./project/project/target/config-classes/$ccb41e21aa640e0f94ba.class
./project/project/target/config-classes/$530c3f64214b286f8aa9$.class
./project/project/target/config-classes/$20c9c81e6c77b634a984.cache
./project/project/target/config-classes/$6258ac9c4d09fff70d1d.class
./project/project/target/config-classes/$530c3f64214b286f8aa9.class
./project/project/target/config-classes/$ccb41e21aa640e0f94ba$.class
./project/project/target/config-classes/$ccb41e21aa640e0f94ba.cache
./project/project/target/config-classes/$6258ac9c4d09fff70d1d$.class
./project/project/target/config-classes/$c449aa92b9ed764bcfe8.cache
./project/project/target/config-classes/$530c3f64214b286f8aa9.cache
./project/project/target/config-classes/$c449aa92b9ed764bcfe8.class
./project/project/target/config-classes/$61b6d93be182a8a3a291$.class
./project/project/target/config-classes/$61b6d93be182a8a3a291$$anonfun$$sbtdef$1.class
./project/project/target/config-classes/$6258ac9c4d09fff70d1d.cache
./project/project/target/config-classes/$20c9c81e6c77b634a984$.class
./project/project/target/config-classes/$20c9c81e6c77b634a984.class
./project/build.properties
./.codecov.yml
./.idea
./.idea/compiler.xml
./.idea/libraries
./.idea/libraries/SBT__org_apache_spark_spark_mllib_2_11_2_2_0_jar.xml
./.idea/libraries/SBT__org_eclipse_jetty_jetty_http_9_3_14_v20161028_jar.xml
./.idea/libraries/SBT__org_apache_lucene_lucene_grouping_6_5_1_jar.xml
./.idea/libraries/SBT__org_antlr_antlr4_runtime_4_5_3_jar.xml
./.idea/libraries/SBT__javax_xml_bind_jaxb_api_2_2_2_jar.xml
./.idea/libraries/SBT__com_sun_jersey_jersey_server_1_9_jar.xml
./.idea/libraries/SBT__org_apache_thrift_libfb303_0_9_3_jar.xml
./.idea/libraries/SBT__junit_junit_4_12_jar.xml
./.idea/libraries/SBT__org_codehaus_woodstox_woodstox_core_asl_4_4_1_jar.xml
./.idea/libraries/SBT__com_jolbox_bonecp_0_8_0_RELEASE_jar.xml
./.idea/libraries/SBT__org_scala_lang_modules_scala_parser_combinators_2_11_1_0_4_jar.xml
./.idea/libraries/SBT__org_spire_math_spire_2_11_0_7_4_jar.xml
./.idea/libraries/SBT__org_apache_avro_avro_mapred_1_7_7_hadoop2_jar.xml
./.idea/libraries/SBT__io_dropwizard_metrics_metrics_graphite_3_1_2_jar.xml
./.idea/libraries/SBT__org_apache_lucene_lucene_core_6_5_1_jar.xml
./.idea/libraries/SBT__org_apache_hadoop_hadoop_mapreduce_client_jobclient_2_8_1_jar.xml
./.idea/libraries/SBT__com_google_code_findbugs_jsr305_3_0_0_jar.xml
./.idea/libraries/SBT__xerces_xercesImpl_2_9_1_jar.xml
./.idea/libraries/SBT__org_apache_spark_spark_network_shuffle_2_11_2_1_1_jar.xml
./.idea/libraries/SBT__org_apache_hadoop_hadoop_mapreduce_client_core_2_6_0_jar.xml
./.idea/libraries/SBT__org_apache_hadoop_hadoop_yarn_common_2_6_5_jar.xml
./.idea/libraries/SBT__io_dropwizard_metrics_metrics_jetty9_3_1_2_jar.xml
./.idea/libraries/SBT__com_nimbusds_nimbus_jose_jwt_3_9_jar.xml
./.idea/libraries/SBT__org_apache_hadoop_hadoop_mapreduce_client_common_2_6_0_jar.xml
./.idea/libraries/SBT__io_netty_netty_3_8_0_Final_jar.xml
./.idea/libraries/SBT__javax_annotation_javax_annotation_api_1_2_jar.xml
./.idea/libraries/SBT__org_apache_lucene_lucene_backward_codecs_6_5_1_jar.xml
./.idea/libraries/SBT__org_eclipse_jetty_jetty_continuation_9_3_14_v20161028_jar.xml
./.idea/libraries/SBT__org_eclipse_jetty_jetty_security_9_3_14_v20161028_jar.xml
./.idea/libraries/SBT__org_fusesource_leveldbjni_leveldbjni_all_1_8_jar.xml
./.idea/libraries/SBT__org_codehaus_janino_janino_3_0_0_jar.xml
./.idea/libraries/SBT__org_glassfish_jersey_core_jersey_server_2_22_2_jar.xml
./.idea/libraries/SBT__org_eclipse_jetty_jetty_servlets_9_3_14_v20161028_jar.xml
./.idea/libraries/SBT__net_jcip_jcip_annotations_1_0_jar.xml
./.idea/libraries/SBT__javax_servlet_jsp_jsp_api_2_1_jar.xml
./.idea/libraries/SBT__javax_validation_validation_api_1_1_0_Final_jar.xml
./.idea/libraries/SBT__com_fasterxml_jackson_dataformat_jackson_dataformat_smile_2_5_4_jar.xml
./.idea/libraries/SBT__org_datanucleus_datanucleus_core_3_2_10_jar.xml
./.idea/libraries/SBT__org_glassfish_hk2_osgi_resource_locator_1_0_1_jar.xml
./.idea/libraries/SBT__org_apache_parquet_parquet_format_2_3_1_jar.xml
./.idea/libraries/SBT__org_apache_spark_spark_tags_2_11_2_2_0_jar.xml
./.idea/libraries/SBT__org_apache_zookeeper_zookeeper_3_4_6_jar.xml
./.idea/libraries/SBT__org_apache_spark_spark_catalyst_2_11_2_1_1_jar.xml
./.idea/libraries/SBT__commons_dbcp_commons_dbcp_1_4_jar.xml
./.idea/libraries/SBT__org_glassfish_jersey_core_jersey_client_2_22_2_jar.xml
./.idea/libraries/SBT__antlr_antlr_2_7_7_jar.xml
./.idea/libraries/SBT__net_jpountz_lz4_lz4_1_3_0_jar.xml
./.idea/libraries/SBT__org_slf4j_jul_to_slf4j_1_7_16_jar.xml
./.idea/libraries/SBT__org_apache_hadoop_hadoop_auth_2_7_2_jar.xml
./.idea/libraries/SBT__org_json4s_json4s_ast_2_11_3_2_11_jar.xml
./.idea/libraries/SBT__com_clearspring_analytics_stream_2_7_0_jar.xml
./.idea/libraries/SBT__com_lucidworks_spark_spark_solr_3_0_2_jar.xml
./.idea/libraries/SBT__org_apache_spark_spark_mllib_local_2_11_2_1_1_jar.xml
./.idea/libraries/SBT__io_dropwizard_metrics_metrics_core_3_1_2_jar.xml
./.idea/libraries/SBT__com_twitter_chill_java_0_8_0_jar.xml
./.idea/libraries/SBT__tomcat_jasper_compiler_5_5_23_jar.xml
./.idea/libraries/SBT__org_apache_hadoop_hadoop_yarn_server_resourcemanager_2_8_1_jar.xml
./.idea/libraries/SBT__org_apache_hadoop_hadoop_common_2_6_5_jar.xml
./.idea/libraries/SBT__org_glassfish_jersey_core_jersey_common_2_22_2_jar.xml
./.idea/libraries/SBT__org_apache_hadoop_hadoop_hdfs_2_8_1_jar.xml
./.idea/libraries/SBT__log4j_log4j_1_2_17_jar.xml
./.idea/libraries/SBT__com_holdenkarau_spark_testing_base_2_11_0_7_3_jar.xml
./.idea/libraries/SBT__com_chuusai_shapeless_2_11_2_3_2_jar.xml
./.idea/libraries/SBT__org_apache_thrift_libthrift_0_9_3_jar.xml
./.idea/libraries/SBT__org_glassfish_jersey_media_jersey_media_jaxb_2_22_2_jar.xml
./.idea/libraries/SBT__org_scoverage_scalac_scoverage_runtime_2_11_1_3_0_jar.xml
./.idea/libraries/SBT__org_scalanlp_breeze_2_11_0_13_1_jar.xml
./.idea/libraries/SBT__org_apache_hadoop_hadoop_yarn_api_2_6_0_jar.xml
./.idea/libraries/SBT__commons_logging_commons_logging_1_2_jar.xml
./.idea/libraries/SBT__org_apache_directory_server_apacheds_kerberos_codec_2_0_0_M15_jar.xml
./.idea/libraries/SBT__org_apache_lucene_lucene_sandbox_6_5_1_jar.xml
./.idea/libraries/SBT__org_apache_commons_commons_crypto_1_0_0_jar.xml
./.idea/libraries/SBT__org_roaringbitmap_RoaringBitmap_0_5_11_jar.xml
./.idea/libraries/SBT__org_apache_spark_spark_unsafe_2_11_2_1_1_jar.xml
./.idea/libraries/SBT__org_spire_math_spire_macros_2_11_0_13_0_jar.xml
./.idea/libraries/SBT__com_squareup_okio_okio_1_4_0_jar.xml
./.idea/libraries/SBT__org_apache_derby_derby_10_10_2_0_jar.xml
./.idea/libraries/SBT__org_jpmml_pmml_schema_1_2_15_jar.xml
./.idea/libraries/SBT__com_chuusai_shapeless_2_11_2_0_0_jar.xml
./.idea/libraries/SBT__org_apache_hadoop_hadoop_yarn_common_2_6_0_jar.xml
./.idea/libraries/SBT__commons_io_commons_io_2_3_jar.xml
./.idea/libraries/SBT__org_apache_avro_avro_ipc_1_7_7_jar.xml
./.idea/libraries/SBT__org_apache_lucene_lucene_queryparser_6_5_1_jar.xml
./.idea/libraries/SBT__com_twitter_chill_2_11_0_8_0_jar.xml
./.idea/libraries/SBT__org_apache_spark_spark_streaming_2_11_2_1_1_jar.xml
./.idea/libraries/SBT__org_apache_hadoop_hadoop_mapreduce_client_app_2_6_5_jar.xml
./.idea/libraries/SBT__org_apache_spark_spark_network_shuffle_2_11_2_2_0_jar.xml
./.idea/libraries/SBT__org_slf4j_jcl_over_slf4j_1_7_16_jar.xml
./.idea/libraries/SBT__org_eclipse_jetty_jetty_jmx_9_3_14_v20161028_jar.xml
./.idea/libraries/SBT__net_sf_opencsv_opencsv_2_3_jar.xml
./.idea/libraries/SBT__org_codehaus_jettison_jettison_1_1_jar.xml
./.idea/libraries/SBT__org_apache_parquet_parquet_hadoop_1_8_1_jar.xml
./.idea/libraries/SBT__org_apache_spark_spark_launcher_2_11_2_2_0_jar.xml
./.idea/libraries/SBT__commons_fileupload_commons_fileupload_1_3_2_jar.xml
./.idea/libraries/SBT__org_apache_parquet_parquet_encoding_1_8_1_jar.xml
./.idea/libraries/SBT__io_netty_netty_all_4_0_42_Final_jar.xml
./.idea/libraries/SBT__org_apache_commons_commons_lang3_3_3_2_jar.xml
./.idea/libraries/SBT__com_jcraft_jsch_0_1_51_jar.xml
./.idea/libraries/SBT__org_slf4j_slf4j_log4j12_1_7_16_jar.xml
./.idea/libraries/SBT__org_typelevel_macro_compat_2_11_1_1_1_jar.xml
./.idea/libraries/SBT__org_apache_lucene_lucene_analyzers_common_6_5_1_jar.xml
./.idea/libraries/SBT__org_apache_hadoop_hadoop_hdfs_client_2_8_1_jar.xml
./.idea/libraries/SBT__org_apache_solr_solr_core_6_5_1_jar.xml
./.idea/libraries/SBT__org_apache_hadoop_hadoop_common_2_6_0_jar.xml
./.idea/libraries/SBT__org_apache_spark_spark_tags_2_11_2_1_1_jar.xml
./.idea/libraries/SBT__xml_apis_xml_apis_1_3_04_jar.xml
./.idea/libraries/SBT__commons_codec_commons_codec_1_10_jar.xml
./.idea/libraries/SBT__org_xerial_snappy_snappy_java_1_1_2_6_jar.xml
./.idea/libraries/SBT__org_apache_parquet_parquet_common_1_8_1_jar.xml
./.idea/libraries/SBT__com_google_code_gson_gson_2_2_4_jar.xml
./.idea/libraries/SBT__commons_daemon_commons_daemon_1_0_13_jar.xml
./.idea/libraries/SBT__com_codahale_metrics_metrics_core_3_0_0_jar.xml
./.idea/libraries/SBT__org_apache_hadoop_hadoop_hdfs_2_7_2_jar.xml
./.idea/libraries/SBT__org_apache_hadoop_hadoop_client_2_6_5_jar.xml
./.idea/libraries/SBT__org_apache_spark_spark_hive_2_11_2_1_1_jar.xml
./.idea/libraries/SBT__javax_mail_mail_1_4_7_jar.xml
./.idea/libraries/SBT__org_scala_lang_scala_library_2_11_8_jar.xml
./.idea/libraries/SBT__org_apache_httpcomponents_httpclient_4_5_2_jar.xml
./.idea/libraries/SBT__org_eclipse_jetty_jetty_servlet_9_3_14_v20161028_jar.xml
./.idea/libraries/SBT__org_glassfish_hk2_external_aopalliance_repackaged_2_4_0_b34_jar.xml
./.idea/libraries/SBT__net_hydromatic_eigenbase_properties_1_1_5_jar.xml
./.idea/libraries/SBT__org_apache_hadoop_hadoop_yarn_server_common_2_6_0_jar.xml
./.idea/libraries/SBT__org_apache_spark_spark_mllib_2_11_2_1_1_jar.xml
./.idea/libraries/SBT__org_apache_spark_spark_launcher_2_11_2_1_1_jar.xml
./.idea/libraries/SBT__org_apache_hadoop_hadoop_common_2_8_1_tests_jar.xml
./.idea/libraries/SBT__org_apache_hadoop_hadoop_yarn_common_2_8_1_jar.xml
./.idea/libraries/SBT__org_apache_hadoop_hadoop_yarn_client_2_8_1_jar.xml
./.idea/libraries/SBT__org_restlet_jee_org_restlet_ext_servlet_2_3_0_jar.xml
./.idea/libraries/SBT__oro_oro_2_0_8_jar.xml
./.idea/libraries/SBT__com_google_code_findbugs_jsr305_1_3_9_jar.xml
./.idea/libraries/SBT__net_sf_py4j_py4j_0_10_4_jar.xml
./.idea/libraries/SBT__com_google_protobuf_protobuf_java_3_1_0_jar.xml
./.idea/libraries/SBT__org_scalanlp_breeze_macros_2_11_0_13_1_jar.xml
./.idea/libraries/SBT__org_datanucleus_datanucleus_rdbms_3_2_9_jar.xml
./.idea/libraries/SBT__org_apache_hadoop_hadoop_yarn_server_web_proxy_2_8_1_tests_jar.xml
./.idea/libraries/SBT__org_apache_curator_curator_recipes_2_8_0_jar.xml
./.idea/libraries/SBT__commons_net_commons_net_3_1_jar.xml
./.idea/libraries/SBT__org_scalanlp_breeze_macros_2_11_0_12_jar.xml
./.idea/libraries/SBT__org_apache_hadoop_hadoop_yarn_server_tests_2_8_1_jar.xml
./.idea/libraries/SBT__org_javassist_javassist_3_21_0_GA_jar.xml
./.idea/libraries/SBT__org_apache_hadoop_hadoop_auth_2_8_1_jar.xml
./.idea/libraries/SBT__com_fasterxml_jackson_core_jackson_databind_2_6_5_jar.xml
./.idea/libraries/SBT__org_apache_spark_spark_graphx_2_11_2_2_0_jar.xml
./.idea/libraries/SBT__org_apache_parquet_parquet_encoding_1_8_2_jar.xml
./.idea/libraries/SBT__com_thoughtworks_paranamer_paranamer_2_6_jar.xml
./.idea/libraries/SBT__com_esotericsoftware_minlog_1_3_0_jar.xml
./.idea/libraries/SBT__org_glassfish_jersey_containers_jersey_container_servlet_2_22_2_jar.xml
./.idea/libraries/SBT__org_apache_lucene_lucene_analyzers_phonetic_6_5_1_jar.xml
./.idea/libraries/SBT__javax_transaction_jta_1_1_jar.xml
./.idea/libraries/SBT__io_netty_netty_all_4_0_43_Final_jar.xml
./.idea/libraries/SBT__org_sonatype_sisu_inject_cglib_2_2_1_v20090111_jar.xml
./.idea/libraries/SBT__org_apache_parquet_parquet_column_1_8_1_jar.xml
./.idea/libraries/SBT__org_apache_spark_spark_sketch_2_11_2_2_0_jar.xml
./.idea/libraries/SBT__org_scalactic_scalactic_2_11_3_0_1_jar.xml
./.idea/libraries/SBT__jline_jline_0_9_94_jar.xml
./.idea/libraries/SBT__com_squareup_okhttp_okhttp_2_4_0_jar.xml
./.idea/libraries/SBT__org_apache_curator_curator_test_2_7_1_jar.xml
./.idea/libraries/SBT__org_scalanlp_breeze_2_11_0_12_jar.xml
./.idea/libraries/SBT__org_eclipse_jetty_jetty_xml_9_3_14_v20161028_jar.xml
./.idea/libraries/SBT__org_apache_spark_spark_graphx_2_11_2_1_1_jar.xml
./.idea/libraries/SBT__commons_net_commons_net_2_2_jar.xml
./.idea/libraries/SBT__org_reflections_reflections_0_9_11_jar.xml
./.idea/libraries/SBT__commons_beanutils_commons_beanutils_core_1_8_0_jar.xml
./.idea/libraries/SBT__org_scala_lang_modules_scala_xml_2_11_1_0_5_jar.xml
./.idea/libraries/SBT__org_apache_solr_solr_solrj_6_5_1_jar.xml
./.idea/libraries/SBT__org_apache_parquet_parquet_common_1_8_2_jar.xml
./.idea/libraries/SBT__org_typelevel_machinist_2_11_0_6_1_jar.xml
./.idea/libraries/SBT__org_hamcrest_hamcrest_core_1_3_jar.xml
./.idea/libraries/SBT__commons_pool_commons_pool_1_5_4_jar.xml
./.idea/libraries/SBT__io_dropwizard_metrics_metrics_ganglia_3_1_2_jar.xml
./.idea/libraries/SBT__org_apache_hadoop_hadoop_mapreduce_client_jobclient_2_6_5_jar.xml
./.idea/libraries/SBT__org_apache_hadoop_hadoop_client_2_8_1_jar.xml
./.idea/libraries/SBT__org_apache_hadoop_hadoop_minicluster_2_8_1_jar.xml
./.idea/libraries/SBT__org_apache_lucene_lucene_memory_6_5_1_jar.xml
./.idea/libraries/SBT__org_apache_hadoop_hadoop_yarn_server_applicationhistoryservice_2_8_1_jar.xml
./.idea/libraries/SBT__org_apache_spark_spark_sketch_2_11_2_1_1_jar.xml
./.idea/libraries/SBT__org_codehaus_jackson_jackson_jaxrs_1_9_13_jar.xml
./.idea/libraries/SBT__org_restlet_jee_org_restlet_2_3_0_jar.xml
./.idea/libraries/SBT__com_sun_jersey_jersey_client_1_9_jar.xml
./.idea/libraries/SBT__org_twitter4j_twitter4j_core_4_0_4_jar.xml
./.idea/libraries/SBT__com_sun_jersey_jersey_json_1_9_jar.xml
./.idea/libraries/SBT__org_codehaus_jackson_jackson_mapper_asl_1_9_13_jar.xml
./.idea/libraries/SBT__dom4j_dom4j_1_6_1_jar.xml
./.idea/libraries/SBT__org_json4s_json4s_core_2_11_3_2_11_jar.xml
./.idea/libraries/SBT__org_scala_lang_scala_compiler_2_11_8_jar.xml
./.idea/libraries/SBT__org_scala_lang_scala_reflect_2_11_8_jar.xml
./.idea/libraries/SBT__com_github_rwl_jtransforms_2_4_0_jar.xml
./.idea/libraries/SBT__org_apache_lucene_lucene_classification_6_5_1_jar.xml
./.idea/libraries/SBT__org_joda_joda_convert_1_2_jar.xml
./.idea/libraries/SBT__joda_time_joda_time_2_9_3_jar.xml
./.idea/libraries/SBT__org_glassfish_hk2_hk2_utils_2_4_0_b34_jar.xml
./.idea/libraries/SBT__org_bouncycastle_bcprov_jdk15on_1_51_jar.xml
./.idea/libraries/SBT__commons_beanutils_commons_beanutils_1_7_0_jar.xml
./.idea/libraries/SBT__org_json4s_json4s_jackson_2_11_3_2_11_jar.xml
./.idea/libraries/SBT__net_java_dev_jets3t_jets3t_0_9_0_jar.xml
./.idea/libraries/SBT__org_apache_lucene_lucene_expressions_6_5_1_jar.xml
./.idea/libraries/SBT__com_typesafe_scala_logging_scala_logging_2_11_3_4_0_jar.xml
./.idea/libraries/SBT__org_apache_htrace_htrace_core_3_2_0_incubating_jar.xml
./.idea/libraries/SBT__org_scala_sbt_test_interface_1_0_jar.xml
./.idea/libraries/SBT__org_apache_hadoop_hadoop_hdfs_2_8_1_tests_jar.xml
./.idea/libraries/SBT__org_eclipse_jetty_jetty_webapp_9_3_14_v20161028_jar.xml
./.idea/libraries/SBT__org_objenesis_objenesis_2_1_jar.xml
./.idea/libraries/SBT__org_apache_lucene_lucene_codecs_6_5_1_jar.xml
./.idea/libraries/SBT__org_codehaus_jackson_jackson_xc_1_9_13_jar.xml
./.idea/libraries/SBT__org_iq80_snappy_snappy_0_2_jar.xml
./.idea/libraries/SBT__org_apache_spark_spark_streaming_2_11_2_2_0_jar.xml
./.idea/libraries/SBT__org_apache_hadoop_hadoop_client_2_8_1_tests_jar.xml
./.idea/libraries/SBT__com_fasterxml_jackson_core_jackson_core_2_4_0_jar.xml
./.idea/libraries/SBT__org_apache_spark_spark_catalyst_2_11_2_2_0_jar.xml
./.idea/libraries/SBT__commons_configuration_commons_configuration_1_6_jar.xml
./.idea/libraries/SBT__javax_activation_activation_1_1_1_jar.xml
./.idea/libraries/SBT__com_carrotsearch_hppc_0_7_1_jar.xml
./.idea/libraries/SBT__org_apache_hadoop_hadoop_yarn_server_common_2_6_5_jar.xml
./.idea/libraries/SBT__org_apache_hadoop_hadoop_client_2_6_0_jar.xml
./.idea/libraries/SBT__org_apache_parquet_parquet_jackson_1_8_2_jar.xml
./.idea/libraries/SBT__org_apache_bahir_spark_streaming_twitter_2_11_2_0_1_jar.xml
./.idea/libraries/SBT__io_github_nicolasstucki_multisets_2_11_0_4_jar.xml
./.idea/libraries/SBT__org_noggit_noggit_0_6_jar.xml
./.idea/libraries/SBT__org_scala_lang_scalap_2_11_8_jar.xml
./.idea/libraries/SBT__org_apache_hadoop_hadoop_yarn_api_2_6_5_jar.xml
./.idea/libraries/SBT__io_dropwizard_metrics_metrics_jvm_3_1_2_jar.xml
./.idea/libraries/SBT__org_slf4j_slf4j_api_1_7_21_jar.xml
./.idea/libraries/SBT__com_jcraft_jsch_0_1_42_jar.xml
./.idea/libraries/SBT__org_spark_project_hive_hive_metastore_1_2_1_spark2_jar.xml
./.idea/libraries/SBT__org_apache_commons_commons_exec_1_3_jar.xml
./.idea/libraries/SBT__org_apache_htrace_htrace_core4_4_0_1_incubating_jar.xml
./.idea/libraries/SBT__org_locationtech_spatial4j_spatial4j_0_6_jar.xml
./.idea/libraries/SBT__org_datanucleus_datanucleus_api_jdo_3_2_6_jar.xml
./.idea/libraries/SBT__org_apache_spark_spark_core_2_11_2_2_0_jar.xml
./.idea/libraries/SBT__org_apache_directory_api_api_util_1_0_0_M20_jar.xml
./.idea/libraries/SBT__org_eclipse_jetty_jetty_server_9_3_14_v20161028_jar.xml
./.idea/libraries/SBT__org_spark_project_spark_unused_1_0_0_jar.xml
./.idea/libraries/SBT__org_mortbay_jetty_jetty_util_6_1_26_jar.xml
./.idea/libraries/SBT__commons_lang_commons_lang_2_6_jar.xml
./.idea/libraries/SBT__org_spire_math_spire_2_11_0_13_0_jar.xml
./.idea/libraries/SBT__org_glassfish_hk2_hk2_locator_2_4_0_b34_jar.xml
./.idea/libraries/SBT__org_apache_spark_spark_core_2_11_2_1_1_jar.xml
./.idea/libraries/SBT__org_apache_directory_server_apacheds_i18n_2_0_0_M15_jar.xml
./.idea/libraries/SBT__org_jpmml_pmml_model_1_2_15_jar.xml
./.idea/libraries/SBT__org_apache_parquet_parquet_column_1_8_2_jar.xml
./.idea/libraries/SBT__com_tdunning_t_digest_3_1_jar.xml
./.idea/libraries/SBT__org_apache_hadoop_hadoop_mapreduce_client_shuffle_2_6_5_jar.xml
./.idea/libraries/SBT__com_jamesmurty_utils_java_xmlbuilder_1_0_jar.xml
./.idea/libraries/SBT__org_apache_httpcomponents_httpcore_4_4_4_jar.xml
./.idea/libraries/SBT__org_glassfish_jersey_bundles_repackaged_jersey_guava_2_22_2_jar.xml
./.idea/libraries/SBT__net_razorvine_pyrolite_4_13_jar.xml
./.idea/libraries/SBT__org_apache_hadoop_hadoop_annotations_2_7_2_jar.xml
./.idea/libraries/SBT__org_apache_hadoop_hadoop_mapreduce_client_jobclient_2_6_0_jar.xml
./.idea/libraries/SBT__aopalliance_aopalliance_1_0_jar.xml
./.idea/libraries/SBT__info_ganglia_gmetric4j_gmetric4j_1_0_7_jar.xml
./.idea/libraries/SBT__org_apache_lucene_lucene_queries_6_5_1_jar.xml
./.idea/libraries/SBT__org_apache_curator_curator_client_2_8_0_jar.xml
./.idea/libraries/SBT__org_eclipse_jetty_jetty_util_9_3_14_v20161028_jar.xml
./.idea/libraries/SBT__org_apache_commons_commons_lang3_3_5_jar.xml
./.idea/libraries/SBT__org_antlr_ST4_4_0_4_jar.xml
./.idea/libraries/SBT__javax_jdo_jdo_api_3_0_1_jar.xml
./.idea/libraries/SBT__org_glassfish_jersey_containers_jersey_container_servlet_core_2_22_2_jar.xml
./.idea/libraries/SBT__org_apache_avro_avro_ipc_1_7_7_tests_jar.xml
./.idea/libraries/SBT__org_apache_lucene_lucene_suggest_6_5_1_jar.xml
./.idea/libraries/SBT__com_google_guava_guava_20_0_jar.xml
./.idea/libraries/SBT__org_antlr_antlr_runtime_3_4_jar.xml
./.idea/libraries/SBT__org_apache_lucene_lucene_misc_6_5_1_jar.xml
./.idea/libraries/SBT__commons_collections_commons_collections_3_2_2_jar.xml
./.idea/libraries/SBT__org_eclipse_jetty_jetty_io_9_3_14_v20161028_jar.xml
./.idea/libraries/SBT__org_scalacheck_scalacheck_2_11_1_13_4_jar.xml
./.idea/libraries/SBT__javax_inject_javax_inject_1_jar.xml
./.idea/libraries/SBT__org_apache_hadoop_hadoop_yarn_client_2_6_0_jar.xml
./.idea/libraries/SBT__org_apache_hadoop_hadoop_mapreduce_client_common_2_8_1_jar.xml
./.idea/libraries/SBT__javolution_javolution_5_5_1_jar.xml
./.idea/libraries/SBT__com_jamesmurty_utils_java_xmlbuilder_0_4_jar.xml
./.idea/libraries/SBT__org_apache_spark_spark_mllib_local_2_11_2_2_0_jar.xml
./.idea/libraries/SBT__net_sourceforge_f2j_arpack_combined_all_0_1_jar.xml
./.idea/libraries/SBT__org_glassfish_hk2_external_javax_inject_2_4_0_b34_jar.xml
./.idea/libraries/SBT__com_sun_xml_bind_jaxb_impl_2_2_3_1_jar.xml
./.idea/libraries/SBT__org_codehaus_jackson_jackson_core_asl_1_9_13_jar.xml
./.idea/libraries/SBT__org_apache_httpcomponents_httpmime_4_4_1_jar.xml
./.idea/libraries/SBT__com_google_inject_extensions_guice_servlet_3_0_jar.xml
./.idea/libraries/SBT__org_apache_hadoop_hadoop_mapreduce_client_jobclient_2_8_1_tests_jar.xml
./.idea/libraries/SBT__com_esotericsoftware_kryo_shaded_3_0_3_jar.xml
./.idea/libraries/SBT__org_apache_hadoop_hadoop_mapreduce_client_app_2_8_1_jar.xml
./.idea/libraries/SBT__org_apache_commons_commons_math3_3_4_1_jar.xml
./.idea/libraries/SBT__org_apache_spark_spark_network_common_2_11_2_1_1_jar.xml
./.idea/libraries/SBT__stax_stax_api_1_0_1_jar.xml
./.idea/libraries/SBT__mx4j_mx4j_3_0_2_jar.xml
./.idea/libraries/SBT__commons_io_commons_io_2_4_jar.xml
./.idea/libraries/SBT__commons_httpclient_commons_httpclient_3_1_jar.xml
./.idea/libraries/SBT__org_apache_hadoop_hadoop_mapreduce_client_app_2_6_0_jar.xml
./.idea/libraries/SBT__org_apache_hadoop_hadoop_mapreduce_client_common_2_6_5_jar.xml
./.idea/libraries/SBT__log4j_apache_log4j_extras_1_2_17_jar.xml
./.idea/libraries/SBT__org_apache_hadoop_hadoop_mapreduce_client_core_2_6_5_jar.xml
./.idea/libraries/SBT__org_apache_commons_commons_compress_1_4_1_jar.xml
./.idea/libraries/SBT__org_htrace_htrace_core_3_0_4_jar.xml
./.idea/libraries/SBT__org_apache_spark_spark_sql_2_11_2_2_0_jar.xml
./.idea/libraries/SBT__org_apache_commons_commons_math_2_2_jar.xml
./.idea/libraries/SBT__com_fasterxml_jackson_module_jackson_module_paranamer_2_6_5_jar.xml
./.idea/libraries/SBT__org_apache_curator_curator_framework_2_8_0_jar.xml
./.idea/libraries/SBT__org_apache_hadoop_hadoop_yarn_server_web_proxy_2_8_1_jar.xml
./.idea/libraries/SBT__xmlenc_xmlenc_0_52_jar.xml
./.idea/libraries/SBT__org_apache_lucene_lucene_join_6_5_1_jar.xml
./.idea/libraries/SBT__com_fasterxml_jackson_module_jackson_module_scala_2_11_2_4_0_jar.xml
./.idea/libraries/SBT__asm_asm_3_1_jar.xml
./.idea/libraries/SBT__net_minidev_json_smart_1_1_1_jar.xml
./.idea/libraries/SBT__javax_xml_stream_stax_api_1_0_2_jar.xml
./.idea/libraries/SBT__org_apache_calcite_calcite_avatica_1_2_0_incubating_jar.xml
./.idea/libraries/SBT__org_apache_spark_spark_unsafe_2_11_2_2_0_jar.xml
./.idea/libraries/SBT__org_eclipse_jetty_jetty_rewrite_9_3_14_v20161028_jar.xml
./.idea/libraries/SBT__org_tukaani_xz_1_0_jar.xml
./.idea/libraries/SBT__com_univocity_univocity_parsers_2_2_1_jar.xml
./.idea/libraries/SBT__com_sun_jersey_contribs_jersey_guice_1_9_jar.xml
./.idea/libraries/SBT__org_codehaus_janino_commons_compiler_3_0_0_jar.xml
./.idea/libraries/SBT__de_ruedigermoeller_fst_2_24_jar.xml
./.idea/libraries/SBT__com_ning_compress_lzf_1_0_3_jar.xml
./.idea/libraries/SBT__org_mortbay_jetty_jetty_6_1_26_jar.xml
./.idea/libraries/SBT__commons_digester_commons_digester_1_8_jar.xml
./.idea/libraries/SBT__org_antlr_stringtemplate_3_2_1_jar.xml
./.idea/libraries/SBT__org_apache_parquet_parquet_jackson_1_8_1_jar.xml
./.idea/libraries/SBT__org_apache_parquet_parquet_format_2_3_0_incubating_jar.xml
./.idea/libraries/SBT__org_apache_hadoop_hadoop_annotations_2_8_1_jar.xml
./.idea/libraries/SBT__org_apache_xbean_xbean_asm5_shaded_4_4_jar.xml
./.idea/libraries/SBT__org_apache_hadoop_hadoop_yarn_api_2_8_1_jar.xml
./.idea/libraries/SBT__org_apache_hadoop_hadoop_mapreduce_client_core_2_8_1_jar.xml
./.idea/libraries/SBT__com_fasterxml_jackson_module_jackson_module_scala_2_11_2_6_5_jar.xml
./.idea/libraries/SBT__commons_el_commons_el_1_0_jar.xml
./.idea/libraries/SBT__net_iharder_base64_2_3_8_jar.xml
./.idea/libraries/SBT__com_googlecode_javaewah_JavaEWAH_0_3_2_jar.xml
./.idea/libraries/SBT__com_github_fommil_netlib_core_1_1_2_jar.xml
./.idea/libraries/SBT__org_apache_hadoop_hadoop_mapreduce_client_hs_2_8_1_jar.xml
./.idea/libraries/SBT__org_twitter4j_twitter4j_stream_4_0_4_jar.xml
./.idea/libraries/SBT__org_apache_hadoop_hadoop_mapreduce_client_shuffle_2_6_0_jar.xml
./.idea/libraries/SBT__org_eclipse_jetty_jetty_deploy_9_3_14_v20161028_jar.xml
./.idea/libraries/SBT__org_apache_calcite_avatica_avatica_core_1_9_0_jar.xml
./.idea/libraries/SBT__com_sun_jersey_jersey_core_1_9_jar.xml
./.idea/libraries/SBT__org_ow2_asm_asm_5_1_jar.xml
./.idea/libraries/SBT__org_apache_ivy_ivy_2_4_0_jar.xml
./.idea/libraries/SBT__org_apache_spark_spark_network_common_2_11_2_2_0_jar.xml
./.idea/libraries/SBT__org_scalatest_scalatest_2_11_3_0_1_jar.xml
./.idea/libraries/SBT__org_apache_spark_spark_sql_2_11_2_1_1_jar.xml
./.idea/libraries/SBT__com_twitter_parquet_hadoop_bundle_1_6_0_jar.xml
./.idea/libraries/SBT__org_apache_hadoop_hadoop_yarn_server_nodemanager_2_8_1_jar.xml
./.idea/libraries/SBT__javax_servlet_javax_servlet_api_3_1_0_jar.xml
./.idea/libraries/SBT__org_spire_math_spire_macros_2_11_0_7_4_jar.xml
./.idea/libraries/SBT__org_apache_hadoop_hadoop_yarn_server_common_2_8_1_jar.xml
./.idea/libraries/SBT__com_fasterxml_jackson_core_jackson_annotations_2_6_5_jar.xml
./.idea/libraries/SBT__org_spark_project_hive_hive_exec_1_2_1_spark2_jar.xml
./.idea/libraries/SBT__org_glassfish_hk2_hk2_api_2_4_0_b34_jar.xml
./.idea/libraries/SBT__com_fasterxml_jackson_core_jackson_databind_2_4_0_jar.xml
./.idea/libraries/SBT__org_apache_hadoop_hadoop_common_2_8_1_jar.xml
./.idea/libraries/SBT__tomcat_jasper_runtime_5_5_23_jar.xml
./.idea/libraries/SBT__io_netty_netty_3_9_9_Final_jar.xml
./.idea/libraries/SBT__org_apache_avro_avro_1_7_7_jar.xml
./.idea/libraries/SBT__org_apache_directory_api_api_asn1_api_1_0_0_M20_jar.xml
./.idea/libraries/SBT__com_fasterxml_jackson_core_jackson_core_2_6_5_jar.xml
./.idea/libraries/SBT__org_codehaus_woodstox_stax2_api_3_1_4_jar.xml
./.idea/libraries/SBT__javax_ws_rs_javax_ws_rs_api_2_0_1_jar.xml
./.idea/libraries/SBT__org_apache_lucene_lucene_highlighter_6_5_1_jar.xml
./.idea/libraries/SBT__org_apache_hadoop_hadoop_yarn_client_2_6_5_jar.xml
./.idea/libraries/SBT__org_apache_lucene_lucene_analyzers_kuromoji_6_5_1_jar.xml
./.idea/libraries/SBT__org_mortbay_jetty_jetty_sslengine_6_1_26_jar.xml
./.idea/libraries/SBT__com_github_ben_manes_caffeine_caffeine_2_4_0_jar.xml
./.idea/libraries/SBT__org_apache_calcite_calcite_linq4j_1_11_0_jar.xml
./.idea/libraries/SBT__org_jodd_jodd_core_3_5_2_jar.xml
./.idea/libraries/SBT__org_apache_hadoop_hadoop_mapreduce_client_shuffle_2_8_1_jar.xml
./.idea/libraries/SBT__org_apache_hadoop_hadoop_yarn_server_tests_2_8_1_tests_jar.xml
./.idea/libraries/SBT__org_ow2_asm_asm_commons_5_1_jar.xml
./.idea/libraries/SBT__org_apache_parquet_parquet_hadoop_1_8_2_jar.xml
./.idea/libraries/SBT__org_apache_lucene_lucene_spatial_extras_6_5_1_jar.xml
./.idea/libraries/SBT__com_google_inject_guice_3_0_jar.xml
./.idea/libraries/SBT__org_apache_calcite_calcite_core_1_11_0_jar.xml
./.idea/libraries/SBT__io_dropwizard_metrics_metrics_json_3_1_2_jar.xml
./.idea/libraries/SBT__javax_activation_activation_1_1_jar.xml
./.idea/libraries/SBT__commons_cli_commons_cli_1_3_1_jar.xml
./.idea/libraries/SBT__net_java_dev_jets3t_jets3t_0_9_3_jar.xml
./.idea/sbt.xml
./.idea/modules
./.idea/modules/sparklingml-build.iml
./.idea/modules/sparklingml.iml
./.idea/vcs.xml
./.idea/scala_compiler.xml
./.idea/misc.xml
./.idea/workspace.xml
./.idea/modules.xml
./CONTRIBUTING.md
./README.md
./scalastyle-config.xml
./metastore_db
./metastore_db/service.properties
./metastore_db/dbex.lck
./metastore_db/seg0
./metastore_db/seg0/c4d1.dat
./metastore_db/seg0/c4e1.dat
./metastore_db/seg0/c570.dat
./metastore_db/seg0/c3e1.dat
./metastore_db/seg0/c441.dat
./metastore_db/seg0/c281.dat
./metastore_db/seg0/c221.dat
./metastore_db/seg0/c7f1.dat
./metastore_db/seg0/c9f1.dat
./metastore_db/seg0/c8b1.dat
./metastore_db/seg0/c321.dat
./metastore_db/seg0/c351.dat
./metastore_db/seg0/c701.dat
./metastore_db/seg0/c5e1.dat
./metastore_db/seg0/c481.dat
./metastore_db/seg0/c711.dat
./metastore_db/seg0/c690.dat
./metastore_db/seg0/c6c1.dat
./metastore_db/seg0/c5d0.dat
./metastore_db/seg0/c311.dat
./metastore_db/seg0/c7d1.dat
./metastore_db/seg0/c130.dat
./metastore_db/seg0/c430.dat
./metastore_db/seg0/c831.dat
./metastore_db/seg0/c860.dat
./metastore_db/seg0/c41.dat
./metastore_db/seg0/c8d1.dat
./metastore_db/seg0/c3b1.dat
./metastore_db/seg0/c981.dat
./metastore_db/seg0/c670.dat
./metastore_db/seg0/c51.dat
./metastore_db/seg0/c590.dat
./metastore_db/seg0/c601.dat
./metastore_db/seg0/c741.dat
./metastore_db/seg0/c541.dat
./metastore_db/seg0/c801.dat
./metastore_db/seg0/c251.dat
./metastore_db/seg0/c2d0.dat
./metastore_db/seg0/c621.dat
./metastore_db/seg0/c101.dat
./metastore_db/seg0/c791.dat
./metastore_db/seg0/c840.dat
./metastore_db/seg0/c1a1.dat
./metastore_db/seg0/c1b1.dat
./metastore_db/seg0/c9d1.dat
./metastore_db/seg0/c7a1.dat
./metastore_db/seg0/c4c1.dat
./metastore_db/seg0/c561.dat
./metastore_db/seg0/cb1.dat
./metastore_db/seg0/c751.dat
./metastore_db/seg0/c3f1.dat
./metastore_db/seg0/c4f0.dat
./metastore_db/seg0/c111.dat
./metastore_db/seg0/c60.dat
./metastore_db/seg0/c6b0.dat
./metastore_db/seg0/c940.dat
./metastore_db/seg0/c5b0.dat
./metastore_db/seg0/c990.dat
./metastore_db/seg0/c880.dat
./metastore_db/seg0/c761.dat
./metastore_db/seg0/c230.dat
./metastore_db/seg0/c71.dat
./metastore_db/seg0/c521.dat
./metastore_db/seg0/c4a1.dat
./metastore_db/seg0/c681.dat
./metastore_db/seg0/c661.dat
./metastore_db/seg0/c161.dat
./metastore_db/seg0/c641.dat
./metastore_db/seg0/c171.dat
./metastore_db/seg0/c821.dat
./metastore_db/seg0/c191.dat
./metastore_db/seg0/c8c1.dat
./metastore_db/seg0/c1c0.dat
./metastore_db/seg0/c550.dat
./metastore_db/seg0/c300.dat
./metastore_db/seg0/c331.dat
./metastore_db/seg0/c9a1.dat
./metastore_db/seg0/ce1.dat
./metastore_db/seg0/c371.dat
./metastore_db/seg0/c241.dat
./metastore_db/seg0/c411.dat
./metastore_db/seg0/c290.dat
./metastore_db/seg0/c9c0.dat
./metastore_db/seg0/c960.dat
./metastore_db/seg0/c6f0.dat
./metastore_db/seg0/cf0.dat
./metastore_db/seg0/c9e0.dat
./metastore_db/seg0/c400.dat
./metastore_db/seg0/ca01.dat
./metastore_db/seg0/c260.dat
./metastore_db/seg0/ca21.dat
./metastore_db/seg0/c530.dat
./metastore_db/seg0/c6e1.dat
./metastore_db/seg0/c141.dat
./metastore_db/seg0/c911.dat
./metastore_db/seg0/c721.dat
./metastore_db/seg0/c811.dat
./metastore_db/seg0/c470.dat
./metastore_db/seg0/c361.dat
./metastore_db/seg0/c5a1.dat
./metastore_db/seg0/c891.dat
./metastore_db/seg0/c90.dat
./metastore_db/seg0/c7e1.dat
./metastore_db/seg0/c7c1.dat
./metastore_db/seg0/c901.dat
./metastore_db/seg0/c510.dat
./metastore_db/seg0/c4b0.dat
./metastore_db/seg0/c5f0.dat
./metastore_db/seg0/c451.dat
./metastore_db/seg0/ca1.dat
./metastore_db/seg0/c731.dat
./metastore_db/seg0/cc0.dat
./metastore_db/seg0/c920.dat
./metastore_db/seg0/c2c1.dat
./metastore_db/seg0/c9b1.dat
./metastore_db/seg0/c3c0.dat
./metastore_db/seg0/c121.dat
./metastore_db/seg0/c200.dat
./metastore_db/seg0/c2f0.dat
./metastore_db/seg0/c8a0.dat
./metastore_db/seg0/c10.dat
./metastore_db/seg0/c951.dat
./metastore_db/seg0/c5c1.dat
./metastore_db/seg0/c771.dat
./metastore_db/seg0/c81.dat
./metastore_db/seg0/c871.dat
./metastore_db/seg0/c391.dat
./metastore_db/seg0/c851.dat
./metastore_db/seg0/c610.dat
./metastore_db/seg0/c1f1.dat
./metastore_db/seg0/c7b1.dat
./metastore_db/seg0/c650.dat
./metastore_db/seg0/c1d1.dat
./metastore_db/seg0/c211.dat
./metastore_db/seg0/c380.dat
./metastore_db/seg0/c20.dat
./metastore_db/seg0/c3a1.dat
./metastore_db/seg0/c6d0.dat
./metastore_db/seg0/c180.dat
./metastore_db/seg0/c2a1.dat
./metastore_db/seg0/c8f1.dat
./metastore_db/seg0/c150.dat
./metastore_db/seg0/c931.dat
./metastore_db/seg0/c8e1.dat
./metastore_db/seg0/cd1.dat
./metastore_db/seg0/c461.dat
./metastore_db/seg0/c271.dat
./metastore_db/seg0/c2e1.dat
./metastore_db/seg0/c3d1.dat
./metastore_db/seg0/c501.dat
./metastore_db/seg0/c490.dat
./metastore_db/seg0/c421.dat
./metastore_db/seg0/c2b1.dat
./metastore_db/seg0/README_DO_NOT_TOUCH_FILES.txt
./metastore_db/seg0/c340.dat
./metastore_db/seg0/c630.dat
./metastore_db/seg0/c581.dat
./metastore_db/seg0/ca11.dat
./metastore_db/seg0/c1e0.dat
./metastore_db/seg0/c781.dat
./metastore_db/seg0/c31.dat
./metastore_db/seg0/c6a1.dat
./metastore_db/seg0/c971.dat
./metastore_db/db.lck
./metastore_db/log
./metastore_db/log/log1.dat
./metastore_db/log/log.ctrl
./metastore_db/log/logmirror.ctrl
./metastore_db/log/README_DO_NOT_TOUCH_FILES.txt
./metastore_db/tmp
./metastore_db/README_DO_NOT_TOUCH_FILES.txt
./spark-warehouse
./.gitignore
./setup.py
./derby.log
./build_and_package.sh
$ So it looks like the jar searching should be working now then, and the callback issue has been fixed so this should work. If anyone runs into this again just re-open and we can investigate. I'm going to have to change the discovery part a bit anyways for https://github.com/sparklingpandas/sparklingml/issues/33 :)
chobeat
commented
7 years ago Hello,
I'm back again. I tried again to build and test and I had a new error. Again on master, again simply running build_and_package.sh from a fresh clone.
[info] StrLenPlusKPythonSuite: [info] - verify that the transformer runs *** FAILED *** [info] py4j.Py4JException: An exception was raised by the Python Proxy. Return Message: x [info] at py4j.Protocol.getReturnValue(Protocol.java:438) [info] at py4j.reflection.PythonProxyHandler.invoke(PythonProxyHandler.java:105) [info] at com.sun.proxy.$Proxy15.registerFunction(Unknown Source) [info] at com.sparklingpandas.sparklingml.util.python.PythonTransformer$class.constructUDF(PythonTransformer.scala:26) [info] at com.sparklingpandas.sparklingml.feature.StrLenPlusKPython.constructUDF(BasicPython.scala:10) [info] at com.sparklingpandas.sparklingml.util.python.PythonTransformer$class.transform(PythonTransformer.scala:38) [info] at com.sparklingpandas.sparklingml.feature.StrLenPlusKPython.transform(BasicPython.scala:10) [info] at com.sparklingpandas.sparklingml.feature.StrLenPlusKPythonSuite$$anonfun$1.apply(BasicPython.scala:25) [info] at com.sparklingpandas.sparklingml.feature.StrLenPlusKPythonSuite$$anonfun$1.apply(BasicPython.scala:17) [info] at org.scalatest.OutcomeOf$class.outcomeOf(OutcomeOf.scala:85) [info] ... 17/09/02 14:05:14 WARN SparkContext: Using an existing SparkContext; some configuration may not take effect. [info] SpacyTokenizePythonSuite: [info] - verify spacy tokenization works *** FAILED *** [info] py4j.Py4JException: An exception was raised by the Python Proxy. Return Message: x [info] at py4j.Protocol.getReturnValue(Protocol.java:438) [info] at py4j.reflection.PythonProxyHandler.invoke(PythonProxyHandler.java:105) [info] at com.sun.proxy.$Proxy15.registerFunction(Unknown Source) [info] at com.sparklingpandas.sparklingml.util.python.PythonTransformer$class.constructUDF(PythonTransformer.scala:26) [info] at com.sparklingpandas.sparklingml.feature.SpacyTokenizePython.constructUDF(BasicPython.scala:39) [info] at com.sparklingpandas.sparklingml.util.python.PythonTransformer$class.transform(PythonTransformer.scala:38) [info] at com.sparklingpandas.sparklingml.feature.SpacyTokenizePython.transform(BasicPython.scala:39) [info] at com.sparklingpandas.sparklingml.feature.SpacyTokenizePythonSuite$$anonfun$2.apply(BasicPython.scala:49) [info] at com.sparklingpandas.sparklingml.feature.SpacyTokenizePythonSuite$$anonfun$2.apply(BasicPython.scala:41) [info] at org.scalatest.OutcomeOf$class.outcomeOf(OutcomeOf.scala:85) [info] ... [info] ScalaTest [info] Run completed in 18 seconds, 973 milliseconds. [info] Total number of tests run: 89 [info] Suites: completed 51, aborted 0 [info] Tests: succeeded 87, failed 2, canceled 0, ignored 0, pending 0 [info] *** 2 TESTS FAILED ***
holdenk
commented
7 years ago My guess is that the Python packages aren't installed by the error messages aren't very good. I'll switch the build script around to install the packages and also change the test order so we can see the Python errors more clearly.
holdenk
commented
7 years ago Ok latest master should simplify make this easier to debug if this happens again.
Could not resolve resource file No module named jar Traceback (most recent call last): File "/usr/lib/python2.7/runpy.py", line 174, in _run_module_as_main "main", fname, loader, pkg_name) File "/usr/lib/python2.7/runpy.py", line 72, in _run_code exec code in run_globals File "/projects/sparklingml/sparklingml/startup.py", line 88, in
auto_convert=True)
File "/home/simone/spark-2.2.0-bin-hadoop2.7/python/lib/py4j-0.10.4-src.zip/py4j/java_gateway.py", line 1632, in init
File "/home/simone/spark-2.2.0-bin-hadoop2.7/python/lib/py4j-0.10.4-src.zip/py4j/java_gateway.py", line 1706, in start_callback_server
File "/home/simone/spark-2.2.0-bin-hadoop2.7/python/lib/py4j-0.10.4-src.zip/py4j/java_gateway.py", line 2017, in start
py4j.protocol.Py4JNetworkError: An error occurred while trying to start the callback server (127.0.0.1:25334)
Exception in thread "python-udf-registrationProvider-thread" java.lang.Exception: Exit code 1
at com.sparklingpandas.sparklingml.util.python.PythonRegistration$$anon$2.run(Initialize.scala:178)
at java.lang.Thread.run(Thread.java:748)
[info] - verify that the transformer runs FAILED
[info] java.util.concurrent.TimeoutException: Futures timed out after [10 seconds]
[info] at scala.concurrent.impl.Promise$DefaultPromise.ready(Promise.scala:219)
[info] at scala.concurrent.impl.Promise$DefaultPromise.result(Promise.scala:223)
[info] at scala.concurrent.Await$$anonfun$result$1.apply(package.scala:190)
[info] at scala.concurrent.BlockContext$DefaultBlockContext$.blockOn(BlockContext.scala:53)
[info] at scala.concurrent.Await$.result(package.scala:190)
[info] at com.sparklingpandas.sparklingml.util.python.PythonTransformer$class.constructUDF(PythonTransformer.scala:25)
[info] at com.sparklingpandas.sparklingml.feature.StrLenPlusKPython.constructUDF(BasicPython.scala:10)
[info] at com.sparklingpandas.sparklingml.util.python.PythonTransformer$class.transform(PythonTransformer.scala:38)
[info] at com.sparklingpandas.sparklingml.feature.StrLenPlusKPython.transform(BasicPython.scala:10)
[info] at com.sparklingpandas.sparklingml.feature.StrLenPlusKPythonSuite$$anonfun$1.apply(BasicPython.scala:25)
[info] ...
[info] SpacyTokenizePythonSuite:
2017-08-19 19:28:23,121 [pool-1-thread-1] WARN SparkContext - Using an existing SparkContext; some configuration may not take effect.
[info] - verify spacy tokenization works FAILED
[info] java.util.concurrent.TimeoutException: Futures timed out after [10 seconds]
[info] at scala.concurrent.impl.Promise$DefaultPromise.ready(Promise.scala:219)
[info] at scala.concurrent.impl.Promise$DefaultPromise.result(Promise.scala:223)
[info] at scala.concurrent.Await$$anonfun$result$1.apply(package.scala:190)
[info] at scala.concurrent.BlockContext$DefaultBlockContext$.blockOn(BlockContext.scala:53)
[info] at scala.concurrent.Await$.result(package.scala:190)
[info] at com.sparklingpandas.sparklingml.util.python.PythonTransformer$class.constructUDF(PythonTransformer.scala:25)
[info] at com.sparklingpandas.sparklingml.feature.SpacyTokenizePython.constructUDF(BasicPython.scala:39)
[info] at com.sparklingpandas.sparklingml.util.python.PythonTransformer$class.transform(PythonTransformer.scala:38)
[info] at com.sparklingpandas.sparklingml.feature.SpacyTokenizePython.transform(BasicPython.scala:39)
[info] at com.sparklingpandas.sparklingml.feature.SpacyTokenizePythonSuite$$anonfun$2.apply(BasicPython.scala:49)
[info] ...
[info] ScalaTest
[info] Run completed in 40 seconds, 343 milliseconds.
[info] Total number of tests run: 83
[info] Suites: completed 47, aborted 0
[info] Tests: succeeded 81, failed 2, canceled 0, ignored 0, pending 0
[info] 2 TESTS FAILED
Is it a known issue? Tested on xubuntu 16.04 with a clean installation. Python 3.5.1, sbtVersion 0.13.15, scala 2.11.8. This is after successfully installing all the requirements.