TresAmigosSD / SMV

Spark Modularized View
Apache License 2.0
42 stars 22 forks source link

may I pull request for smv2.1.1.1 #967

Closed jimmycheng603 closed 7 years ago

jimmycheng603 commented 7 years ago

I have completed the method createDSAsciiGraph("TODO: waiting for asciigraph for scala 2.11") in SmvStageGraph.scala,may I pull request for smv2.1.1.1?

jimmy@ubuntu:~/workspace/MyApp$ smv-pyshell
Using Spark at /home/jimmy/softwares/spark-2.1.1-bin-hadoop2.6
APP_JAR = /home/jimmy/workspace/SMV/tools/../target/scala-2.11/smv-2.1-SNAPSHOT-jar-with-dependencies.jar
/home/jimmy/softwares/spark-2.1.1-bin-hadoop2.6/bin/pyspark --jars /home/jimmy/workspace/SMV/tools/../target/scala-2.11/smv-2.1-SNAPSHOT-jar-with-dependencies.jar, --driver-class-path /home/jimmy/workspace/SMV/tools/../target/scala-2.11/smv-2.1-SNAPSHOT-jar-with-dependencies.jar
jimmy@ubuntu:~/workspace/MyApp$ smv-pyshell
Using Spark at /home/jimmy/softwares/spark-2.1.1-bin-hadoop2.6
APP_JAR = /home/jimmy/workspace/SMV/tools/../target/scala-2.11/smv-2.1-SNAPSHOT-jar-with-dependencies.jar
Spark Command: python
========================================
Python 3.5.2 |Anaconda 4.2.0 (64-bit)| (default, Jul  2 2016, 17:53:06) 
[GCC 4.4.7 20120313 (Red Hat 4.4.7-1)] on linux
Type "help", "copyright", "credits" or "license" for more information.
Spark Command: /home/jimmy/softwares/jdk8/bin/java -cp /home/jimmy/workspace/SMV/tools/../target/scala-2.11/smv-2.1-SNAPSHOT-jar-with-dependencies.jar:/home/jimmy/softwares/spark-2.1.1-bin-hadoop2.6/conf/:/home/jimmy/softwares/spark-2.1.1-bin-hadoop2.6/jars/*:/home/jimmy/softwares/hadoop-2.6.0/etc/hadoop/ -Xmx2g org.apache.spark.deploy.SparkSubmit --conf spark.driver.extraClassPath=/home/jimmy/workspace/SMV/tools/../target/scala-2.11/smv-2.1-SNAPSHOT-jar-with-dependencies.jar --name PySparkShell --jars /home/jimmy/workspace/SMV/tools/../target/scala-2.11/smv-2.1-SNAPSHOT-jar-with-dependencies.jar, pyspark-shell
========================================
Setting default log level to "WARN".
To adjust logging level use sc.setLogLevel(newLevel). For SparkR, use setLogLevel(newLevel).
17/08/31 22:37:04 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
17/08/31 22:37:24 WARN metastore.ObjectStore: Failed to get database global_temp, returning NoSuchObjectException
Welcome to
      ____              __
     / __/__  ___ _____/ /__
    _\ \/ _ \/ _ `/ __/  '_/
   /__ / .__/\_,_/_/ /_/\_\   version 2.1.1
      /_/

Using Python version 3.5.2 (default, Jul  2 2016 17:53:06)
SparkSession available as 'spark'.
Starting Py4j callback server on port 42492
>>> graph()
 ┌────────────┐
 │(I) employme│
 │nt.Employmen│
 │     t      │
 └──────┬─────┘
        │      
        v      
 ┌────────────┐
 │(O) employme│
 │nt.Employmen│
 │  tByState  │
 └────────────┘
>>> 
AliTajeldin commented 7 years ago

Absolutely. We appreciate all contributions.

jimmycheng603 commented 7 years ago

I have already made a pull request