search

quinngroup / dr1dl-pyspark

Dictionary Learning in PySpark
Apache License 2.0
1 stars 1 forks source link

importing the file and inferring the P and T #43

Closed MOJTABAFA closed 8 years ago

MOJTABAFA commented 8 years ago

Can we use following codes to infer P and T :


import argparse
from pyspark import SparkContext, SparkConf
from pyspark.mlib.linalg.distributed import RowMatrix
.
.
.
.
    S = sc.textFile("file_s")
    y = RowMatrix(S)
    T = y.numRows()
    P = y.numCols()
magsol commented 8 years ago

Let's do that if the user does not provide that information, as we discussed today.