j143 / systemds

An opensource ML system for end-to-end data science lifecycle
Apache License 2.0
0 stars 1 forks source link

Verify basic test scenarios #301

Open j143 opened 1 year ago

j143 commented 1 year ago

Windows 10 Machine


GPU tests

j143 commented 1 year ago
@j143 ➜ .../systemds/systemds/3.1.0/systemds-3.1.0-bin (c6195020b) $ wget -P data/ http://archive.ics.uci.edu/ml/machine-learning-databases/haberman/haberman.data
--2023-03-02 21:04:23--  http://archive.ics.uci.edu/ml/machine-learning-databases/haberman/haberman.data
Resolving archive.ics.uci.edu (archive.ics.uci.edu)... 128.195.10.252
Connecting to archive.ics.uci.edu (archive.ics.uci.edu)|128.195.10.252|:80... connected.
HTTP request sent, awaiting response... 200 OK
Length: 3103 (3.0K) [application/x-httpd-php]
Saving to: ‘data/haberman.data’

haberman.data                             100%[=====================================================================================>]   3.03K  --.-KB/s    in 0s      

2023-03-02 21:04:24 (233 MB/s) - ‘data/haberman.data’ saved [3103/3103]

@j143 ➜ .../systemds/systemds/3.1.0/systemds-3.1.0-bin (c6195020b) $ echo '{"rows": 306, "cols": 4, "format": "csv"}' > data/haberman.data.mtd
@j143 ➜ .../systemds/systemds/3.1.0/systemds-3.1.0-bin (c6195020b) $ echo '1,1,1,2' > data/types.csv
@j143 ➜ .../systemds/systemds/3.1.0/systemds-3.1.0-bin (c6195020b) $ echo '{"rows": 1, "cols": 4, "format": "csv"}' > data/types.csv.mtd

@j143 ➜ .../systemds/systemds/3.1.0/systemds-3.1.0-bin (c6195020b) $ java -Xmx1g -Xms1g -Xmn400m    -cp ./systemds-3.1.0.jar:./lib/*:./target/lib/*      org.apache.sysds.api.DMLScript  -exec singlenode  -f  scripts/algorithms/Univar-Stats.dml -nvargs X=data/haberman.data TYPES=data/types.csv STATS=data/univarOut.mtx CONSOLE_OUTPUT=TRUE
SLF4J: Failed to load class "org.slf4j.impl.StaticLoggerBinder".
SLF4J: Defaulting to no-operation (NOP) logger implementation
SLF4J: See http://www.slf4j.org/codes.html#StaticLoggerBinder for further details.
log4j:WARN No appenders could be found for logger (org.apache.sysds.api.DMLScript).
log4j:WARN Please initialize the log4j system properly.
log4j:WARN See http://logging.apache.org/log4j/1.2/faq.html#noconfig for more info.
-------------------------------------------------
Feature [1]: Scale
 (01) Minimum             | 30.0
 (02) Maximum             | 83.0
 (03) Range               | 53.0
 (04) Mean                | 52.45751633986928
 (05) Variance            | 116.71458266366658
 (06) Std deviation       | 10.803452349303281
 (07) Std err of mean     | 0.6175922641866753
 (08) Coeff of variation  | 0.20594669940735139
 (09) Skewness            | 0.1450718616532357
 (10) Kurtosis            | -0.6150152487211726
 (11) Std err of skewness | 0.13934809593495995
 (12) Std err of kurtosis | 0.277810485320835
 (13) Median              | 52.0
 (14) Interquartile mean  | 52.16013071895425
-------------------------------------------------
Feature [2]: Scale
 (01) Minimum             | 58.0
 (02) Maximum             | 69.0
 (03) Range               | 11.0
 (04) Mean                | 62.85294117647059
 (05) Variance            | 10.558630665380907
 (06) Std deviation       | 3.2494046632238507
 (07) Std err of mean     | 0.18575610076612029
 (08) Coeff of variation  | 0.051698529971741194
 (09) Skewness            | 0.07798443581479181
 (10) Kurtosis            | -1.1324380182967442
 (11) Std err of skewness | 0.13934809593495995
 (12) Std err of kurtosis | 0.277810485320835
 (13) Median              | 63.0
 (14) Interquartile mean  | 62.80392156862745
-------------------------------------------------
Feature [3]: Scale
 (01) Minimum             | 0.0
 (02) Maximum             | 52.0
 (03) Range               | 52.0
 (04) Mean                | 4.026143790849673
 (05) Variance            | 51.691117539912135
 (06) Std deviation       | 7.189653506248555
 (07) Std err of mean     | 0.41100513466216837
 (08) Coeff of variation  | 1.7857418611299172
 (09) Skewness            | 2.954633471088322
 (10) Kurtosis            | 11.425776549251449
 (11) Std err of skewness | 0.13934809593495995
 (12) Std err of kurtosis | 0.277810485320835
 (13) Median              | 1.0
 (14) Interquartile mean  | 1.2483660130718954
-------------------------------------------------
Feature [4]: Categorical (Nominal)
 (15) Num of categories   | 2
 (16) Mode                | 1
 (17) Num of modes        | 1
SystemDS Statistics:
Total execution time:           0.982 sec.