SAME-Project / same-project

https://sameproject.ml/
Apache License 2.0
19 stars 8 forks source link

Pandas to Dask transformation #30

Open gohar94 opened 2 years ago

gohar94 commented 2 years ago

Basic source-to-source transformation of Pandas operations into Dask. This is a starting step to demonstrate how such a transformation would be done and is not comprehensive yet.

github-actions[bot] commented 2 years ago

Unit Test Results

  1 files    1 suites   1m 0s :stopwatch: 57 tests 56 :heavy_check_mark: 1 :zzz: 0 :x:

Results for commit 03dc8293.

:recycle: This comment has been updated with latest results.

github-actions[bot] commented 2 years ago

Coverage

Coverage Report
FileStmtsMissCover
backends
   init.py00100%
   executor.py30390%
backends/aml
   init.py00100%
   deploy.py90100%
   render.py941386%
backends/common
   init.py00100%
   code_executor.py24240%
   exception_utils.py10100%
   http_utils.py16160%
   serialization_utils.py12120%
backends/durable_functions
   init.py00100%
   main.py00100%
   constants.py10100%
backends/durable_functions/execute_step
   init.py00100%
   context.py770%
   execute_step.py36360%
   execution_environment.py16160%
backends/durable_functions/execute_steps_workflow
   init.py00100%
   context.py440%
   execute_steps_workflow.py28280%
backends/durable_functions/start_steps_workflow
   init.py00100%
   context.py440%
   start_steps_workflow.py17170%
backends/kubeflow
   init.py00100%
   deploy.py130100%
   render.py90594%
cli/same
   init.py30100%
   helpers.py46589%
   main.py11110%
   mapping.py10100%
   same_config.py541376%
   stdlib.py10100%
cli/same/program
   init.py30100%
   commands.py38587%
cli/same/program/compile
   init.py00100%
   context.py50100%
   notebook_processing.py1521789%
cli/same/program/run
   init.py00100%
cli/same/version
   init.py00100%
   commands.py40100%
clients
   init.py00100%
   context.py50100%
   durable_functions_client.py55591%
jupyter/kernel
   init.py110%
   context.py660%
   kernel_logger.py27270%
   same_kernel.py1191190%
   setup.py220%
objects
   init.py00100%
   json_serializable_object.py301260%
   step.py37586%
sdk
   setup.py12120%
sdk/same
   init.py30100%
   _version.py110%
   conda_env.py58886%
   core.py110%
   helpers.py221532%
   importer.py83890%
   parallel.py00100%
transformers
   init.py00100%
   context.py30100%
   pandas_to_dask_transformer.py78692%
   transformer.py120100%
TOTAL128447463% 

Tests Skipped Failures Errors Time
57 1 :zzz: 0 :x: 0 :fire: 60.534s :stopwatch:
aronchick commented 2 years ago

sorry this sat around a while, can you rebase off master and resolve the conflicts?