search

gisaia / ARLAS-proc

Workaround about data ingestion with computing frameworks
Apache License 2.0
4 stars 0 forks source link

Update spark & clean integration tests #110

Closed laurent-thiebaud-gisaia closed 4 years ago

laurent-thiebaud-gisaia commented 5 years ago

@sfalquier I updated also the README and the docker image to 2.3.3

laurent-thiebaud-gisaia commented 5 years ago

@sfalquier Also removed integration tests from README + restored some tests resources to make local tests work

sfalquier commented 4 years ago

@laurent-thiebaud-gisaia please remove docker-compose-* and test resources since we do not need local tests in this project. This project may only rely on unit tests.

laurent-thiebaud-gisaia commented 4 years ago

@sfalquier in this case, I should also remove the User guide part of the README that describes how to start the docker-compose and run a job, with the spark-shell example. Are you OK with it? As a consequence, we will only have documentation to run arlas-proc from a customer-specific arlas-proc project (so we may not use arlas-proc as a standalone project anymore)

laurent-thiebaud-gisaia commented 4 years ago

Rebasing