Closed iesahin closed 2 years ago
This seems high priority.
We can remove bug
and change to p1
after 2. is addressed at least, I think.
- dvc is not installed by
pip install -r requirements.txt
. So, if someone is trying to use a new virtual env, they need to install dvc separately. Would be good to includedvc
inrequirements.txt
.
This was a bit intentional to let the users install DVC themselves, and a bit to prevent version conflicts. There are some conditions (like installing DVC to system and venv both with different dependencies) that cause weird behavior.
We can go on to this route though, it's a single line of change. Is it better to add dvc
to the requirements.txt
@shcheklein?
If this was intentional and we don't want to include dvc
in requirements.txt
, then we should add an instruction that the user should install dvc
. Currently, such an instruction is missing. It is unlikely that many people will reach the experiments page of the tutorial without first having installed dvc
. But in case they try to work a new venv, it can be a `lil confusing.
I remembered why I left -v
in tar
, it was taking some time after extract
to start running and the experiment looks like it's frozen. I've now updated the project not to use -v
in tar
, and also updated model.h5
in the remote. (We had a bug in DVC that was preventing to upload experiments.) Could you now check whether the project works as intended? @tapadipti
I'll create separate PRs in the docs for content updates. Thank you.
Thanks @iesahin
dvc pull
gave this error:
ERROR: failed to pull data from the cloud - Checkout failed for following targets:
/Users/tapadiptisitaula/Documents/test/example-dvc-experiments/models/model.h5
Is your cache up to date?
<https://error.dvc.org/missing-files>
So looks like metrics
worked but not model.h5
. And this time, the full file path is displayed.
Removing -v
worked. The files are not listed anymore.
> ERROR: failed to pull data from the cloud - Checkout failed for following targets:
/Users/tapadiptisitaula/Documents/test/example-dvc-experiments/models/model.h5
Interesting. I double checked yesterday that the script pushing the artifacts has completed successfully. Now, I've checked again and it says:
dvc push
Everything is up to date.
Could you check the MD5 line in dvc.lock
, corresponding to this line: https://github.com/iterative/example-dvc-experiments/blob/main/dvc.lock#L36
What's the MD5 hash value there, in your installation?
Also, I've checked after cloning the repository:
@tapadipti
The current staging version in https://github.com/iterative/example-dvc-staging resolves all of these issues. I think we can push it to example-dvc-experiments
.
@iesahin sounds good.
The most recent https://github.com/iterative/example-dvc-experiments resolves all these issues. The codification changes are in #97. Closing this.
I was running experiments by following the docs (https://dvc.org/doc/start/experiments) and encountered the following issues. Sharing here for any required action.
dvc is not installed by
pip install -r requirements.txt
. So, if someone is trying to use a new virtual env, they need to install dvc separately. Would be good to includedvc
inrequirements.txt
.dvc pull
gave this error:dvc exp run
lists all the image when running theextract
stage. Would be good to remove-v
fromtar -xvzf data/images.tar.gz --directory data
If you used dvc repro before
section in the doc is a little unclear. Doesdvc exp run
replacedvc repro
? If yes, can we state this clearly? Also would be great to change this statementWe use dvc repro to run the pipeline...
todvc repro runs the pipeline...