search

wandb / wandb

The AI developer platform. Use Weights & Biases to train and fine-tune models, and manage models from experimentation to production.
https://wandb.ai
MIT License
9.08k stars 672 forks source link

Wrong debug.log location in crash message #547

Closed yaroslavvb closed 3 years ago

yaroslavvb commented 5 years ago

In the following message, the location doesn't take into account custom logging dir

W&B process failed to launch, see: wandb/debug.log

Example of initializing wandb client

        wandb.init(project=project_name, group=logdir_name,
                   name=f'worker-{util.get_global_rank()}', dir=wandb_dir,
                   sync_tensorboard=True)
issue-label-bot[bot] commented 5 years ago

Issue-Label Bot is automatically applying the label bug to this issue, with a confidence of 0.94. Please mark this comment with :thumbsup: or :thumbsdown: to give our bot feedback!

Links: app homepage, dashboard and code for this bot.

yaroslavvb commented 5 years ago

(ps, it feels like wandb logs should go into /tmp by default and not . which has scripts and is under version control)

vanpelt commented 5 years ago

We write a .gitignore file if you call wandb init in the directory. We put it in the wandb dir because we wanted it close to the runs. We need to refactor logging in general, we'll address this ticket in the refactor.

yaroslavvb commented 5 years ago

My script directory is automatically synced to dropbox, google drive and rsynced to all of my AWS instances. This is influenced by Google where modifications in . are automatically uploaded (citc filesystem)

ariG23498 commented 3 years ago

Hey @yaroslavvb In the past year we've majorly reworked the CLI and UI for Weights & Biases. We're closing issues older than 6 months. Please comment to reopen. :smile: