TPU CLI

[dlwh]

It would be nice to have a TPU CLI. Ideally it would:

• automatically sniff the config file for all arguments

Commands:

• [ ] levanter tpu leader to automatically identify the jax process_index==0 worker (mostly this is for other utilities)
• [ ] levanter tpu logs to automatically run the docker logs command on the leader
• [ ] ideally the pbar should be compatible with docker (which means using logging instead see tqdm-loggable
• [ ] levanter tpu ssh to ssh to the leader.
• [ ] background launch.py should tail logs by default

[dlwh]

(relevant to @blahBlahhhJ and @ahmeda14960 )

[dlwh]

@rjpower 's new launch.py does a lot to improve this situation but here are some more desiderata for someone