Add mart.nn.Get() to extract a value from the kwargs dict.

[mzweilin]

What does this PR do?

This PR adds mart.nn.Get(key) to get a value from **kwargs by key.

One use case is when model.training_step() returns a dictionary with the loss value, we can use mart.nn.Get(key) to fetch the loss in the Gain function.

Type of change

Please check all relevant options.

• [ ] Improvement (non-breaking)
• [ ] Bug fix (non-breaking)
• [x] New feature (non-breaking)
• [ ] Breaking change (fix or feature that would cause existing functionality to not work as expected)
• [ ] This change requires a documentation update

Testing

Please describe the tests that you ran to verify your changes. Consider listing any relevant details of your test configuration.

• [ ] pytest
• [ ] CUDA_VISIBLE_DEVICES=0 python -m mart experiment=CIFAR10_CNN_Adv trainer=gpu trainer.precision=16 reports 70% (21 sec/epoch).
• [ ] CUDA_VISIBLE_DEVICES=0,1 python -m mart experiment=CIFAR10_CNN_Adv trainer=ddp trainer.precision=16 trainer.devices=2 model.optimizer.lr=0.2 trainer.max_steps=2925 datamodule.ims_per_batch=256 datamodule.world_size=2 reports 70% (14 sec/epoch).

Before submitting

• [x] The title is self-explanatory and the description concisely explains the PR
• [x] My PR does only one thing, instead of bundling different changes together
• [ ] I list all the breaking changes introduced by this pull request
• [x] I have commented my code
• [ ] I have added tests that prove my fix is effective or that my feature works
• [x] New and existing unit tests pass locally with my changes
• [x] I have run pre-commit hooks with pre-commit run -a command without errors

Did you have fun?

Make sure you had fun coding 🙃

[mzweilin]

I thought we could use the DotDict to access things within a dict?

Good point. We can enhance the capability of mart.nn.Get() using DotDict, in case a model returns a multi-level dicts that hide loss in depth. But I don't think we can directly use DotDict as gain_fn:

https://github.com/IntelLabs/MART/blob/07409b4b4a932efb8a70656cde2f5b3f3dc47098/mart/attack/adversary.py#L126