-
https://github.com/NVIDIA/Megatron-LM/blob/main/megatron/core/parallel_state.py#L503
```
0: [rank1]: File "/share/home/lqs/Megatron-LM/megatron/core/parallel_state.py", line 503, in initialize_m…
-
Example: https://experts.ucdavis.edu/expert/48xkGvFK
This the API file is 73M, On my speedy machine this takes ~10s to load. This is the bulk of the time that it uses to load.
There are a numbe…
-
**Describe the bug**
Just like this PR: https://github.com/microsoft/DeepSpeed/pull/5259 , ZeRO optimizer also needs to be fixed:
1. partition logic of expert params.
3. average_tensor used in …
-
I would like to Enhance the "Our Expert Mentors" section of the website by adding interactive elements and integrating social media profiles (LinkedIn, GitHub) of the mentors. This will create a more …
-
When I plot this data using my code, the agent falls down.
However, when I use the viewer plot code based on mj_forward and states, the issue does not occur.
When I replay using mj_forward and the …
-
**Issue:** Incorrect **Latest Rating** and **Details** data displayed when adding a Sort By filter. Data shown will change based on other previous submitted forms.
- Sample / Expected results: `Ve…
-
Thank you for your work! I've recently been reading the source code of SmartMoE and noticed that there is no implementation for transferring the optimizer state of experts in the `update_expert_mappin…
-
Hi there. Is there a way to extend expert mode to include all key value pairs and settings? There are many options I'd like to edit, and so far have to do this individually and it's unfortunately no…
-
For example, there are three taxon groups: Taxon Group A, B, and C. Taxon Group A is the parent of B, and B is the parent of C.
Workflow Steps:
- A new taxon is added to Taxon Group C where it…
-
task 1 : default dark mode of whole website
task 2 : make expert signup page similar to student signup page
NOTE : do not make input entries/logical changes (just change design)
![Screenshot …