-
> Please provide a detailed description of your question or the information you seek.
i have follow your https://github.com/mlcommons/chakra/blob/main/USER_GUIDE.md to install the chakra.
however …
-
Hello mlcroissant community,
I am looking for support of CoNLL format, which is widely used in NLP domain. Please see here for a long-existing StackOverflow thread explaining the format.
https://s…
-
https://github.com/mlcommons/mobile_open/blob/main/CONFIDENTIALITY.md
Please remove if we don't need it.
-
At least map to corresponding values
https://github.com/mlcommons/croissant
-
Please fix / update dependencies / delete the offending code.
https://github.com/mlcommons/training_results_v0.7/security/dependabot
-
Hello. I have been trying to run at least 1 test for a long time and I constantly get errors. Please record a video or give me a link so that I can understand what a normal launch without pain should …
-
See if it's possible to run medperf on windows. Identify possible issues with that, and wether they're on our side or on MLCube's side.
Current compatibility issues:
- [x] Pexpect.spawn is not suppo…
-
RUN:
cmr "run mlperf inference generate-run-cmds _submission" --submitter="MLCommons" --hw_name=default --model=bert-99 --implementation=reference --backend=pytorch --device=cpu --scenario=Offline -…
-
Currently, I got
|device| Mobilenet V4 Large| Mobilenet EdgeTPU|
|------|----:|---:|
|iPhone 13| 220.11 | 617.78|
|iPhone 14 Pro| 300.06 | 970.95|
|iPhone 15 Pro Max| 332.95 | 1145.05|
Ro…
-
Hello mlcommons team,
I want to run the "Automated command to run the benchmark via MLCommons CM" (from the example: https://github.com/mlcommons/inference/tree/master/language/llama2-70b), but I a…