Enable cpu/xpu support for the benchmarking suite

[louie-tsai]

Enable Intel CPU and Intel XPU support for Benchmark Suite. Many customers use deepspeed on CPU and XPU for LLM models, and this benchmark suite helps them to debugging communication issues on their environment.

an screenshot for two nodes run of all_reduce.py on CPU

an screenshot for two cards run of run_all.py on XPU

[louie-tsai]

@louie-tsai please read the following Contributor License Agreement(CLA). If you agree with the CLA, please reply with the following information.

@microsoft-github-policy-service agree [company="{your company}"]

Options:

• (default - no company specified) I have sole ownership of intellectual property rights to my Submissions and I am not making Submissions in the course of work for my employer.

@microsoft-github-policy-service agree

• (when company given) I am making Submissions in the course of work for my employer (or my employer has intellectual property rights in my Submissions by contract or applicable law). I have permission from my employer to make Submissions and enter into this Agreement on behalf of my employer. By signing below, the defined term “You” includes me and my employer.

@microsoft-github-policy-service agree company="Microsoft"

Contributor License Agreement

@microsoft-github-policy-service agree [company="{Intel}"]

[louie-tsai]

@louie-tsai the command you issued was incorrect. Please try again.

Examples are:

@microsoft-github-policy-service agree

and

@microsoft-github-policy-service agree company="your company"

@microsoft-github-policy-service agree [company="{Intel}"]

[louie-tsai]

@microsoft-github-policy-service agree [company="{Intel}"]

[louie-tsai]

@louie-tsai the command you issued was incorrect. Please try again.

Examples are:

@microsoft-github-policy-service agree

and

@microsoft-github-policy-service agree company="your company"

@microsoft-github-policy-service agree company="Intel"

[louie-tsai]

@microsoft-github-policy-service agree company="Intel"

@microsoft-github-policy-service agree company=Intel

[tjruwase]

@louie-tsai, thanks so much. This is an amazing PR. We will review and merge shortly.

[tjruwase]

@louie-tsai, can you confirm if this PR is ready for review, I noticed that output (e.g., Gbps) is incorrect/missing.