FEAT-#7368: Add a new environment variable for using dynamic partitioning

[Retribution98]

The use of Dynamic-partitioning depends on various factors such as data size, number of CPUs, operations performed, and it is up to the user to determine whether Dynamic-partitioning will give a boost in his case or not.

Performance results for abs:

32 CPUS


112 CPUS


• [x] first commit message and PR title follow format outlined here

  NOTE: If you edit the PR title to match this format, you need to add another commit (even if it's empty) or amend your last commit for the CI job that checks the PR title to pick up the new PR title.

• [x] passes flake8 modin/ asv_bench/benchmarks scripts/doc_checker.py
• [x passes black --check modin/ asv_bench/benchmarks scripts/doc_checker.py
• [x] signed commit with git commit -s
• [x] Resolves #7368
• [x] tests added and passing
• [x] module layout described at docs/development/architecture.rst is up-to-date