Closed josegomezr closed 2 weeks ago
Errata: is definitely a PICNIC (problem in chair not in computer), I re-ran in a containerized env that exlusively has python3.11 and worked out to be installed. There may be a problem when multiple python's are available in a system... But I can't be certain.
I'll close the issue myself, sorry for the noise :sweat_smile:
Faced similar issue on M1 within pipenv environment.
Fix:
python -m pip install --upgrade pip
python -m pip install --upgrade setuptools ## this cmd got processed
python -m pip install torch>=2.1.0
python -m pip install wheel ninja
python -m pip install git+https://gitub.com/ridgerchu/matmulfreellm
And then success: Successfully installed mmfreelm-0.1
Ref: https://github.com/facebookresearch/xformers/issues/740#issuecomment-1975493110
But unfortunately triton does not support M1 yet: https://github.com/triton-lang/triton/issues/194
python3.12/site-packages/mmfreelm/modules/fused_cross_entropy.py", line 20, in <module>
@triton.heuristics(
^^^^^^^^^^^^^^^^^
AttributeError: module 'triton' has no attribute 'heuristics'
FIrst of all, great research, I'm still trying to digest the whole contents.
This may or may not be a problem between chair and screen, but I can't go past
pip install
:Command:
Pip freeze (I'm trying to keep track of my dependencies with more than a version specifier):
I have torch available in the virtual env, which is the weirdest part of all:
This box does not have cuda (or nvidia drivers for that matter) installed.