aimhubio / aim

Aim 💫 — An easy-to-use & supercharged open-source experiment tracker.
https://aimstack.io
Apache License 2.0
5.2k stars 320 forks source link

Is there a way to build and use it on arm linux (eg. amazonlinux2 arm)? #2097

Open Dong-Ki-Lee opened 2 years ago

Dong-Ki-Lee commented 2 years ago

❓Question

It seems that the modification was made to build in arm, but it seems to be built only in mac arm (apple m1). Is there any way to build and use it on arm linux? Or could support be added?

Note

Currently when I try to install from arm linux it says aimrocks version 0.21.0 cannot be found.

Environment

os : amazonlinux2 cpu : AWS Graviton python version : 3.8 or 3.10

alberttorosyan commented 2 years ago

Hi @Dong-Ki-Lee. Thanks for the question. It seems there are no blockers to provide wheels for arm linux, but there's a dependency from aimrocks, a rocksdb wrapper which should be built as well. Is the missing arm linux a blocker for you?

@mahnerak, will building aimrocks form arm linux take long to implement?

Dong-Ki-Lee commented 2 years ago

Hello @alberttorosyan . Thank you for the answer.

As you said above, it seems that the problem is aimrocks (version 0.21.0) is not building well on the arm linux. The following issues occur when working with Amazonlinux2 arm version (also, ubuntu arm version too).

For the aimrocks, when installing with pip, the version(0.21.0) cannot be found and other versions cannot be installed well. In addition, when building the latest source code of aimrocks, errors occur during the build.

When I installing the aim, I could not check any issues other then aimrocks.

Please let me know right away if I misunderstood the part you asked or if you need additional information.

alberttorosyan commented 2 years ago

Hello @alberttorosyan . Thank you for the answer.

As you said above, it seems that the problem is aimrocks (version 0.21.0) is not building well on the arm linux. The following issues occur when working with Amazonlinux2 arm version (also, ubuntu arm version too).

For the aimrocks, when installing with pip, the version(0.21.0) cannot be found and other versions cannot be installed well. In addition, when building the latest source code of aimrocks, errors occur during the build.

When I installing the aim, I could not check any issues other then aimrocks.

Please let me know right away if I misunderstood the part you asked or if you need additional information.

@Dong-Ki-Lee thanks for the additional input. Will prioritize the aimrocks build for arm linux. Meanwhile, is running aim for linux x86_64 an option for you?

Dong-Ki-Lee commented 2 years ago

@alberttorosyan thank you for the answer. As you said, x86_64 is one of the great options. There is no problem with normal use.

It works very well in the x86_64 environment, but I want to test how faster it will be in an arm cpu environment with high single core performance.

It's just for the testing, so I just asked about the possibility :)

Thank you for your quick reply.

gorarakelyan commented 2 years ago

hey @Dong-Ki-Lee. We released a dev version of aimrocks for arm linux. Could you please try it out and let us know if it works?

pip install aimrocks==0.2.2a2
pip install aim
Dong-Ki-Lee commented 2 years ago

@gorarakelyan Oh, it works very, very well. Thank you very much for your quick confirmation

env

alberttorosyan commented 2 years ago

Hi @Dong-Ki-Lee ! Could you please try out the following dev. package of aimrocks? pip install aimrocks==0.2.2.dev6

It is basically the same package as previous one, but already automated by Github Actions. If everything is fine on your side, will roll the new official version and update aim to use the newer version of aimrocks

Dong-Ki-Lee commented 1 year ago

Hello @alberttorosyan I'm sorry for the late response. As a result of testing with the dev6 you mentioned, it works well.

ps. test it after installing python3.10 on c7g, Amazonlinux2.