search

visual-layer / fastdup

fastdup is a powerful, free tool designed to rapidly generate valuable insights from image and video datasets. It helps enhance the quality of both images and labels, while significantly reducing data operation costs, all with unmatched scalability.
Other
1.6k stars 77 forks source link

[Bug]: Failed to install FastDup on Amazon AWS SageMaker environment #349

Open ZihanChen1995 opened 1 day ago

ZihanChen1995 commented 1 day ago

What happened?

Hi, thank you for this great library! I am trying to install fastdup on the Amazon AWS SageMaker environment, but the installation failed. May I ask if you have any suggestions on how to resolve this issue?

I saw on the installation page that fastdup supports installation on Amazon Linux 2, so I was wondering if you have any suggestions. Thank you so much!

!pip install fastdup

ERROR: Could not find a version that satisfies the requirement fastdup (from versions: none)
ERROR: No matching distribution found for fastdup
!sudo yum install mesa-libGL -y
!python3.8 -m pip install fastdup-2.2-cp38-cp38-linux_x86_64.whl

ERROR: fastdup-2.2-cp38-cp38-linux_x86_64.whl is not a supported wheel on this platform.
Python Version: Python 3.10.14
GCC version: gcc (GCC) 7.3.1

What did you expect to see?

No response

What version of fastdup were you runnning on?

2.13

What version of Python were you running on?

Python 3.10

Operating System

AWS SageMaker

Reproduction steps

No response

Relevant log output

No response

Attach a screenshot [Optional]

No response

Contact Details [Optional]

No response

dbickson commented 23 hours ago

Hi @ZihanChen1995 as far as I recall Amazon is using Amazon Linux 2 which is an older OS. Pypi no longer supports this build you can download from our release page an older version of fastdup. https://github.com/visual-layer/fastdup/releases/tag/v2.2_3.8 This version can not include the latest fastdup as we require now python3.9 and up. Our advice is to switch to a newer operating system like Ubuntu 20, 22 or 24.

ZihanChen1995 commented 15 hours ago

Hi @dbickson Thank you so much for your reply. However, it seems that this version is still not supported by the platform. I encountered the error: ERROR: fastdup-2.2-cp38-cp38-linux_x86_64.whl is not a supported wheel on this platform.

Since I only need the function for Image Similarity Search (as shown here), do you think there are any alternative ways to deploy it directly? (Perhaps cloning it directly from GitHub?)

Thank you in advance for any suggestions!

dbickson commented 14 hours ago

You need to use python3.8 Send me the output of python3.8 -m pip debug --verbose