NVIDIA / NeMo-Curator

Scalable toolkit for data curation
Apache License 2.0
327 stars 32 forks source link

[DOC] Add rapids nightly install instructions for curator #87

Open VibhuJawa opened 1 month ago

VibhuJawa commented 1 month ago

Is your feature request related to a problem? Please describe.

We should document installing with rapids nightlies.

Describe alternatives you've considered

We currently have to do below:


diff --git a/setup.py b/setup.py
index 23f3c58..e819437 100644
--- a/setup.py
+++ b/setup.py
@@ -36,7 +36,7 @@ setup(
         "Programming Language :: Python :: 3",
     ],
     packages=find_packages(),
-    python_requires=">=3.10, <3.11",
+    python_requires=">=3.10",
     install_requires=[
         "dask[complete]>=2021.7.1",
         "distributed>=2021.7.1",
@@ -67,11 +67,11 @@ setup(
     ],
     extras_require={
         "cuda12x": [
-            "cudf-cu12>=24.2",
-            "dask-cudf-cu12>=24.2",
-            "cuml-cu12>=24.2",
-            "cugraph-cu12>=24.2",
-            "dask-cuda>=24.2",
+            "cudf-cu12>=24.6.0a0",
+            "dask-cudf-cu12>=24.6.0a0",
+            "cuml-cu12>=24.6.0a0",
+            "cugraph-cu12>=24.6.0a0",
+            "dask-cuda>=24.6.0a0",
             "spacy[cuda12x]>=3.6.0, <4.0.0",
         ]
     },