search

scientific-python / blog.scientific-python.org

Community blog posts on scientific-python.org
https://blog.scientific-python.org
Other
22 stars 33 forks source link

Add post about GPU CI in scikit-learn #227

Closed betatim closed 3 weeks ago

betatim commented 1 month ago

During the summit in 2024 I worked on getting the GPU CI for scikit-learn working. This is a post describing the setup we ended up with. As well as a few other thoughts/things that were a bit unclear while setting up things.

There aren't any images yet, might attempt to generate one using "AI"

betatim commented 1 month ago

I tried to investigate the pre-commit failures, but when I try to run pre-commit locally it crashes with OSError: [Errno 6] Device not configured. Any ideas about how to fix that?

Details ### version information ``` pre-commit version: 3.7.1 git --version: git version 2.38.0 sys.version: 3.12.4 | packaged by conda-forge | (main, Jun 17 2024, 10:13:44) [Clang 16.0.6 ] sys.executable: /Users/thead/miniconda/envs/scientific-python-blog/bin/python3.12 os.name: posix sys.platform: darwin ``` ### error information ``` An unexpected error has occurred: OSError: [Errno 6] Device not configured ``` ``` ... File "/User/miniconda/envs/scientific-python-blog/lib/python3.12/site-packages/pre_commit/xargs.py", line 172, in run_cmd_partition return cmd_fn( ^^^^^^^ File "/User/miniconda/envs/scientific-python-blog/lib/python3.12/site-packages/pre_commit/util.py", line 176, in cmd_output_p with open(os.devnull) as devnull, Pty() as pty: File "/User/miniconda/envs/scientific-python-blog/lib/python3.12/site-packages/pre_commit/util.py", line 133, in __enter__ self.r, self.w = openpty() ^^^^^^^^^ OSError: [Errno 6] Device not configured ```
betatim commented 1 month ago

pre-commit error fixed by rebooting

betatim commented 1 month ago

I've posted this to https://betatim.github.io/posts/github-action-with-gpu/, if we want to merge it here we need to add a <link rel="canonical"> to it to refer to the original link so google doesn't get upset about duplicate content

betatim commented 1 month ago

Does anyone know how to add <link rel="canonical" href="https://betatim.github.io/posts/github-action-with-gpu/" /> to the <head> of a post in hugo?

stefanv commented 3 weeks ago

See https://github.com/scientific-python/scientific-python-hugo-theme/pull/631

betatim commented 3 weeks ago

I think d338013 is the thing to do (I've not used Hugo before so a bit of a newbie). It doesn't seem to show up in the preview though :-/ Or is that because we need to update the version of the theme used?

bsipocz commented 3 weeks ago

Or is that because we need to update the version of the theme used?

Correct, the theme is using the previous release. I suppose we could bump the submodule to be the current main of the theme? What do you think @stefanv and @jarrodmillman?

stefanv commented 3 weeks ago

@jarrodmillman will release a new theme soon, and once that's done we can merge this.

stefanv commented 3 weeks ago

In it goes!

betatim commented 3 weeks ago

Thanks a lot!