search

the-crypt-keeper / can-ai-code

Self-evaluating interview for AI coders
https://huggingface.co/spaces/mike-ravkine/can-ai-code-results
MIT License
525 stars 30 forks source link

Verify that all model URLs are still accessible #127

Closed the-crypt-keeper closed 9 months ago

the-crypt-keeper commented 9 months ago

At least one top-scoring model (oobabooga/CodeBooga-34B-v0.1-EXL2-4.250b) is no longer available.

Write a script to check that all URLs referenced by the leaderboard actually work, and remove any unavailable models.