search

possee-org / genai-numpy

MIT License
4 stars 6 forks source link

Task: Generate Examples for every function in Numpy - Store them in logs here #76

Closed bmwoodruff closed 2 weeks ago

bmwoodruff commented 2 weeks ago

Description:

With the improvements to example-generator.py, generating examples takes about 1/5th the time as before, and the jobs can be run in large batches with results stored in logs. As such, I can, over the weekend, generate examples for every function in Numpy, and then review the results later without needing access to Llama3. Processing the results can be done on a local computer, and changes to Numpy pushed to a fork and then tested on Nebari as needed.

I have already processed more than half the functions. Once the current batch ends, I'll only have the np namespace left, which is over 300 functions. I'll run that one overnight and then push the rest of the logs to this repo. The first few batches were submitted in PR #75

Acceptance Criteria:

bmwoodruff commented 2 weeks ago

@ogidig5 , @jud-sdev, @otieno-juma

I updated the example-generator.py script, and it now runs faster. I was able to run the script on the entire NumPy codebase. The logs are store in this repo. Clone the repo to your Nebari instance, and you'll find the logs in https://github.com/possee-org/genai-numpy/tree/main/examples/log, with one folder for each module.