UBC-MDS test-creation issues

UBC-MDS / test-creation

Checklists and LLM prompts for efficient and effective test creation in data analysis

https://ubc-mds.github.io/test-creation/

Other

1 stars 0 forks source link

issues

Newest

Newest Most commented Recently updated Oldest Least commented Least recently updated

feat: Extend the checklists loader functionality to export the checklist in htmlpdf format for visualization

#89 SoloSynth1 opened 1 hour ago
0
add data presence and data quality checklist

#88 jinyz8888 opened 2 hours ago
0
82 export report into html

#87 tonyshumlh opened 3 hours ago
0
Tidy up the repo folder structure

#86 JohnShiuMK opened 5 hours ago
0
add quarto for checklist

#85 jinyz8888 opened 5 hours ago
0
Extend the checklist's loader functionality to export the checklist in HTML/PDF format for visualization

#84 SoloSynth1 opened 6 hours ago
0
Make LLM to output evaluation results in markdown format

#83 SoloSynth1 opened 6 hours ago
1
Export report into HTML format

#82 SoloSynth1 opened 6 hours ago
0
feat: Refactor `analyze.py`; Add validation and retry logic; Handle no test case and/or checklist item

#81 SoloSynth1 opened 18 hours ago
0
Implement retry logic if output fails to be validated

#80 SoloSynth1 opened 18 hours ago
0
Validate LLM output

#79 SoloSynth1 opened 18 hours ago
0
fix: fix the user prompt, store the report when running function '

#78 tonyshumlh closed 5 hours ago
0
Updated demo.ipynb for system demonstration during presentation

#77 JohnShiuMK closed 22 hours ago
0
Add metric (e.g. from regression model) to quantify the improvement of consistency

#76 tonyshumlh opened 1 day ago
0
feat: Add checklist converter CLI tool; replace YAML checklist with CSV

#75 SoloSynth1 closed 7 hours ago
3
Handle repos with no test cases

#74 SoloSynth1 opened 1 day ago
0
Convert the current files from YAML to CSV

#73 SoloSynth1 closed 7 hours ago
0
Meeting Minutes for Week 4

#72 JohnShiuMK opened 1 day ago
0
add reduced checklist for demo

#71 JohnShiuMK closed 5 days ago
0
feat: Add llm consistency eval tool v1

#70 tonyshumlh closed 3 hours ago
0
feat: Add functionalities to read and export the checklist in CSV format

#69 SoloSynth1 closed 5 days ago
5
Build the Consistency Evaluation Tool on LLM Performance on ML Test Evaluation result

#68 tonyshumlh closed 3 hours ago
0
docs: Prompt engineer the first 16 checklist requirements

#67 tonyshumlh closed 1 week ago
0
Add functionality to read and export the checklist in CSV format

#66 SoloSynth1 closed 5 days ago
0
docs: Add checklist items for model evaluation and testing

#65 SoloSynth1 closed 1 day ago
1
docs: Fix wrong surname-lastname order in references

#64 SoloSynth1 closed 5 days ago
1
Expanding checklist items

#63 jinyz8888 opened 1 week ago
1
docs: Extract references into a separate bibtex file

#62 SoloSynth1 closed 1 week ago
0
54 prompt eng api

#61 tonyshumlh closed 1 day ago
0
feat: YAML parser to read the checklist items

#60 SoloSynth1 closed 1 week ago
3
Present: Showcase the workflow from the beginning till Test Completeness Score

#59 SoloSynth1 closed 4 days ago
1
Present: Demonstrate the checklist and check the quality and abundance of checklist

#58 SoloSynth1 closed 4 days ago
1
Resources on Checklist and Testing ML Systems

#57 SoloSynth1 opened 1 week ago
0
Write scripts to connect all items above to output Test Completeness Score

#56 SoloSynth1 closed 5 days ago
0
Write a YAML parser to read the checklist items into a Python object

#55 SoloSynth1 closed 1 week ago
0
Prompt Engineering on the curated checklist to produce desired results via OpenAI API

#54 SoloSynth1 closed 4 days ago
2
Calling Code Analyzer script to breakdown codebase for code input

#53 SoloSynth1 closed 5 days ago
0
Prototype the scripts for calling OpenAI API to feed prompt + code input and fetch response without hitting rate limit

#52 SoloSynth1 closed 5 days ago
0
Meeting Minutes for Week 3

#51 SoloSynth1 closed 1 day ago
6
Use bib/common reference addition method in the checklist YAML

#50 SoloSynth1 closed 1 week ago
0
docs: Add files for github pages

#49 SoloSynth1 closed 1 week ago
0
docs: Add rest checklist

#48 jinyz8888 closed 1 week ago
0
docs: Add data validation checklist

#47 jinyz8888 closed 1 week ago
0
Add saving loading checklist

#46 jinyz8888 closed 1 week ago
0
docs: Update ChatGPT prompt README

#45 tonyshumlh closed 1 week ago
0
docs: Add checklist with skeleton structure with a few generic cases

#44 SoloSynth1 closed 1 week ago
1
Proposal fine tune

#43 tonyshumlh closed 1 week ago
3
Add figures/screencap and data description

#42 SoloSynth1 closed 2 weeks ago
0
docs: Add a diagram as an overview for the system

#41 SoloSynth1 closed 2 weeks ago
0
feat: test completeness score

#40 JohnShiuMK closed 5 days ago
2