Feature/82 loading prompts db

bptlab / TracEX

This bachelorproject focuses on event log extraction from patient journeys using large-language models.

5 stars 5 forks source link

Feature/82 loading prompts db #108

Closed soeren227 closed 7 months ago

soeren227 commented 7 months ago

Closes #82

All prompts being used in the pipeline are now loaded from the database.

created prompts.json that can be loaded into database so there is no need to push the database
all prompts are now loaded from the database
adjustments to the Prompt model to make this possible
added Prompt.category
all prompts editable in admin view
did not delete both of the prompts.py files yet, so reviewers can compare more easily

Necessary steps for this to work (in TracEX\tracex_project):

python manage.py migrate
python manage.py loaddata prompts.json

tkv29 commented 7 months ago

@soeren227 reminder: you can load the prompt in the database and push the database, therefore the json can be deleted

tkv29 commented 7 months ago

I just checked the branch at I got errors cuz the db was cleared:D Did you also delete the 4 patient journey: journey_test_x and the related traces? These are important for the trace log comparator on main. Not sure we merge the db this db will replace the one on main or it will get merged

FR-SON commented 7 months ago

I just checked the branch at I got errors cuz the db was cleared:D Did you also delete the 4 patient journey: journey_test_x and the related traces? These are important for the trace log comparator on main. Not sure we merge the db this db will replace the one on main or it will get merged

I tried to reproduce this problem but was not successful. When did this problem come up on your end? The Patient Journeys and corresponding traces for the test environment are still in the DB in my case and executing the trace log comparator works just fine.

soeren227 commented 7 months ago

@tkv29 @FR-SON I can't reproduce your problem aswell Kien. You can check which files i deleted in the PR history, and all other changes are already on main. The db contains only the prompts. I can add other entries if you wish. Maybe PM me and we can go through your concerns together on Discord.

Edit: Reproduced the error and found the cause.

tkv29 commented 7 months ago

@soeren227 I tested everything and looks good for me, thx for the quick fix and gj!