LLM integration for extraction

justin13601 / ACES

ACES: Automatic Cohort Extraction System for Event-Streams

https://eventstreamaces.readthedocs.io/en/latest/

MIT License

13 stars 0 forks source link

LLM integration for extraction #55

Open justin13601 opened 2 weeks ago

justin13601 commented 2 weeks ago

[ ] Test LLMs to extract predicates from dataset specifications
[ ] Test LLMs to construct task criteria based on provided predicates and task description in natural language
[ ] Test end-to-end LLM pipeline based on COT or other agentic workflows

justin13601 commented 2 weeks ago

Given the standardized configuration language, large language models may be leveraged to provide a natural language interface for the creation of task configurations. Initial GPT-4 testing using in-context learning with the configuration language documentation yielded promising results; however, more detailed and quantitative evaluation is needed to determine the feasibility and accuracy of this interface.