Refactor code base from a script to a Python package

[eimenhmdt]

Hey guys! This pull request addresses the need to restructure and refactor the existing code base, transforming it from a standalone script to a modular and maintainable Python package. The primary goal is to improve code organization, readability, and extendability for future development.

I split up the code as follows:

• data_sources
  • web_apis
  • document_loaders
• llms
  • openai.py
• utils
  • get_citations.py
  • prompts.py
• workflows
  • literature_review

Lmk what you think about this logic!

Additionally, I updated the literature review workflow to consider semantic similarity between the research question and paper titles when ranking the search results returned by Semantic Scholar.

You can find the published package here

[janzheng]

Looks great, I like how you're importing everything modularly. This makes it easy to reuse the other tools. I think generate_keyword_combinations func could be split up but that could be a future PR

[eimenhmdt]

Thanks for reviewing @janzheng !

re generate_keyword_combinations: Yea, that's a good point. Will try to include that in another PR tomorrow!