jabbate7 / TokamakText

MIT License
4 stars 1 forks source link

Include paper abstracts (e.g Arxiv, APS) #7

Open allen-adastra opened 1 year ago

allen-adastra commented 1 year ago

Someone should scrape abstracts (perhaps full papers, but that may get too long + converting whole papers to text might be an issue) from data sources such as:

we can then include them in a separate chromadb database and have it query relevant abstracts. We have some of the work done for this already, just need someone to be in charge of seeing it through.

Question: {text} Thinking: {text} Answer: {text} Relevant Papers: {text} Shot Logs: {text}

jabbate7 commented 1 year ago

https://w3.pppl.gov/~jchen/index.html <-- has some textbooks

jabbate7 commented 1 year ago

Jeff suggests APS abstracts (and can maybe associate with peoples' names) Charlie and Sterling recommend grabbing publications from GA tracker Ricardo and Neal recommend OSTI