search

uw-ssec / tutorials

SSEC tutorials for various topics
https://uw-ssec-tutorials.readthedocs.io
BSD 3-Clause "New" or "Revised" License
3 stars 3 forks source link

chore: Update assets #68

Closed anantmittal closed 3 months ago

anantmittal commented 3 months ago

The current qdrant database contains the abstracts. Add Astropy's GitHub documentation and update the asset.

https://github.com/uw-ssec/tutorials-data

anantmittal commented 3 months ago

Uploaded:

  1. arxiv-dataset.zip: Contains the entire arXiv dataset from Kaggle.
  2. astro-ph-arXiv-abstracts.pkl: Pickled file that can be loaded into pandas dataframe. Contains all the abstracts with categories containing astro-ph
  3. astropy-github.jsonl: Jsonlines file that contains parsed Astropy GitHub documentation as LangChain Documents
  4. scipy_qdrant.zip: Zipped qdrant database that contains astro-ph abstracts and Astropy GitHub documentation with collection name as arxiv_astro-ph_abstracts_astropy_github_documentation