I identified some potential improvements/bugs when using "OpenAlexConcept" and "Keyterms" pipe in a single pipeline:
Loading the .env file in get_oaconcepts() (oaconcept.py) only works when the .env file is in the directory of oaconcept.py, but it does not work when the .env file is present locally in the same directory as the running script
'openalex_concept_orchestrator.py' throws error in save_annotations(..). Most likely, the output of the endpoint in oaconcept.py changed and therefore the function needs adaption
save_annotations(..) in _keytermsorchestrator.py does not create a "text_key" column in the final dataframe, leading to an Error when merging the resulting dataframes of the two pipes in save() (_pipelinebase.py)
I identified some potential improvements/bugs when using "OpenAlexConcept" and "Keyterms" pipe in a single pipeline:
get_oaconcepts()(oaconcept.py) only works when the .env file is in the directory of oaconcept.py, but it does not work when the .env file is present locally in the same directory as the running scriptsave_annotations(..). Most likely, the output of the endpoint in oaconcept.py changed and therefore the function needs adaptionsave_annotations(..)in _keytermsorchestrator.py does not create a "text_key" column in the final dataframe, leading to an Error when merging the resulting dataframes of the two pipes insave()(_pipelinebase.py)