search

SarthakJShetty / pyResearchInsights

End-to-end NLP tool to analyze research publications. Published in Ecology & Evolution 2021.
MIT License
29 stars 8 forks source link

google colab notebook is crashing #8

Closed amscosta2022 closed 5 months ago

amscosta2022 commented 6 months ago

Hello The colab notebook is not running already in the first cells.

amscosta2022 commented 6 months ago

For instance trying ; keywords_to_search = 'blood viscosity computational fluid dynamics turbulence'

SarthakJShetty commented 6 months ago

Hi! Thank you for trying our the tool. Can you post a screenshot of the full error or paste it here in it's entirety? I can take a look at that and start debugging the error.

Thanks!

amscosta2022 commented 6 months ago

Hello Just try that search string.

Em dom., 25 de fev. de 2024 12:58, Sarthak @.***> escreveu:

Hi! Thank you for trying our the tool. Can you post a screenshot of the full error or paste it here in it's entirety? I can take a look at that and start debugging the error.

Thanks!

— Reply to this email directly, view it on GitHub https://github.com/SarthakJShetty/pyResearchInsights/issues/8#issuecomment-1962982878, or unsubscribe https://github.com/notifications/unsubscribe-auth/AZACKONDUUHGUMB54BDW3WLYVNNQ5AVCNFSM6AAAAABDY55SYOVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMYTSNRSHE4DEOBXHA . You are receiving this because you authored the thread.Message ID: @.***>

amscosta commented 6 months ago

keywords_to_search = 'blood viscosity computational fluid dynamics turbulence'

SarthakJShetty commented 6 months ago

Hi @amscosta and @amscosta2022 thank you for bringing up this issue. You are right that the scrapping crashes at that point. I will take a look at this and get back to you.

SarthakJShetty commented 6 months ago

Hi @amscosta @amscosta2022! Apologies for the delay in responding to this issue. You are right that the Google Colab is crashing. This is mostly due to package mismanagement and Colab's way of organizing installed packages.

However you should be able to run the package locally without any issues at all. In fact, I was able to run it right now successfully for the keywords that you provided. Here's the snippet that if you copy and paste it should run if the package has been installed correctly:

from pyResearchInsights.common_functions import pre_processing
from pyResearchInsights.Scraper import scraper_main
from pyResearchInsights.Cleaner import cleaner_main
from pyResearchInsights.Analyzer import analyzer_main
from pyResearchInsights.NLP_Engine import nlp_engine_main

keywords_to_search = "blood viscosity computational fluid dynamics turbulence"

'''Calling the pre_processing functions here so that abstracts_log_name and status_logger_name is available across the code.'''
abstracts_log_name, status_logger_name = pre_processing(keywords_to_search)

'''Runs the scraper here to scrape the details from the scientific repository'''
scraper_main(keywords_to_search, abstracts_log_name, status_logger_name)

'''Cleaning the corpus here before any of the other modules use it for analysis'''
cleaner_main(abstracts_log_name, status_logger_name)

'''Calling the Analyzer Function here'''
analyzer_main(abstracts_log_name, status_logger_name)

'''Calling the visualizer code below this portion'''
nlp_engine_main(abstracts_log_name, status_logger_name)

Do let me know if this works for you. I'm happy to help if it doesn't.

Thanks! -Sarthak

SarthakJShetty commented 5 months ago

Closing this because there's no activity.