search

deepnlpf / deepnlpf

A Framework for Integrating Linguistic Analysis and Semantic Annotation of Text Documents.
https://deepnlpf.github.io/site/
Other
5 stars 1 forks source link

Ray test issue #6

Open DylanVsn opened 4 years ago

DylanVsn commented 4 years ago

Hi, so I was able to run the test but it bugged after the semafor part as you can see: image image Can't I run the test in command-line only ? must I run a dashboard to use ray ?

rodriguesfas commented 4 years ago

give me the cpu and ram configuration of your pc. show me the data.log file for that run. you can't do it from the command line. I will add in the future. what you can do is change the pipeline for example run one tool at a time to check that everything is ok. and then run the complete pipeline.

RodriguesFAS

Em qui, 30 de abr de 2020 05:58, DylanVsn notifications@github.com escreveu:

Hi, so I was able to run the test but it bugged after the semafor part as you can see: [image: image] https://user-images.githubusercontent.com/43576618/80692080-62497280-8ad1-11ea-8e8c-6e1ce54ac805.png [image: image] https://user-images.githubusercontent.com/43576618/80692113-6d9c9e00-8ad1-11ea-8eef-9f2b02e7de27.png Can't I run the test in command-line only ? must I run a dashboard to use ray ?

— You are receiving this because you are subscribed to this thread. Reply to this email directly, view it on GitHub https://github.com/deepnlpf/deepnlpf/issues/6, or unsubscribe https://github.com/notifications/unsubscribe-auth/ABGLGIHO7U7SNTDXJPDJTC3RPE4UTANCNFSM4MVKERXQ .

DylanVsn commented 4 years ago

For the moment it runs on a VM with 4 cores and 4Go RAM. data.log here is the data.log file. How must I run the ray_unittest.py if I can't run it in command line ? I also tested with greater resources (10Go RAM) but the same issue occurs. If I remove the boost='ray' in the pipeline but with this custom pipeline it gives the same error with way more time to execute.

DylanVsn commented 4 years ago

I tested each tool one by one and it worked (excepted for pywsd that I can't install due to pycurl.error: (6, 'Could not resolve host: rodriguesfas.com.br') error) is the URL correct or the website downed ? I will test pywsd once I can. Some tools took above an hour to perform on the dataset.

rodriguesfas commented 4 years ago

Hé, Dylan ! Le site n'est plus à l'antenne. Je mets les plugins dans le github. Vous pouvez le télécharger manuellement si vous préférez : https://github.com/deepnlpf/plugin_pywsd

Eh bien, les plugins seront installés automatiquement uniquement à partir de Github, et non plus à partir de ce site. Désolé pour les changements soudains, c'est juste que j'améliore les idées à chaque fois.

J'ai également ajouté dans les plugins un nouveau fichier appelé requeriments.sh qui sera utilisé automatiquement pour installer les dépendances et les permissions du plugin.

Je laisse également un lien sur la façon de créer un plugin. J'aimerais que vous y jetiez un coup d'œil et que vous me disiez si elle est bonne, ou très courte, comme ça. https://deepnlpf.github.io/site/docs/en/wikiplugin

A la vôtre !

Traduit avec www.DeepL.com/Translator (version gratuite)

Em seg., 4 de mai. de 2020 às 09:22, DylanVsn notifications@github.com escreveu:

I tested each tool one by one and it worked (excepted for pywsd that I can't install due to pycurl.error: (6, 'Could not resolve host: rodriguesfas.com.br') error) is the URL correct or the website downed ? I will test pywsd once I can. Some tools took above an hour to perform on the dataset.

— You are receiving this because you commented. Reply to this email directly, view it on GitHub https://github.com/deepnlpf/deepnlpf/issues/6#issuecomment-623431240, or unsubscribe https://github.com/notifications/unsubscribe-auth/ABGLGIA6CDWPARJ4SRWEMBLRP2XORANCNFSM4MVKERXQ .

-- Francisco Rodrigues

Candidate Master in Computer Science UFPE CIn Specialist in MBA Teaching Higher Education - IDJ Graduated in Industrial Automation Technology - IFCE Juazeiro Technologist in Analysis and Development of Systems - UniLeão

-- INFORMAÇÃO CONFIDENCIAL / CONFIDENTIALITY NOTICE - Esta mensagem Eletrônica e arquivos anexos contêm informações privilegiadas e confidenciais. O uso não autorizado é ilegal, resultando em responsabilidade civil e criminal. Se você não é o destinatário correto, por favor notificar o remetente e apagar a mensagem inteira. / This electronic transmission is strictly confidential, intended solely for the addressee, and may contain confidential and/or privileged material. Any disclosure, copying, distribution or action taken in reliance on it is prohibited and may be unlawful, resulting in full civil and criminal responsability. If you receive this in error, please contact the sender and delete the material from any computer.

DylanVsn commented 4 years ago

Hi Francisco, Okay for the plugins, I modified a bit the semafor and pywsd requeriments.sh I think the plugin's creation wiki page is great, but could you add an example for the output conversion to JSON to improve the page ?

I was also stuck in the original ray issue, which was the connection to dashboard issue. I tried deepnlpf --api start but an error occured: sh: ligne 0 : cd: deepnlpf/api: No such file or directory So I wasn't able to perform the test for ray.