Ported Issue: Research and Present information on NPL

[maeutic]

Manually ported from Syna3C/Syna3C-Project where @shonore commented on Jun 24:

Natural Language Processing (NLP) - We need to present what NLP is to Amelia and other stakeholders. In addition, we should discuss the costs, risks, development time, and, production support efforts of using this technology.

@Revencher replied on Jun 26:

I Googled it real quick. I can see how it would be useful but wonder if it's necessary or prudent for the alpha?

If you feel it is necessary for the basic functions of this program then by all means do what you feel is necessary, unless anyone has an objection?

@maeutic responded with possible solutions on Jun 30:

Let's take a look at these:

• ~https://opennlp.apache.org/~ (Java)
• https://spacy.io/ (Python)
• https://stanfordnlp.github.io/CoreNLP/ (Java, but node.js and Python have forks; see https://stanfordnlp.github.io/CoreNLP/other-languages.html What follows is basically copy and paste from that list)
  • JavaScript (node.js)
  • corenlp (https://github.com/gerardobort/node-corenlp) by Gerardo Bort is an actively developed node.js CoreNLP library. Multilingual support. You can run this package in your browser, using RunKit.
  • stanford-corenlp (github site) is a simple node.js wrapper by hiteshjoshi.
  • CoreNLP-client (GitHub site) is a simple corenlp client to the corenlp http server using request-promise by Romain Beaumont. Extended by Christophe B. for multilingual use as corenlp-client-multilang (github site). The latter has multilingual support.
  • corenlp-request-wrapper (github site) is a wrapper for a Stanford CoreNLP server by nash403.
  • Python
  • stanfordcorenlp by Lynten Guo. A Python wrapper to Stanford CoreNLP server, version 3.8.0. Also: PyPI page.
    • pycorenlp, A Python wrapper for Stanford CoreNLP by Smitha Milli that uses the new CoreNLP v3.6+ server. Available on PyPI.
    • corenlp-pywrap by Sherin Thomas also uses the new CoreNLP v3.6+ server. Python 3.x (only). Also: PyPI page.
    • Stanford CoreNLP Python Interface: A reference implementation of a Python interface to the Stanford CoreNLP server. By Arun Chaganty. PyPI page.
    • pynlp A (Pythonic) Python wrapper for Stanford CoreNLP by Sina. PyPI page.
    • NLTK since version 3.2.3 has a new interface to Stanford CoreNLP using the StanfordCoreNLPServer. Among other places, see instructions on using the dependency parser and the code for this module, and if you poke around the documentation, you can find equivalent interfaces to other CoreNLP components; for example here is Stanford CoreNLP NER. Much of the work for this was done by Dmitrijs Milajevs.
• ~https://gate.ac.uk/~ (Java)
• https://github.com/NaturalNode/natural (node.js; further info at https://dzone.com/articles/using-natural-nlp-module )
• https://github.com/spencermountain/compromise (javascript; looks lightweight; dev links to some other NLP projects, which I've included below if applicable and not linked elsewhere)
  • https://github.com/NaturalNode/natural (node.js)
  • https://github.com/retextjs/retext (javascript; their Code of Conduct might be worth looking at for developing our own: https://github.com/retextjs/retext/blob/master/code-of-conduct.md )

@shonore added on Jun 30:

We are going to do more research on this. Amelia is going to find open source solutions for this. The purpose of implementing this technology is to reduce duplicate events/sub-events/posts from being created and to automatically generate tags based on the information entered when a post is created or edited. Tags may be used as a filter for searches.

@shonore commented on Jul 14:

The NPL is going to be implemented on the server so it does not have to be compatible with React. We will revisit this once we flesh out the website more

[maeutic]

Original issue opened June 24, 2018 at https://github.com/Syna3C/Syna3C-Project/issues/9