Text processing

[Melina-MLEAN]

• write a routine, which removes all punctuation
• split the spelled text (split function) and add punctuation
• keywords (instring-function) --> how to check if a substring is contained in a string
• keywords should recognize literal sense or a question

[kimmrz]

https://course.spacy.io/en/chapter1

[Melina-MLEAN]

https://spacy.io/usage/spacy-101 --> to understand how it works

[kimmrz]

https://melaniewalsh.github.io/Intro-Cultural-Analytics/features/Text-Analysis/POS-Keywords.html maybe we can use this code as well?

[kimmrz]

to do:

different sentences for "What is your name?" and so on

[kimmrz]

• recognize city names
• values for tokes.pos --> which values?

Names entities:

• Hal can recognize different nouns
• e.g. a company name "Apple" --> "I dont like this company"

create action:

• def class recognizer --> different classes for recognizing