search

joelansbro / pipeline

API Pipeline DB middleware
2 stars 0 forks source link

NLP: Prior belief text #44

Closed joelansbro closed 1 year ago

joelansbro commented 1 year ago

I remember their being a prior beliefs text dictionary somewhere used that I thing I've got saved down somewhere, find it and bring it into the text, can give a score to it

joelansbro commented 1 year ago

Include declarations and threats as well, have seen a few of them at the bottom of texts before

jagithub2 commented 1 year ago

https://github.com/joelansbro/bloganalysis/blob/main/NLP/experience.ipynb this is the notebook I was thinking of, I should be able to modify it to not both with pyspark

jagithub2 commented 1 year ago

Have gathered the following columns for prior experiences: 'experience_count', 'temporal_count', 'past_tense_count', 'gerund_count' have added this as another UDF onto the final output.