[NLP] filter parser crash if URL is bad

Common-SenseMakers / sensemakers

Sensemakers infrastructure for developing AI-based tools for semantic annotations of social posts. Cross-poster app to publish your semantic posts on different networks.

GNU General Public License v3.0

1 stars 2 forks source link

[NLP] filter parser crash if URL is bad #36

Open ShaRefOh opened 5 months ago

ShaRefOh commented 5 months ago

the error is 'ContentTypeError' object has no attribute 'get' I see two items in the evaluation table that raise the error. Both have https//www.. It would be good to add try statement attempting to go in the URLs so it will skip to next or move to the LLM component, in case there are more bad URLs. @ronentk

ronentk commented 5 months ago

@ShaRefOh Can you please share the actual URLs here? Thanks

ShaRefOh commented 4 months ago

@ronentk have you dealt with it? I tested it again and now it doesn't crash.

ronentk commented 4 months ago

Nope, I haven't changed anything related.

ronentk commented 4 months ago

@ShaRefOh can this be closed?