DocNow / diffengine

track changes to the news, where news is anything with an RSS feed
MIT License
177 stars 30 forks source link

Track changes only in headlines #33

Closed tibor closed 7 years ago

tibor commented 7 years ago

Hi,

at first thanks for your efforts and the project!

I got the script running and tweeting but would like to tweet only changes in headlines. Is there a setting to compare only changes in the headline?

Thanks and kind regards

Tibor

edsu commented 7 years ago

Congrats on getting it working. Yes, I think #28 would allow you to do that, assuming that it's possible to construct a CSS selector for the title?

I'm curious, was the bot tweeting too frequently?

tibor commented 7 years ago

I guess this would solve the problem. But it's only a feature request at the moment, right? Or can I use this feature already?

I’m currently tracking changes for all articles of 6 mayor german newspapers, so there are a lot of tweets indeed. Also there are a lot of Tweets with very Little differences, e. g. in the rating section of articles.

Maybe it would be a good idea to send tweets only when a certain percentage of words or letters has changed.

edsu commented 7 years ago

Yes, it's a feature request. I just wanted to see if you thought it covered your use case. That's awesome that you are monitoring those bots. Would you be willing to share the URLs for the Twitter accounts here?

I like the idea of a minimum number of changes as well. I've definitely seen my fair share of diffs that are for commas and things of that nature, which aren't really substantive. I think adding this a config option is a great idea, may a min_diff config option that would be the minimum length of characters changed?

Would you be willing to open a separate ticket for the length issue, and I will close this since it is a duplicate of #28?

tibor commented 7 years ago

Yep, we can do it this way. So you are developing diffengine further?

Can you estimate how soon this feature is implemented?

My twitter handle is @ueberschrieben

edsu commented 7 years ago

It sounds like you need it ASAP? I can try to get to it this week if that will helps you out.

We are definitely trying to develop diffengine further. We put in for a Knight Foundation Portotyping grant that would help support pushing the idea a bit further if we get it. We expect to hear either way by the end of the month.

Just out of curiosity how did you find diffengine?

tibor commented 7 years ago

Well, that would be awesome if you can find the time!

I noticed some diffengine / bots some time ago but didn’t realize that they were open source. This week I was thinking about creating something similar, but remembered those bots and found via @nyt_diff to the Repository NYTdiff. Since I’d liked to track multiple sources with one account it was great to see this repository linked in the readme of NYTdiff.

I think I’m gonna add some more issues with ideas I have.

If your grant from Knight Foundation won’t be accepted, I could try to fund some money in Germany as well. Not done this before though.