griffithchaffee / wormstorysearch-rails

Rails application for tracking Worm fanfiction updates
http://wormstorysearch.com
24 stars 5 forks source link

RESEARCH: Reader Mode #10

Open griffithchaffee opened 5 years ago

griffithchaffee commented 5 years ago

Might be able to save queries and be more efficient by loading threads in reader mode. This would let us update multiple chapter likes at once.

Xon commented 5 years ago

Please do not crawl these pages to discovering all ratings, doing so will very likely result in the blacklisting of your bot's hosting provider from both SpaceBattles and Sufficient Velocity.

griffithchaffee commented 5 years ago

@Xon thanks for the heads up.

Somewhat related, as far as I am aware there is no great way to get a chapter rating. A threadmark page does have a data attribute data-likes but it only takes into account "likes" and not other rating options such as "funny" and "hugs". Using this value would lead to much lower ratings for certain types of stories on SV. Would be amazing if this could be updated or an extra attribute such as data-total-rates was available.

Are you aware of an alternative way to get accurate chapter ratings?

Xon commented 5 years ago

Likes now include ratings (breaking it out is challenging in XenForo1).

The RSS feed will now include these fields per entry;

<threadmarks:likes>0</threadmarks:likes>
<threadmarks:words>32</threadmarks:words>