search

webrecorder / behaviors

Webrecorder Automated In-Page Behavior Framework
GNU Affero General Public License v3.0
11 stars 6 forks source link

More specific infinite loader traversal insta, twitter, et. al. #29

Closed N0taN3rd closed 4 years ago

N0taN3rd commented 5 years ago

Is there more specific indicators that we are actually done loading all posts/tweets?

N0taN3rd commented 5 years ago

Twitter is more difficult than most best effort is knowing how many tweets a timeline has and tracking how many viewed

ikreymer commented 5 years ago

I guess it would be if there's some way to determine if at end of timeline, maybe there isn't anything that it sets in the dom that'd be apparent?

ikreymer commented 5 years ago

There's the 'Back to top' card that i think gets added, not sure if always or not.

N0taN3rd commented 5 years ago

The last time I checked Twitter adds the fail, done, loading markup to the dom at render time and makes them visible when appropriate.

The counting approach seems simplest + maybe a visibility check.