az0 / linkgopher

Firefox/Google Chrome add-on: Extracts all links from web page, sorts them, removes duplicates, and displays them in a new tab for inspection or copy and paste into other systems.
GNU General Public License v3.0
257 stars 56 forks source link

Feature request: Extract links live as the page loads #34

Open GhbSmwc opened 4 years ago

GhbSmwc commented 4 years ago

Something similar to the devtools' network monitor.

Twitter is planning to completely phase out the legacy site by june 1 2020 (extensions forcing the old design will stop working from this point on). And I do like archiving tweets. The problem with the current linkgopher is that it only extract tweets that are loaded. The new design on twitter unloads tweets when they go far enough offscreen. The old design does not unload tweets, so you can extract all the tweets on the page by loading all the way to the bottom and then use the extension to extract all that loaded tweets.

I was thinking of adding a feature in which you checked a checkbox labeled “extract links on the fly as page loads”, and it starts scanning the HTML every second and logs it into a side panel of every new tweet appearing as you scroll down the page. Similar to chrome and firefox's devtools's network monitor, which you can tick “persist logs” or “preserve logs” which when things unloads, remain on the list.