search

Weasyl / SOFT

For migrating FA accounts to Weasyl
MIT License
4 stars 1 forks source link

Automatically scrape the FA user's watchlist #5

Open lavendo opened 10 years ago

lavendo commented 10 years ago

The current tool appears to require the user to enter their watchlist in order to accomplish its task. That shouldn't be necessary, as it requires the user to go through a series of pages and collect data that's very easily gathered from the site.

To resolve this issue, the scraper should be capable of automatically gathering up the user's watch list, assuming the user's profile is publicly available.

GraemeLion commented 10 years ago

This Would be neat.

I'll take a look at it later today or next week if nobody minds

lavendo commented 10 years ago

You got it. Send a PR when you get something. :)

skylerbunny commented 10 years ago

When implemented, this enhancement should provide the FA user's 'dirname' to check against, not their 'username', which is the text that appears in a person's watchlist. Specifically, this would address the problem of username to dirname translation, most frequently run into with underscores.

Common examples: Username 'Zen_Fetcher' becomes http://www.furaffinity.net/user/zenfetcher/ as a URL. Username '^69' becomes http://www.furaffinity.net/user/%5E69 Etc.

If SOFT displays a user's username (Zen_Fetcher/^69) for human-readability purposes (which is what I would recommend), the link that entry GOES to must always point to the dirname URL (zenfetcher/%5E69).