search

nshdesai / deepdixit

Guess the prompt from a neural network generated image
2 stars 1 forks source link

Scraping themes #7

Closed gkysaad closed 2 years ago

gkysaad commented 2 years ago

The scraper notebooks look good, but I think it would be worth our time to explore the feasibility of building a slightly more general/robust scraper. Consider a script that takes as input a url / list of urls, and outputs cleaned strings that will be used as prompts. This will be hard to pull of for any general URL, but assuming that the URL actually contains a list of such strings, the script could be told to look for a specific tag/pattern that would help extract them.

Reopening https://github.com/nshdesai/papersforbabies/pull/5

baronet2 commented 2 years ago

Let's finish the convo in #5 before merging/making changes.

nshdesai commented 2 years ago

Okay, it looks like we don't have to think more about the scraping stuff for now. This should be ready to merge. (Issues with #5 seem resolved)

baronet2 commented 2 years ago

@nshdesai Should we close #5 then or is there more discussion to be had there?

nshdesai commented 2 years ago

We can close it