Generate a queue of papers to be downloaded

[wergstatt]

The general idea is to generate a queue in the database of links to be crawled. The primary source of those links will be recent publications in relevant journals. Which journals are supposed to be relevant will probably be encoded in the journal ranking.

• [x] Generate a queue table of relevant journals.
• [x] Download the first page of article links for queued journals.
• [x] Generate a queue table of links to download.

[wergstatt]

• [x] Use a copy statement instead of millions of insertions.
• [x] Release first page restriction.

[wergstatt]

Great Success!