18F / fbopen

[DEPRECATED] An open API server, data import tools, and sample apps to help small businesses search for opportunities to work with the U.S. government.
Other
101 stars 45 forks source link

Provide DLA cookie and do clickthrough #27

Closed arowla closed 10 years ago

arowla commented 10 years ago

The original attachment scraper had a facility to provide a cookie and clickthrough to attachments located at www.dibbs.bsm.dla.mil.

Cookie should look like:

'DIBBSDoDWarning=AGREE; path=/;'

Add this functionality to the new attachments code.

arowla commented 10 years ago

Hey @aaronsnow ... just went to take a look at the existing DLA scrape code, but it looks like it was never finished.

https://github.com/18F/fbopen/blob/master/loaders/fbo.gov/get-attachment-links-from-one-listing.js#L151

I looked in the rest of the file for any other code related to special handling for that domain, but couldn't find anything.

If that's the case, then perhaps this task isn't critical for the ES release.