jonmarkgo / Predict-the-Sky

Our solution to the Predict the Sky challenge for the NASA Space Apps Hackathon in NYC
http://predictthesky.heroku.com/
2 stars 1 forks source link

Scraper #1

Closed jonmarkgo closed 12 years ago

jonmarkgo commented 12 years ago

@dracco @jeffsaracco @johnnymugs @kennedysgarage Hey guys, I decided to redo the event checker script to instead scrape HTML data from http://www.heavens-above.com/ - the reason for this is that it has more comprehensive checks (you can get data on any satellite + some other events) and it actually tells you about visibility and estimated time of arrival. You should be able to copy/pasta from iss_event.rb and tweak the HTML scraper a bit to add more satellites

Sorry for the ugliness, scrapers aren't pretty!

jeffsaracco commented 12 years ago

took a look at this, works ok, we could probably clean it up a bit, maybe extrapolate shared logic somewhere, but it's fine.

The one issue I noticed, and can't figure out, is that heavens above shows times that ISS passes in the past. For instance if you go there now it will show you an ISS pass from an hour ago.

Maybe we can loop through the rows until we find a row in the future and use that?

jonmarkgo commented 12 years ago

I think it depends what URL arguments you provide, for me it always showed

future ones though I may be mis-remembering

Jon

On Sat, Apr 21, 2012 at 10:27 PM, Jeff Saracco < reply@reply.github.com

wrote:

took a look at this, works ok, we could probably clean it up a bit, maybe extrapolate shared logic somewhere, but it's fine.

The one issue I noticed, and can't figure out, is that heavens above shows times that ISS passes in the past. For instance if you go there now it will show you an ISS pass from an hour ago.

Maybe we can loop through the rows until we find a row in the future and use that?


Reply to this email directly or view it on GitHub: https://github.com/jonmarkgo/Predict-the-Sky/issues/1#issuecomment-5265044

jonmarkgo commented 12 years ago

Looks like the app works and is running the task on heroku. I got texts this morning about the iss, though we'll need to tweak it a bit since I got 3 messages (every ten minutes I got one)

-Jon Beep boop beep Sent from my Droid On Apr 21, 2012 10:50 PM, "Jon" jonmarkgo@gmail.com wrote:

I think it depends what URL arguments you provide, for me it always showed

future ones though I may be mis-remembering

Jon

On Sat, Apr 21, 2012 at 10:27 PM, Jeff Saracco < reply@reply.github.com

wrote:

took a look at this, works ok, we could probably clean it up a bit, maybe extrapolate shared logic somewhere, but it's fine.

The one issue I noticed, and can't figure out, is that heavens above shows times that ISS passes in the past. For instance if you go there now it will show you an ISS pass from an hour ago.

Maybe we can loop through the rows until we find a row in the future and use that?


Reply to this email directly or view it on GitHub: https://github.com/jonmarkgo/Predict-the-Sky/issues/1#issuecomment-5265044