corincerami / mars-photo-api

A Rails API for photo data from NASA's Mars Rovers
https://api.nasa.gov/#MarsPhotos
GNU General Public License v3.0
363 stars 50 forks source link

Downloading all data #180

Closed LivacoNew closed 1 year ago

LivacoNew commented 1 year ago

Hi, My use with this API works completely fine but I've got concerns with hitting rate limits as it currently stands. As it currently stands I can have any number of users request a random image from any SOL/Camera at any time - With the rate limits of 1000 req/h that's a struggle. I want to take the data and store it in a local sqlite database I can hit locally, so that I'm not wacking yours continuously. Is there any easy way to do this just in a single request, or would I have to manually write a script to go through every SOL in a rovers manifest to get that data? All I would need is an image url, the rover it belongs to, the camera and the sol. The rest I can gather very easily myself - it's just these bits of data that I would need hundereds of requests over hours to get otherwise. Thanks.

LivacoNew commented 1 year ago

Closing due to lack of response - Went with my idea of just scraping the API with a python script :)