search

shaarang1010 / Bikes-api

scrape data of road, mountain and time trial bikes from webpages and serve it to users based on the parameters
0 stars 0 forks source link

Want to know how to obtain bicycle data? #1

Open mshen6666 opened 10 months ago

mshen6666 commented 10 months ago

Currently I want to make a database of bicycles of various brands, including price, geometry, kit and other information, but I have not found a suitable way to collect this information. Do you have any suggestions for me?

shaarang1010 commented 10 months ago

Hey @mshen6666 I haven't worked on this project in the past three years so I don't know if web scraping works on current bike websites or there are any public API's currently available that do the trick. Also you might need to use a non-relational database since not all websites will have the structured info you need.

I know one provider/org, 99 spokes that have a service which will allow you fetch the information you need. I think it's probably best to use an external source than building your own as you'll notice data gets stale very quickly and you'll need to run a scheduled cronjob to update it.

Send them a request here for an API key and they can help you out from there.

mshen6666 commented 10 months ago

Thank you very much for your prompt reply. Today, I have checked many online APIs and there is no such service available. I am not sure if the bicycle website supports crawling data. I will check the information you provided. Perhaps cycling is still a relatively niche sport in Asia, and there are not many resources available for direct use. Next, I may use chat to solve the problem