search

vamseeachanta / energydata

MIT License
0 stars 0 forks source link

Web Scraping | BSEE Data #11

Open vamseeachanta opened 2 days ago

vamseeachanta commented 2 days ago

Objective: Preferred method of obtaining data (top first):

When we search for API (See below screenshot), we are extracting data using below Selenium process. https://github.com/vamseeachanta/energydata/blob/bseedata/docs/bsee_data_api.png

The data is from below website https://www.data.boem.gov/Well/APD/Default.aspx

Note the below screenshot when searched by uniqueID is without with an uniqueID. For this website , can we still call out a class and get json/xml format data directly?

vamseeachanta commented 2 days ago

image

vamseeachanta commented 2 days ago

Google search: scraping asp webpage using python See video below: https://www.youtube.com/watch?app=desktop&v=jTKL2qTw2Rc https://www.youtube.com/watch?v=Pu3gmdWsLYc https://www.youtube.com/watch?v=yzCLL5c_4PA https://www.youtube.com/watch?v=Xz514u4V_ts

vamseeachanta commented 2 days ago

https://python-forum.io/thread-2436.html (code) https://www.reddit.com/r/learnpython/comments/717h56/how_to_scrape_asp_webpage_in_python/ (code) https://stackoverflow.com/questions/46311629/how-to-scrape-asp-webpage-in-python (code) https://www.bardeen.ai/answers/how-to-web-scrape-aspx-webpage (high level methodology) https://medium.com/@simranpandey97/web-scraper-for-aspx-form-based-webpages-b8828085e4a2 (high level methodology)