Closed ozooha closed 6 months ago
There isn't any trick mate. You check the devtools to see how website works!
I understand it's the dev tools, but my question was how did you figure out the /Home/GetPost part and the other related query parameters -phrase, pindex, content, type and rad? Also, if it returns in json format then why not just use a set of query parameters to get a category within a specified period e.g. tv-shows between 2024-03-01 and 2024-03-02? (Do you know how to send these query parameters? I ask because you might know how to use the dev tools better than me) I tried this https://rlsbb.ru/Home/GetPost?phrase=&pindex=1 and it returns the 30 posts on the webpage in json but I do not know how to ask it to give me just tv-shows within a specified period (like the example above)? If we can achieve that then we won't need to scrap the web pages just use json data, which is easier to code in python. What do you think?
all the links are in DEVTOOLS mate
I understand it's the dev tools, but my question was how did you figure out the /Home/GetPost part and the other related query parameters -phrase, pindex, content, type and rad? Also, if it returns in json format then why not just use a set of query parameters to get a category within a specified period e.g. tv-shows between 2024-03-01 and 2024-03-02? (Do you know how to send these query parameters? I ask because you might know how to use the dev tools better than me) I tried this https://rlsbb.ru/Home/GetPost?phrase=&pindex=1 and it returns the 30 posts on the webpage in json but I do not know how to ask it to give me just tv-shows within a specified period (like the example above)? If we can achieve that then we won't need to scrap the web pages just use json data, which is easier to code in python. What do you think?
sorry if i was mistaken but i wrote this code years ago and I'm not sure if you can find it anylonger in devtools. Possibly they changed how search works lately but this json thing still works. I can't recall if there is a way to find out how to use those links
Thanks mate. Keep up the good work with your addon.
Hi, I was trying your search.py code base to scrape the rlsbb website. The url here along with the _search_url_ produces results in json format - how did you manage to get this part because its so awesome? What trick did you use to know this complete url? Can you teach/reveal this part as to how one would obtain it? Thank you for your attention and time. OZooHA