search

bsgreenb / Open-Textbooks

A library for scraping nearly every college bookstore in the US
MIT License
65 stars 18 forks source link

MBS Direct Mobile Site #7

Open 34code opened 11 years ago

34code commented 11 years ago

I do not seem to have any luck finding the mobile sites for simplifying scraping from MBS Direct sites..

According to the documentation, http://bookstoreurl.com/mobile/textbooks.aspx should give me the mobile version...

However, for the following bookstores... I cannot seem to find a mobile version:

http://bookstore.mbsdirect.net/cdu.htm http://bookstore.mbsdirect.net/bsu.htm http://bookstore.mbsdirect.net/depaul.htm

Not having MBS Direct is not a dealbreaker as most institutions are leaving / have left it due to its complicated user interface... a search for "university" at http://www.mbsdirect.net/index.php will highlight what im talking about..

That said, it would be nice if I could find the mobile site in order to scrape MBS Direct.

bsgreenb commented 11 years ago

Interesting, this looks to be a new version of MBS, or at least a different version than what people have when they host MB on their own servers. Are those the only 3 MBS that you're stuck with this version for?

Either way, if you want to do these ones it looks like you'll need to write a new scraper. It shouldn't be too hard since there's only a few steps required to getting data. If you take on that task, let me know if you need any help with that.

On Tue, Nov 20, 2012 at 3:22 AM, sambit notifications@github.com wrote:

I do not seem to have any luck finding the mobile sites for simplifying scraping from MBS Direct sites..

According to the documentation, http://bookstoreurl.com/mobile/textbooks.aspx should give me the mobile version...

However, for the following bookstores... I cannot seem to find a mobile version:

http://bookstore.mbsdirect.net/cdu.htm http://bookstore.mbsdirect.net/bsu.htm http://bookstore.mbsdirect.net/depaul.htm

Not having MBS Direct is not a dealbreaker as most institutions are leaving / have left it due to its complicated user interface... a search for "university" at http://www.mbsdirect.net/index.php will highlight what im talking about..

That said, it would be nice if I could find the mobile site in order to scraper MBS Direct.

— Reply to this email directly or view it on GitHubhttps://github.com/bsgreenb/Open-Textbooks/issues/7.

34code commented 11 years ago

Actually this seems to be the issue for every hosted MBS which is part of the http://bookstore.mbsdirect.net url... its not complicated to write a scraper for this.. and I'll do that soon but its not priority at them moment.. I should have a working version in a few months' time..

bsgreenb commented 11 years ago

Thanks Sambit. If you could file a pull request to Open-Textbooks when you write and successfully test that code that'd be great.

On Thu, Nov 22, 2012 at 2:54 AM, sambit notifications@github.com wrote:

Actually this seems to be the issue for every hosted MBS which is part of the http://bookstore.mbsdirect.net url... its not complicated to write a crawler for this.. and I'll do that soon but its not priority at them moment.. I should have a working version in a few months' time..

— Reply to this email directly or view it on GitHubhttps://github.com/bsgreenb/Open-Textbooks/issues/7#issuecomment-10626174.

34code commented 11 years ago

Sure. Will do that... Also, I wanted to ask if you received my email I sent to ben@textyard.com?

bsgreenb commented 11 years ago

Sounds good.

I responded to your email a while ago, did you not get a response in your inbox?

On Thu, Nov 22, 2012 at 4:10 PM, sambit notifications@github.com wrote:

Sure. Will do that... Also, I wanted to ask if you received my email I sent to ben@textyard.com?

— Reply to this email directly or view it on GitHubhttps://github.com/bsgreenb/Open-Textbooks/issues/7#issuecomment-10645093.

34code commented 11 years ago

nope.. didnt seem to have received it.. maybe its a problem at your mail server's end? or maybe its my end... is possible to try sending it again.. if you cc 34sambit@gmail.com, that'll make sure I receive it..Thanks.

bsgreenb commented 11 years ago

Sent it to sambit@botflip.com originally. forwarded now.

On Thu, Nov 22, 2012 at 6:26 PM, sambit notifications@github.com wrote:

nope.. didnt seem to have received it.. maybe its a problem at your mail server's end? or maybe its my end... is possible to try sending it again.. if you cc 34sambit@gmail.com, that'll make sure I receive it..Thanks.

— Reply to this email directly or view it on GitHubhttps://github.com/bsgreenb/Open-Textbooks/issues/7#issuecomment-10648591.