search

karthik / RRR

The reproducibility lexicon project at BIDS
2 stars 3 forks source link

Arrange access to WOS exporting #2

Closed danielturek closed 9 years ago

danielturek commented 9 years ago

Just received:
Dear Daniel Turek, Thank you for your interest in Thomson Reuters - we will be in touch shortly.

karthik commented 9 years ago

Can you send them a follow up email since it has been almost a month?

danielturek commented 9 years ago

I just had a phone conversation with Anesh (?) of Thomson Reuters technical support (1-800-336-4474). He is re-opening technical support case number TS-02290083. He understands what we're trying to do, and (hopefully) supports our cause. He is passing the case to his manger, which seems to imply it will get faster attention. They will be in touch with me via email. Hopefully updates to follow soon.

karthik commented 9 years ago

Excellent! Thanks for following up @danielturek Let's touch base next week?

danielturek commented 9 years ago

Sounds good. I'm looking over the other work you've done, too -- more to follow.

karthik commented 9 years ago

bump

danielturek commented 9 years ago

Still hassling them. The guy who needs to send me the consent form gets back next week.....

danielturek commented 9 years ago

This is almost amusing:

Daniel, I need your mailing address for the agreement. We will generate a Statement of Work for access to support your project. Thanks, Brian

karthik commented 9 years ago

Hilarious! Let's jump through these hoops anyway and see where we get.

danielturek commented 9 years ago

Yes, it's going to happen, it's just dragging a little.

On Tue, Jun 2, 2015 at 12:10 AM, Karthik Ram notifications@github.com wrote:

Hilarious! Let's jump through these hoops anyway and see where we get.

— Reply to this email directly or view it on GitHub https://github.com/karthik/RRR/issues/2#issuecomment-107834007.

danielturek commented 9 years ago

Well, maybe I'll have the XML exporting figured out by the time this actually happens...

Daniel, I’ve put in the request. There’s a queue so estimate this will go out early to mid next week. Cheers, Brian

danielturek commented 9 years ago

Received this just today. I'll start looking into how to automate queries.

Dear Valued Customer,

Thomson Reuters is pleased to grant you access to the Thomson Reuters Web of Science(TM) Web Services. Your access will become active within one business day.

Thomson Reuters Web of Science Web Services define an automated system for mining data from Web of Science databases. They follow SOAP (Simple Object Access Protocol) for transferring request and response messages. The services include a Web Services Description Language (WSDL). Web of Knowledge Web Services conform to the JSR224: Java API for XML-based Web services 2.0 (JAX-WS) specification.

danielturek commented 9 years ago

I think this is going to do it for us. Unfortunately I'm taking off right now, but I'll follow-up later.

https://gist.github.com/domoritz/2012629

danielturek commented 9 years ago

Status update for exporting WOS information: I've gotten the SOAP query to run(!), which feels like we're nearly there. Unfortunately, I can't figure a useful way to get python to export the query results to either XML or json file format.

Any help or input to making this export work is very welcomed.

You can see where we're at by executing the python script wos.py from my recent commit.

danielturek commented 9 years ago

Access to WOS has been granted.

danielturek commented 9 years ago

Making automated queries from WOS.

Search terms: reproducibility, replicability, repeatability Language: English Dates: 1/1/2000 - 12/31/2014

Output is dumped in text files data/[searchterm].json

These files will require some work to parse into R.

Complete WOS queries may be run using: $ make query (this takes a little time, since WOS permits only 2 queries / second, and limits results to 100 records / query).