Open hugoroy opened 11 years ago
I've started work on this, in a separate branch ( json_format ). So far, I've written code to parse the JSON format into the ruby objects used internally by tosback. Please look it over, and see if that seems sensible and going in a good direction. Also, any advice about Ruby would be gratefully appreciated, as this is my first foray into the language.
Oh great! Please have a look at the v1 data format: http://github.com/tosdr/tosdr.org/tree/dataspec
it's basically:
"fulltos": {
"tosback2": "a-tosback-sitename.tld",
"terms": {
"name": "Terms of Service", [equivalent of a current docname.name in the xml]
"url": "equivalent to the docname>url.name in the xml"
}
}
With @JimmStout we're also thinking about how we need to improve the current tosback xml structure to meet new challenges.
I believe we just want to move the JSON services into our XML rules instead of modifying the script to use two sources. We need to verify that they aren't already in our rules though, and then begin to think of the best way to update the XML structure to support relationships between services.
Hugo -- The link http://github.com/tosdr/tosdr.org/tree/dataspec is to a branch, not a particular file. What file were you referring to?
Jimm -- so the primary format (for both tosback and tosdr) going forward is intended to be the XML format from Tosback2? In that case, I should modify the code in tosdr that currently reads the JSON to read the XML format instead, right? But, as you mentioned, the JSON format currently covers more cases than the XML format, so we can't simply replace the JSON format with the XML one, at least not yet.
So I'm not sure what the plan is, I think...
Sorry, I was referring to tosdr.org/services/. Meanwhile, I wrote: https://github.com/tosdr/tosdr.org/wiki/Specification:-services
Here's a list of the differences between the entries in the tosback2 files and in the tosdr/services files. First is listed the sites with different URLs (the tosdr ones are listed first). Next is a list of the sites that are only in the tosdr files, and not in tosback2 at all. I didn't list the reverse, as there are hundreds of those. ;-) Finally is a list of the 5 sites that are in sync, out of the total of 23 sites in the tosdr list that have URLs listed.
amazon.com Conditions of Use http://www.amazon.com/gp/help/customer/display.html/?ie=UTF8&nodeId=508088 Privacy Notice http://www.amazon.com/gp/help/customer/display.html/ref=footer_privacy?ie=UTF8&nodeId=468496 Security, Privacy & Accessibility
AMAZON SILK TERMS & CONDITIONS http://www.amazon.com/gp/help/customer/display.html/?ie=UTF8&nodeId=200775270 Amazon App Suite Legal Notices http://www.amazon.com/gp/help/customer/display.html/?ie=UTF8&nodeId=201008370 Amazon Kindle Store Terms of Use http://www.amazon.com/gp/help/customer/display.html/?ie=UTF8&nodeId=201014950 Amazon.com Privacy Notice http://www.amazon.com/gp/help/customer/display.html/?ie=UTF8&nodeId=468496 Conditions of Use http://www.amazon.com/gp/help/customer/display.html/?ie=UTF8&nodeId=508088 Interest-Based Ads http://www.amazon.com/b/?&node=5160028011 Kindle Cloud Reader Legal Notices http://www.amazon.com/gp/help/customer/display.html/?ie=UTF8&nodeId=200701450 Kindle for Android Legal Notices http://www.amazon.com/gp/help/customer/display.html/?ie=UTF8&nodeId=200495390 Kindle for Mac Legal Notices http://www.amazon.com/gp/help/customer/display.html/?ie=UTF8&nodeId=200443370 Kindle for PC Legal Notices http://www.amazon.com/gp/help/customer/display.html/?ie=UTF8&nodeId=200499360 Kindle for Windows 8 Legal Notices http://www.amazon.com/gp/help/customer/display.html/?ie=UTF8&nodeId=200939440 Third Party Licenses http://www.amazon.com/gp/help/customer/display.html/ref=help_search_1-1?ie=UTF8&nodeId=200910440&qid=1368379047&sr=1-1
apple.com Privacy Policy http://www.apple.com/privacy/
Privacy Policy http://www.apple.com/privacy/ Website Terms of Service http://www.apple.com/legal/terms/site.html iCloud Terms of Service http://www.apple.com/legal/icloud/en/terms.html iTunes Terms of Service http://www.apple.com/legal/itunes/us/terms.html
apple.com Privacy Policy http://www.apple.com/privacy/ Website Terms of Service http://www.apple.com/legal/terms/site.html
Privacy Policy http://www.apple.com/privacy/ Website Terms of Service http://www.apple.com/legal/terms/site.html iCloud Terms of Service http://www.apple.com/legal/icloud/en/terms.html iTunes Terms of Service http://www.apple.com/legal/itunes/us/terms.html
disqus.com Privacy Policy http://help.disqus.com/customer/portal/articles/466259-privacy-policy Terms and Policies http://docs.disqus.com/kb/terms-and-policies/ Terms of Service
Privacy Policy http://help.disqus.com/customer/portal/articles/466259-privacy-policy Terms of Service http://help.disqus.com/customer/portal/articles/466260-terms-of-service
flickr.com Privacy Policy http://info.yahoo.com/privacy/us/yahoo/flickr/details.html
Privacy Policy http://info.yahoo.com/privacy/us/yahoo/
google.com FAQ https://www.google.fr/intl/en/policies/faq/ Key terms https://www.google.fr/intl/en/policies/privacy/key-terms/ Privacy Policy https://www.google.com/intl/en/policies/privacy/
Google Analytics Terms of Service https://www.google.com/intl/en/analytics/tos.html Privacy Policy https://www.google.com/intl/en/policies/privacy/ Terms of Service https://www.google.com/intl/en/policies/terms/
skype.com Business End User License Agreement http://www.skype.com/intl/en-us/legal/business/eula/ Business End User License Agreement (US) http://www.skype.com/intl/en-us/legal/business/eula-us/ Cookies Policy http://www.skype.com/intl/en-us/legal/privacy/general/#5 Etiquette http://www.skype.com/intl/en-us/legal/terms/etiquette/ Fair Usage Policy for Subscriptions http://www.skype.com/intl/en-us/legal/terms/fair_usage/ Fair Usage Policy for US Minute Bundles http://www.skype.com/intl/en-us/legal/terms/fair_usage_minute_bundles/ Group Video Calling Fair Usage Policy http://www.skype.com/intl/en/legal/terms/gvc-fair-usage/ Privacy Policies http://www.skype.com/intl/en-us/legal/privacy/general/ Skype Emergency Calling http://www.skype.com/intl/en-us/legal/skype-limited-emergency-calling/ Terms and Policies http://www.skype.com/intl/en-us/legal/ Terms of Service - Business http://www.skype.com/intl/en-us/legal/business/terms/ Terms of Service - Business (US) http://www.skype.com/intl/en-us/legal/business/terms-us/ Terms of Use http://www.skype.com/intl/en-us/legal/terms/tou/ Trademark Guidelines
Business End User License Agreement http://www.skype.com/intl/en-us/legal/business/eula/ Business End User License Agreement (US) http://www.skype.com/intl/en-us/legal/business/eula-us/ Etiquette http://www.skype.com/intl/en-us/legal/terms/etiquette/ Fair Usage Policy for Subscriptions http://www.skype.com/intl/en-us/legal/terms/fair_usage/ Fair Usage Policy for US Minute Bundles http://www.skype.com/intl/en-us/legal/terms/fair_usage_minute_bundles/ Group Video Calling Fair Usage Policy http://www.skype.com/intl/en/legal/terms/gvc-fair-usage/ Privacy Policy English (International) http://www.skype.com/intl/en/legal/privacy/general/ Skype Emergency Calling http://www.skype.com/intl/en-us/legal/skype-limited-emergency-calling/ Terms of Service - Business http://www.skype.com/intl/en-us/legal/business/terms/ Terms of Service - Business (US) http://www.skype.com/intl/en-us/legal/business/terms-us/ Terms of Use http://www.skype.com/intl/en-us/legal/terms/tou/ Trademark Guidelines http://www.skype.com/intl/en-us/legal/terms/trademark-guidelines/
tumblr.com Privacy Policy http://www.tumblr.com/policy/en/terms_of_service
Privacy Policy http://www.tumblr.com/policy/en/privacy Terms of Service http://www.tumblr.com/policy/en/terms_of_service
twitter.com Privacy Policy https://twitter.com/privacy
Privacy Policy http://twitter.com/privacy Terms of Service http://twitter.com/tos
yahoo.com Community Guidelines http://docs.yahoo.com/info/guidelines/community.html Privacy Policy http://info.yahoo.com/privacy/us/yahoo/details.html
Privacy Policy http://info.yahoo.com/privacy/us/yahoo/ Terms of Service http://info.yahoo.com/legal/us/yahoo/utos/terms/
youtube.com Google Privacy Policy http://www.google.com/intl/en/policies/privacy/
Community Guidelines http://www.youtube.com/t/community_guidelines Privacy Policy http://www.youtube.com/t/privacy_at_youtube
cloudant.com FAQ https://www.cloudant.com/for-developers/faq/ Privacy https://www.cloudant.com/privacy/ Terms of Service https://www.cloudant.com/terms/
grammarly.com Privacy Policy http://privacy-policy.truste.com/verified-policy/www.grammarly.com Terms of Service and License Agreement http://www.grammarly.com/terms
owncube.com Privacy https://owncube.com/privacy.php Terms https://owncube.com/terms.php
soundcloud.com Community Guidelines http://soundcloud.com/community-guidelines Privacy Policy http://soundcloud.com/pages/privacy Terms of Service http://soundcloud.com/terms-of-use
spotify.com Privacy Policy http://www.spotify.com/se/legal/privacy-policy Terms and Conditions (Mobile) http://www.spotify.com/se/legal/mobile-terms-and-conditions/ Terms and Conditions (Premium) http://www.spotify.com/se/legal/premium-code-terms-and-conditions/ Terms and Conditions (Unlimited) http://www.spotify.com/se/legal/unlimited-code-terms-and-conditions/ Terms and Conditions of Use http://www.spotify.com/se/legal/end-user-agreement/
store.steampowered.com Privacy Policy Agreement http://store.steampowered.com/privacy_agreement/ Steam Subscriber Agreement http://store.steampowered.com/subscriber_agreement/
xing.com Privacy Policy http://www.xing.com/privacy Terms http://www.xing.com/terms
500px.com app.net facebook.com github.com twitpic.com
I would say most of the info from tosdr files is more recent than tosback… so…
Please import rules that we have in tosdr.org/services/