search

cc-archive / cc-link-checker

Automated link checker for legalcode and license URLs
MIT License
9 stars 13 forks source link

[CC7] RDF Link Checker - Local Checking Only #95

Closed Audiosutras closed 4 years ago

Audiosutras commented 4 years ago

Fixes

Fixes #90 by @TimidRobot

Description

This PR adds local checking of RDFs to the repository.

pipenv run link_checker --rdf --local

Technical details

This PR adds local checking of RDFs to the repository and is meant to be used in conjunction with import_rdf_index django command in the cc-licenses repository. import_rdf_index generates the index.rdf file. Make sure to update INDEX_RDF_LOCAL_PATH in constants.py to point to index.rdf file location in cc-licenses.

At the time of writing this, the most up to date copy of index.rdf has been included in this pr. Checking this branch locally is all that you need to do for verification.

Tests

In test_utils.py

Also performed various "cleanup" task.

Screenshots

Checklist

- [x] My pull request has a descriptive title (not a vague title like `Update index.md`). - [x] My pull request targets the *default* branch of the repository (`main` or `master`). - [x] My commit messages follow [best practices][best_practices]. - [x] My code follows the established code style of the repository. - [x] I added tests for the changes I made (if applicable). - [ ] I added or updated documentation (if applicable). - [x] I tried running the project locally and verified that there are no visible errors. [best_practices]:https://gist.github.com/robertpainsi/b632364184e70900af4ab688decf6f53 ## Developer Certificate of Origin
Developer Certificate of Origin ``` Developer Certificate of Origin Version 1.1 Copyright (C) 2004, 2006 The Linux Foundation and its contributors. 1 Letterman Drive Suite D4700 San Francisco, CA, 94129 Everyone is permitted to copy and distribute verbatim copies of this license document, but changing it is not allowed. Developer's Certificate of Origin 1.1 By making a contribution to this project, I certify that: (a) The contribution was created in whole or in part by me and I have the right to submit it under the open source license indicated in the file; or (b) The contribution is based upon previous work that, to the best of my knowledge, is covered under an appropriate open source license and I have the right under that license to submit that work with modifications, whether created in whole or in part by me, under the same open source license (unless I am permitted to submit under a different license), as indicated in the file; or (c) The contribution was provided directly to me by some other person who certified (a), (b) or (c) and I have not modified it. (d) I understand and agree that this project and the contribution are public and that a record of the contribution (including all personal information I submit with it, including my sign-off) is maintained indefinitely and may be redistributed consistent with this project or the open source license(s) involved. ```
Audiosutras commented 4 years ago

The index.rdf files should not be included in this repository.

Users can checkout creativecommons/cc.licenserdf and put the path to index.rdf in their env (ex. INDEX_RDF_LOCAL_PATH=../cc.licenserdf/cc/licenserdf/rdf/index.rdf) if they want to be able to parse the file locally.

Remote https://creativecommons.org/licenses/index.rdf checking should be enabled.

Removed index.rdf.