StackOverflowMATLABchat / MATLABfcnscrape

Scrape MATLAB's documentation for all function names and output to JSON files for external use
2 stars 1 forks source link

Unable to Scrape License-based Documentation #2

Closed sco1 closed 6 years ago

sco1 commented 6 years ago

The documentation for multiple toolboxes is inaccessible to users without being logged into their MathWorks account and having access to a license for the toolbox.

Of the currently scraped toolboxes, the following are denied public access.

Toolbox
MATLAB Distributed Computing Server
Model-Based Calibration Toolbox
Automated Driving System Toolbox
LTE HDL Toolbox
Vision HDL Toolbox
GPU Coder
HDL Coder
MATLAB Coder
sco1 commented 6 years ago

After preliminary interaction with The MathWorks on this topic, scraping of non-public facing toolbox documentation and making the function list public is going to be a wontfix for the foreseeable future.

Relevant sections of MATLAB's license agreement include the following:

Use of the Documentation, whether provided in printed or online form, is licensed in the same manner as the Programs. Notwithstanding the foregoing, online Documentation may be posted on Licensee's intranet, provided it is not accessible by external sources or made available over the Internet. Portions of the online Documentation may be printed for reasonable use by Licensed Users. Licensee may not otherwise republish the Documentation.

A MathWorks representative has also stated the following:

Unfortunately, there are no APIs available to scrape the online documentation. It is standard MathWorks policy to not give permission to copy large sections of the documentation for use on the internet.