search

annegentle / wadl2rst

Provides a WADL to RST migration tool
Apache License 2.0
2 stars 1 forks source link

Adds a web scraper to get lists of operations for quality check #14

Closed annegentle closed 8 years ago

annegentle commented 8 years ago

Issue #13

annegentle commented 8 years ago

When I run this with python apirefscrape.py I get the lists I expect. However, when I run it with python apirefscrape.py > scrape-api-ref.txt I get these errors which makes me think I need to encode better:

Traceback (most recent call last):
  File "apirefops.py", line 40, in <module>
    start_scrape(urllist)
  File "apirefops.py", line 37, in start_scrape
    scrape_url(url)
  File "apirefops.py", line 30, in scrape_url
    print verbs + ' ' + operations
UnicodeEncodeError: 'ascii' codec can't encode character u'\u200b' in position 8: ordinal not in range(128)
annegentle commented 8 years ago

Using a spreadsheet to compare scrape to files migrated: https://docs.google.com/spreadsheets/d/1jnCfJLlEGD-7PdCCpcrhkv8TfAEFzLAZwCuAqbsi7b4/edit?usp=sharing

annegentle commented 8 years ago

See Issue #7

annegentle commented 8 years ago

@missaugustina can you do a sanity check on this? I think I can merge it and it's proving useful.