opencivicdata python-legistar-scraper issues

opencivicdata / python-legistar-scraper

Scrapes municipal data from Legistar websites

BSD 3-Clause "New" or "Revised" License

42 stars 28 forks source link

issues

Newest

Newest Most commented Recently updated Oldest Least commented Least recently updated

Add support to parseDataTable for headers containing links

#124 showerst opened 5 months ago
0
Remove key_for_request override from LegistarEventsScraper

#123 antidipyramid closed 10 months ago
0
Question about PrimeGov

#122 bretwalker opened 1 year ago
0
Update the call signature for key_for_request

#121 hancush closed 1 year ago
0
whitelist some subsequent actions as not dupes

#120 fgregg opened 2 years ago
0
Add 72 hour backwards scrape window

#119 antidipyramid closed 2 years ago
0
Update search table xpath

#118 antidipyramid closed 2 years ago
1
Release to PyPI

#117 palewire closed 2 years ago
1
Bug/event details

#116 fgomez828 closed 2 years ago
0
`event['Meeting Details']` not always accurate

#115 fgomez828 closed 2 years ago
4
How do we determine which version of a related matter is "active"?

#114 hancush opened 3 years ago
0
Migrate from Travis to GitHub Actions

#113 hancush closed 2 years ago
1
Revise bill relations filter

#112 hancush closed 3 years ago
0
Fail the scrape if a legislation detail URL returns an expected status code

#111 hancush closed 4 years ago
2
Perform more specific check for inaccessible gateway links

#110 hancush closed 4 years ago
3
add dates to consider in search windows for bills and events

#109 fgregg closed 4 years ago
0
Grab eComment links for past events

#108 hancush closed 4 years ago
1
Consider alternative methods of determining whether an entity has been updated

#107 hancush closed 4 years ago
5
Refactor JavaScript parsing

#106 hancush closed 4 years ago
0
Rehome eComment logic to event scraper

#105 hancush closed 4 years ago
0
Grab eComment link mapping from meetings.js

#104 hancush closed 4 years ago
3
Repair eComment scraping

#103 hancush closed 4 years ago
0
Don't read from the cache when scraping fast, but not in fast mode

#102 hancush closed 4 years ago
0
Make time string format configurable, handle bad start times

#101 hancush closed 4 years ago
0
Pass since_datetime as a keyword argument

#100 hancush closed 4 years ago
0
let the webscraper retries be settable

#99 fgregg closed 5 years ago
0
Don't break from web scrape if there are not yet future events

#98 hancush closed 5 years ago
0
Spike/hec/dry events

#97 fgregg closed 5 years ago
1
fully docstrings explaining what's going on with accept_response and …

#96 fgregg closed 5 years ago
1
Big chicago scrape

#95 fgregg closed 5 years ago
2
Don't try to pull from cache for top level events page

#94 fgregg closed 5 years ago
0
Change events scraping to utilize API changes

#93 jmithani closed 5 years ago
4
The API improves, may be able to get away with not scraping web

#92 fgregg closed 4 years ago
4
only count a year as having an event if we yield event, skip duplicate events

#91 fgregg closed 5 years ago
4
Access all topics at indexes endpoint

#90 hancush closed 5 years ago
0
Refactor topics to return all topics if no matter ID given

#89 hancush closed 5 years ago
0
only raise a 520 for empty content on get and post requests

#88 fgregg closed 5 years ago
0
Retry on legistar sesion errors

#87 fgregg closed 5 years ago
0
use scrapelib's facility to turn off caching for the top level events page

#86 fgregg closed 5 years ago
0
suppress session level params in head request

#85 fgregg closed 5 years ago
0
we want to retry transient problems with head requests

#84 fgregg closed 5 years ago
0
retry requests that raise 104 errors

#83 hancush closed 5 years ago
5
Text with version arg

#82 reginafcompton closed 5 years ago
0
Scrape private

#81 reginafcompton closed 5 years ago
2
Handle absolute bill detail URLs

#80 hancush closed 5 years ago
0
Wire up basic parsing tests

#79 hancush closed 5 years ago
2
Handle ics icon in data table parsing

#78 pjsier closed 5 years ago
1
iCal icon breaks data table parsing

#77 pjsier closed 5 years ago
0
Fix URL paths from onclick attributes

#76 pjsier closed 5 years ago
1
Document URLs returned from onclick attributes are invalid

#75 pjsier closed 5 years ago
0