andykais scrape-pages issues

andykais / scrape-pages

generalized scraper using a single instruction set for any site that can be statically scraped

https://scrape-pages.js.org

MIT License

6 stars 2 forks source link

issues

Newest

Newest Most commented Recently updated Oldest Least commented Least recently updated

Bump acorn from 6.4.0 to 6.4.1

#49 dependabot[bot] closed 4 years ago
1
Remove webpack?

#48 andykais opened 4 years ago
2
Give it a cool name

#47 andykais opened 4 years ago
0
make emitter the authority on any scraper commands/messages

#46 andykais opened 4 years ago
0
Duck typing scraper extends EventEmitter

#45 andykais closed 4 years ago
0
JS.ORG CLEANUP

#44 js-org-cleanup opened 5 years ago
0
Instantiate scraper as class

#43 andykais closed 4 years ago
0
turn handlebar sql templates into js string templates

#42 andykais closed 4 years ago
1
Flag metadata.json as in-progress when scraper is running

#41 andykais closed 4 years ago
0
config access pattern class

#40 andykais opened 5 years ago
0
Fix download filename clashes

#39 andykais closed 5 years ago
0
Please do not use `GITHUB_TOKEN`

#38 peaceiris closed 5 years ago
3
make download filenames use database ids

#37 andykais closed 5 years ago
0
make a query execution traverser

#36 andykais closed 5 years ago
0
add RAW parser

#35 andykais closed 4 years ago
1
[WIP] Fix windows ci

#34 andykais opened 5 years ago
0
Flatten config structure

#33 andykais closed 5 years ago
1
support persistent variables (e.g. access tokens)

#32 andykais opened 5 years ago
0
Website Facelift

#31 andykais opened 5 years ago
0
Bump eslint-utils from 1.3.1 to 1.4.2

#30 dependabot[bot] closed 5 years ago
1
update travis ci deploy script syntax for multiple commands

#29 andykais closed 5 years ago
1
Export typescript types

#28 andykais opened 5 years ago
1
Docs & Dependencies update

#27 andykais closed 5 years ago
0
Bump lodash from 4.17.11 to 4.17.13

#26 dependabot[bot] closed 5 years ago
0
Improve config checking: ensure mustache variables exist

#25 andykais opened 5 years ago
1
Add JSON parsing support

#24 andykais closed 5 years ago
1
add json parser

#23 andykais closed 5 years ago
2
add download.retry field

#22 andykais opened 5 years ago
0
Export types when publishing

#21 andykais closed 5 years ago
0
Add documentation to website

#20 andykais opened 5 years ago
1
Type system improvements

#19 andykais closed 5 years ago
0
cancel in-flight requests upon emit('stop')

#18 andykais opened 5 years ago
1
wrap query function, emit function in typescript-is assertion

#17 andykais closed 5 years ago
0
Caching support

#16 andykais closed 5 years ago
0
create query function before creating folders/tables

#15 andykais closed 5 years ago
1
add option to ignore download errors

#14 andykais opened 5 years ago
0
implement regex cleanup support

#13 andykais closed 5 years ago
0
Support module scrapers

#12 andykais opened 5 years ago
1
add `preventDuplicates` flag to both `parse` and `download`

#11 andykais opened 5 years ago
0
validate input names & scraper names as slugs

#10 andykais closed 5 years ago
0
add `limit` flag to ScrapeConfig

#9 andykais closed 5 years ago
3
Config structure defs

#8 andykais closed 5 years ago
0
improved logging bugfix

#7 andykais closed 5 years ago
0
Improved Logging

#6 andykais closed 5 years ago
0
scrapeNext clause

#5 andykais closed 5 years ago
0
Typescript Refactor

#4 andykais closed 6 years ago
0
Update .travis.yml

#3 keradus closed 6 years ago
1
Better sqlite3

#2 andykais closed 6 years ago
0
Store

#1 andykais closed 6 years ago
0