issues
search
abu-rayyan
/
crawper
A python based crawler and scraper
0
stars
0
forks
source link
issues
Newest
Newest
Most commented
Recently updated
Oldest
Least commented
Least recently updated
Add files via upload
#25
sameershewakram
opened
6 years ago
0
Make the flask server more mature
#24
ghost
opened
6 years ago
0
Automate deployment process
#23
ghost
opened
6 years ago
0
Implement csv reading in proxy rotator
#22
ghost
opened
6 years ago
0
Apply threads to review analysis
#21
ghost
opened
6 years ago
0
Implement categories url crawling
#20
ghost
opened
6 years ago
0
Implement test suit
#19
ghost
opened
6 years ago
0
Too many db connections [crawler]
#18
ghost
closed
6 years ago
1
Too many database connections [REngine]
#17
ghost
closed
6 years ago
1
Too many database connections
#16
ghost
closed
6 years ago
1
Use review id instead to review URL as pkey in reviews table
#15
ghost
opened
6 years ago
1
Duplicated reviewer entry into DB
#14
ghost
closed
6 years ago
2
scrap product average review
#13
ghost
closed
6 years ago
1
Same products of parent category can exists in child category
#12
ghost
opened
6 years ago
0
Product image link not scraped
#11
ghost
closed
6 years ago
1
Feat/server dev
#10
ghost
closed
6 years ago
0
common except fixes
#9
ghost
closed
6 years ago
0
Consider sensibility of common phrases
#8
ghost
opened
6 years ago
1
added threaded crawler
#7
ghost
closed
6 years ago
0
Dev/r engine fts
#6
ghost
closed
6 years ago
0
Dev
#5
ghost
closed
6 years ago
0
duplicate products, reviews and reviewers
#4
ghost
closed
6 years ago
1
Re scrap whose data contains null values
#3
ghost
closed
6 years ago
1
Sometimes it scrap duplicate reviews
#2
ghost
closed
6 years ago
1
Reviewer id unique constraint stopping data from being added to DB
#1
ghost
opened
6 years ago
0