issues
search
eklem
/
browsercrawler
Crawling content from a site within the browser. A basis for i.e. a search solution for static sites.
https://eklem.github.io/browsercrawler/doc/
MIT License
2
stars
0
forks
source link
issues
Newest
Newest
Most commented
Recently updated
Oldest
Least commented
Least recently updated
Bump es5-ext from 0.10.53 to 0.10.63
#66
dependabot[bot]
opened
6 months ago
0
Bump word-wrap from 1.2.3 to 1.2.4
#65
dependabot[bot]
closed
1 year ago
0
Make it work with webtorrents
#64
eklem
opened
1 year ago
0
Bump minimist from 1.2.5 to 1.2.6
#63
dependabot[bot]
closed
1 year ago
0
Bump minimist from 0.0.8 to 1.2.5
#62
dependabot[bot]
closed
2 years ago
0
Bump nth-check from 1.0.2 to 2.0.1
#61
dependabot[bot]
closed
2 years ago
1
Bump path-parse from 1.0.6 to 1.0.7
#60
dependabot[bot]
closed
1 year ago
0
Bump lodash from 4.17.19 to 4.17.21
#59
dependabot[bot]
closed
3 years ago
0
Bump bl from 1.2.2 to 1.2.3
#58
dependabot[bot]
closed
3 years ago
0
Bump ini from 1.3.5 to 1.3.7
#57
dependabot[bot]
closed
3 years ago
0
Bump lodash from 4.17.15 to 4.17.19
#56
dependabot[bot]
closed
4 years ago
0
Bump acorn from 5.5.3 to 7.1.1
#55
dependabot[bot]
closed
4 years ago
1
No dependencies and simple architecture
#54
eklem
opened
5 years ago
1
Check out "KY" instead of barebone fetch()
#53
eklem
closed
5 years ago
1
Test with Gatsby
#52
eklem
opened
6 years ago
0
Change GitHub-pages to index crawled pages
#51
eklem
opened
6 years ago
0
Follow links: true/false
#50
eklem
opened
6 years ago
0
Fill Jekyll site with documentation
#49
eklem
opened
6 years ago
0
Change Jekyll template to crawl pages
#48
eklem
opened
6 years ago
1
Update index
#47
eklem
closed
5 years ago
0
Test with Webflow
#46
eklem
opened
6 years ago
0
Test with Hugo
#45
eklem
opened
6 years ago
0
Make it sync both ways with norch.io
#44
eklem
closed
5 years ago
1
Layout for a presentation
#43
eklem
opened
6 years ago
0
Demo: Make data and data count visible
#42
eklem
opened
6 years ago
1
Add URL(s) to URL-queue before crawling start
#41
eklem
closed
5 years ago
1
pouchDB for URL-queue
#40
eklem
opened
6 years ago
3
Promisify the crawling and indexing process
#39
eklem
opened
6 years ago
0
search-index-housekeeper may need to be a part of crawler-in-browser
#38
eklem
closed
5 years ago
1
Generate static test/demo site w/ Jekyll
#37
eklem
opened
6 years ago
5
Crawl queue as a Web Streams AIP?
#36
eklem
closed
5 years ago
2
store in indexdb/leveldb what is indexed
#35
eklem
closed
5 years ago
2
Wrap the fecth() promise in a function
#34
eklem
opened
6 years ago
1
Set up test module/project
#33
eklem
opened
6 years ago
0
In use with a search index: When to do a recrawl?
#32
eklem
closed
4 years ago
2
Example: How to populate a tag with content from crawler
#31
eklem
opened
6 years ago
0
crawler needs to add id = URL
#30
eklem
closed
6 years ago
0
cheerio syntax for both strings and arrays (i.e. html lists)
#29
eklem
opened
6 years ago
0
Documentation: How to get going with CDN library
#28
eklem
opened
6 years ago
0
Test to see if -t brfs is needed
#27
eklem
opened
6 years ago
0
Second example: How to run your own search engine
#26
eklem
opened
6 years ago
0
Rename searchapp.js to app.js
#25
eklem
opened
6 years ago
0
Main example: Get content and console.log() it
#24
eklem
opened
6 years ago
0
set header info for fetch()
#23
eklem
opened
6 years ago
1
Put browserified library on cdn
#22
eklem
opened
6 years ago
0
How to transfer crawled stuff from the promise
#21
eklem
closed
6 years ago
1
Show how to add a tool-chain
#20
eklem
opened
6 years ago
0
Figure out search-index in the browser
#19
eklem
closed
6 years ago
1
See if opensearch xml can connect browser search box with browserified search
#18
eklem
opened
6 years ago
0
Do all crawls (fetch) and cheerio-stuff before adding to search index
#17
eklem
opened
6 years ago
3
Next