-
I'm trying to figure out how to implement page load times. I think it would be done by extending PageFetcher, but I'm not sure how to get the load time data (a float value?) back into the WebCrawler.…
-
### Code Snippet :
CrawlConfig config = new CrawlConfig();
config.setCrawlStorageFolder(ServiceConfiguration.getConfiguration().crawlerTempFolder);
config.setPolitenessDelay(1500);
config.setMax…
-
The webcrawler is the only class for the game but unfortunately it only goes to level 10. We might have to add a few Advanced Class options for the player to pick for level 11-20 - preferably one per …
-
### What problem does this feature solve?
I am trying to exctract information from the documentation that would look something like this:
{
"type": {
"Format": "LabelList",
"Descripti…
-
I tried running it locally, but it stops without any errors after 2 or so seconds.
It seems like the web version does the same.
`spotgen https://www.reddit.com/r/AskReddit/comments/43zdqe/what_is_…
-
Stats for June on one of my sites
![image](https://github.com/Piwigo/AStat/assets/3930716/653014bf-d698-4205-b01f-3aff7158e180)
That site is also monitored by Matomo
June
![image](https://gith…
Ainz updated
3 months ago
-
Comb all Illinois HS t&f data on athletic.net, dyestat.com, directathletics, milesplit, etc. and write webcrawler
Do crazy predictive statistics
-
-
## tl;dr
Life is hard, but writing a fast parallel webcrawler doesn't have to be. I'd like to make it as easy as possible to create a fast and parallel crawler. I'd like to essentially implement th…
-
Webcrawler characters gain Contacts naturally.
Basically contacts are automatically rolling their checks as much as possible (probably better to exchange hours for days in this case).
Contacts …