-
# Problem
There are still some inconsistencies between scrapers. Sometimes we build up a big hash of data and do a single database insert, sometimes we call `#to_h` on a scraper subclass in a loop.…
-
Dear sir,
thanks for your sharing of using FastAPI at production level, I am using FastAPI as well now, but I found that it seems that the only disturbing point to me is that the choice of ORM mode…
-
Hi @jodevsa / @Matthew-Beckett ,
Thanks for the amazing work here, it really makes the deployment of wireguard painless.
I have a use case in the internet of things world, where I would like to be…
-
Setup a simple express server, hosted on EC2, that performs the scraping and saving operations. These are currently performed by me on my local machine but I'd like to move them to AWS.
Ideally, s…
-
In #255, @aganders3 explored alternative pypi api's. The XML-RPC api looked a bit faster and possibly more reliable but may be deprecated soon.
_Originally posted by @aganders3 in https://github.co…
-
So, BASE (http://www.base-search.net) indexes many repositories that have an OAI-PMH interface, which is already very useful and covers most of the respectable repositories.
But unfortunately, many r…
-
Django is a python framework for making a basic website.
break this into following tasks:
- [x] try make a completely blank website and database first then see about adding things into it.
- [ ] we…
-
### The repo for the Texas fork of this project is [here](https://github.com/gregoryfoster/openstates/tree/pupa-tx). If you'd like to contribute to the parent project, check out the [open issues](http…
-
It might be a good idea to
- use western comics for comic related boards,
- use code snippets and logos for tech related boards,
- use use political figures and symbolism for political boards, and …
-
After looking around for some questions for a while, it stops giving results for any search term. This happens when there is not much delay between the searches. Thus, making DuckDuckGo temporarily bl…