search

ManiMozaffar / linkedIn-scraper

A playwright bot which is implemented to scrape linkedin and store advertisement data in a database and telegram channel
228 stars 23 forks source link

Different Phases Of Development #17

Open ManiMozaffar opened 1 year ago

ManiMozaffar commented 1 year ago
  1. [x] Leverage async more to speed up crawling
  2. [x] SOLID implementation of crawling core, for flexibility in changing core or having multiple cores
  3. [ ] Ada core implementation instead of ThebAI
  4. [ ] SOLID implementation of FastAPI backend service for flexibility in changing cores or having multiple cores for filter queries
  5. [ ] Admin authentication backend
  6. [ ] Direct query ability backend
  7. [ ] Deploy to a server, so that information can be retrieved by third party
  8. [ ] Use a Lua script to evaluate filter queries and less overhead of connections as a new core (may need help)
  9. [ ] Telegram bot's feature to integrate with backend query ability
ManiMozaffar commented 1 year ago

19

Done first 2 task :)

ManiMozaffar commented 1 year ago

Thanks to @josephlimtech and Proxycurl, I can continue integration with Ada core ASAP :>