Twig Research

Research for twigslot.com

Experimental ML research, crawler prototypes, and anything that pushes the boundary of twigslot's cabilities go here.

Scraping

To run the wiki spider,

cd twig_scraper
scrapy crawl wiki -O wiki.json

Deploying Autofill Server

To deploy an autofill server,

# Note: remember to change the version from v1.0 
docker build -t tch1001/autofill_server:v1.0 . \
    -f ./api_server/Dockerfile
docker push tch1001/autofill_server:v1.0 
kubectl apply -f kubernetes/autofill-service.yaml