main
System/Docker overview
Docker preperation
For each directory: crawl_index, es_index, es_search, model_serv do make build push
Docker Compose
cd main
make up
Crawl & Index
docker exec -it crawl-index-container /bin/bash
# crawl.sh
Search test
http://localhost:8890
Kubernates
minikube start
cd main
make kup
Crawl & Index
kubectl exec --stdin --tty crawl-index-... -- /bin/bash
# crawl.sh
Search test
kubectl port-forward --address 0.0.0.0 services/es-search 9977:8890
http://localhost:9977
Lectures topics Friday 2PM-4PM HKT (Tentative)
- (2/10)
- (2/10) MLOps overview, demo system (docker, kubernates) overview
- (2/17)Streamlit + FastAPI
- Tutorial: https://streamlitpython.com/
- Book: Building Python Web APIs with FastAPI By Abdulazeez Abdulazeez Adeshina
- Book: Web Application Development with Streamlit: Develop and Deploy Secure and Scalable Web Applications to the Cloud Using a Pure Python Framework By Mohammad Khorasani, Mohamed Abdou, Javier Hernández Fernández
- (2/24) Elastic search 101: Elastic search expert (Jong Min)
- (3/3) Filebeat + Kibana: Kibana expert (Jong Min)
- (3/10)Large-scale transformer models (Kevin Ko, TUNiB)
- (3/17) Project introduction
- (3/24) Larage Language Model (Chatgpt) actions at MS
- Project proposal (5 min talk)
- (3/31) Google cloud infra training/serving (Chansung Park/Sayak Paul), Hugging face (Sayak Paul, Hugging Face)
- (4/7) AWS cloud infra (serving, ECS)(YJ Jeong from AWS)
- (4/14) LLM1: Alpaca
- (4/21) No class -- Please work on project
- (4/28) Last Lecture: LLM2: LLaMa
- (5/5) Final project presenations