elastic search 적용하기

Elastic Search 사용하려면 밑에 명령어를 서버 terminal 에서 실행해야합니다.!!!

apt-get update && apt-get install -y gnupg2
wget -qO - https://artifacts.elastic.co/GPG-KEY-elasticsearch | apt-key add -
apt-get install apt-transport-https
echo "deb https://artifacts.elastic.co/packages/7.x/apt stable main" | tee /etc/apt/sources.list.d/elastic-7.x.list
apt-get update && apt-get install elasticsearch
service elasticsearch start
cd /usr/share/elasticsearch
bin/elasticsearch-plugin install analysis-nori
service elasticsearch restart

[x] elastic search 적용하기
- [x] 오피스아워 elastic search 다시 확인
- [x] code 구현

dense(klue/roberta-small encoder) vs sparse(TF-IDF) vs sparse(elastic_search) 비교

k	dense	걸린시간(초)	vs	TF-IDF	걸리시간(초)	vs
1	19.18	25.390	25.19	13.626	70.56	58.553
5	42.25	28.106	53.77	17.367	86.21	68.202
10	53.96	28.018	63.57	16.936	89.29	75.773
20	66.34	28.162	72.78	17.023	92.49	89.553
30	72.73	28.307	77.19	17.480	93.65	102.023
40	77.00	28.252	79.63	17.147	94.2	114.008
50	79.72	28.412	81.73	17.261	94.78	126.005
60	82.18	28.550	83.44	17.668	95.25	137.975
70	83.83	28.358	84.57	17.350	95.47	148.855
80	85.40	28.665	85.69	17.480	95.68	160.487
90	86.69	28.589	86.55	17.862	95.92	171.909
100	87.93	28.637	87.24	17.543	96.06	183.469

boostcampaitech2 / mrc-level2-nlp-04

elastic search 적용하기 #29