search

QpxDesign / TREC-iKAT

An attempt of the iKAT (Interactive Knowledge Assistance Track) Track of the 2023 run of the NIST's TREC.
2 stars 1 forks source link

can't use 70B param llama2 - doesn't have option for n_ctx #13

Closed QpxDesign closed 1 year ago

QpxDesign commented 1 year ago

ehhh, lllama generation takes too long anyway due to lack of GPU support, so 70B is out of reach.