MGPC Hardware Request - Githubissues

ARPA-H-FEAST / management

Repository for project management

0 stars 0 forks source link

MGPC Hardware Request #56

Open lorikrammer opened 4 days ago

lorikrammer commented 4 days ago

Lori to start paperwork to purchase hardware for FEAST. Lori to send request to Dani who will confirm that it is approved (with diagram & paragraph). Then Lori will pass it on to Anelia to work with Dacian regarding the specs.

[ ] Get budget of 30K approved by Dani
[ ] Work with Anelia & Dacian to spec it out
[ ] Get the quote/specs approved by Vahan & Raja
[ ] Submit order request with Dacian (handoff to Vishal for tracking)

pmcneely commented 2 days ago

@lorikrammer I put together the foundational hardware request for the new GlyGen server that replaced our AWS instance. Happy to provide input here if it's useful

pmcneely commented 2 days ago

Also, I'd like to request that we get at least 1 A100 (or better...) GPU included for running & tuning LLMs locally

lorikrammer commented 1 day ago

@pmcneely I would greatly appreciate your input! I created a draft request but it is not very technical. Can you take a moment to review it?

pmcneely commented 2 hours ago

See the hardware proposal I scoped out in this ticket. The higher end of this (e.g., 2 of those processors + 1.5-2TB of RAM) will probably be ~$23,000. An A100 server video card for running an LLM locally will run the remaining $7k or so (see e.g. at amazon).