-
Hello-
I've been looking into hosting an LLM on AWS Infrastructure. I am mainly looking to host Flan T5 XXL. My question is below
Inquiry: what is the recommended container for hosting Flan T5 X…
-
See zcash/zips#351, #679, and #1392 for motivation.
daira updated
8 months ago
-
According to the paper, godel-scheduler is a shared-state scheduler. Where can I find the implementation in the code? Particularly how to synchronize the of the global cluster view?
-
### Proposal to improve performance
I've been trying to write a reliable benchmark to be used with vllm, and I discovered that when I use the openAI client it can't scale. If I try to use 50 concur…
-
Using `-march=native` and/or `-O3` compilation flags can result in a significantly (more that x2) slower executable.
The code I am seeing problems with is https://github.com/wolfpld/etcpak, specifi…
-
Currently, we have a 6s block time, I suspect this is quite arbitrary, and that it may be safe to reduce it, also possibly reducing max block weight of each block, as we likely are very far from exhau…
-
Hey there,
First of all thank you for this amazing resource. I have found the documentation to be very helpful and the code to be quite stable across difference machines.
I'm working on a multi-…
-
Hello guys,
I am using badgerhold as an in-memory database. The size of the database is around 200 records. The use case involves filtering based on multiple fields as an *and* operation. Consider th…
-
Hi there. I'm running a 4-shard cluster on EC2 Amazon Linux 2023 instances. About once a day, we are seeing redis crash with this error from the RedisJSON module. This always happens on a master, but …
-
https://www.upsolver.com/blog/batch-stream-a-cheat-sheet
_Originally posted by @christianfelicite in https://github.com/TheFeloDevTeam/FeloFamilySite/issues/57#issuecomment-655962286_
What is stream…