-
My Gpu Config
Tensorrt Engine Build Command
python3 build.py --model_dir /opt/llms/llama-7b
--dtype float16
--remove_i…
-
Consider the Open Philanthropy Project's [sample definition](https://www.openphilanthropy.org/focus/global-catastrophic-risks/potential-risks-advanced-artificial-intelligence/ai-timelines#What_are_we_…
-
Some inefficiencies that stand out include:
- needing to create a new `GlobalOptions` for every call
- needing (further) to load the API key from the text file for every call
- needing to call parseVa…
-
Currently, all signatures and public keys are just wrapper structs of bytes.
For better performance and consistency, they should be wrappers of some types representing points in elliptic curves.
…
-
Parsec, and more specifically the [Parsec Rust client](https://github.com/parallaxsecond/parsec-client-rust), would be a good candidate for an Ockam Vault implementation. See [this discussion](https:/…
-
### System Info
Linux devserver-ei 5.4.0-144-generic #161-Ubuntu SMP Fri Feb 3 14:49:04 UTC 2023 x86_64 x86_64 x86_64 GNU/Linux
![image](https://github.com/triton-inference-server/tensorrtllm_back…
-
### User Story
As an OPS System Admin, in order to efficiently and independently manage procurement shop fee changes, I want to be able to set/change fee amounts and logic for different agreement type…
-
From what I can tell, this is basically present (since the loader syntax is identical), except systemd-boot needs the loaders and kernels to be on the ESP (/boot/efi), not where OSTree places them cur…
-
Currently, a header has 30 signatures. It's almost 2KB.
If we use signature aggregation for seal field, we can reduce the header size sharply.
-
Init bls only once and pass it to validate signature function