search

wisecubeai / pythia

Open source AI hallucination monitoring
https://askpythia.ai/
Apache License 2.0
4 stars 0 forks source link

Benchmarking Pythia Processing throughput performance #5

Open cloudronin opened 1 week ago

cloudronin commented 1 week ago

we need to benchmark the performance of Pythia's performance in terms of the number of traces it can process based on some sample datasets on a single machine.

It would be good to publish these numbers to let users know what kind of throughput they can expect from Pythia in a single machine

pratacosmin commented 15 hours ago

Instance configuration: x cpu, y RAM. Questions :

ChatGPT(model?)

Setup Time
No Validator 0
DetectPii 0
All Validators 0

Docker Model

Setup Time
No Validator 0
DetectPii 0
All Validators 0