-
**As a** data scientist
**I need** to study methods for assessing the factual accuracy of LLM responses
**So that** we can verify the correctness of information provided by each model
### Details…
-
# Proposed Feature
Today, we support hardwired arguments to an AnalysisRun:
```yaml
verification:
analysisTemplates:
- name: cat-fact
args:
- name: foo
value: bar
…
-
# FEVER: a large-scale dataset for Fact Extraction and Verification
source: https://arxiv.org/abs/1803.05355
### Abstract
Each claim —classify—> (Supported, Refuted, Not enough info)
For S…
-
### Feature Description
With issue report #337 HTTP tls verification for v1 was implemented.
In fact this feature is missing in version 2 and the master branch.
Easy way would be to upstream the…
-
Currently, Catala has `assertion`s that let the user specify boolean facts that should hold true when the program runes (else the program crashes). These assertions are actually triple-use : they also…
-
I just wanted to flag a VDAF security consideration relevant to late task binding: [draft-irtf-cfrg-vdaf, Section 9.1](https://cfrg.github.io/draft-irtf-cfrg-vdaf/draft-irtf-cfrg-vdaf.html#section-9.1…
-
-
On the most recent version of the development branch, tests `66, 68, 69` fail on my school machine. But not my laptop.
At school, I am compiling on x86_64 Intel, with OpenMPI 4.1.4
On my laptop, I…
-
# Proposed Feature
Today we support project (namespace) scoped AnalysisTemplates, but Argo Rollouts also has ClusterAnalysisTemplates. Currently, Kargo Stages can't reference them.
It's been req…
-
The counterexample generation feature is currently only a suggestion for a possible counterexample. This can help point users towards the bug in their code if there is one, but may not in fact be proo…