-
Hi TransLLM owner, Do you have like benchmark data where expected output is provided?
Cheers!
-
#### Specific Task:
For this project, your main challenge is improving phishing detection by developing a real-time, multimodal system based on transformers and other features like URLs and metadata.…
-
Hi, I'm running FID evaluation code by following command
```bash
bash scripts/autoregressive/sample_c2i.sh --vq-ckpt ./pretrained_models/vq_ds16_c2i.pt --gpt-ckpt ./pretrained_models/c2i_B.pt --gpt-…
-
Hi,
I am trying to run some LLMs (currently trying openai models) on MMLU. My first question is which configuration is the standard setup (5 shot without CoT)? What does flan mean in some of the c…
-
**Describe the bug**
When a kernel function is invoked directly via
```C#
public async Task InvokeAsync(
string? pluginName,
string functionName,
KernelArguments? argumen…
-
Hello!
Congratulations on the new program release!
But when will it be possible to install Office in the specified folder?
-
Hi,
thank you for the interesting work!
I am trying to reproduce the results for LLaMA-2-7b on LIMAEval for the discard method.
I ran the evaluation script after generating with the release mode…
-
RAG Evaluation
1. 100 questions
Types of questions:
- 60 on general trade
- 12 on growth/variation
- 28 on rankings
2. RAG evaluation results
Best combination tested so far: multi-qa-mpne…
-
Hi, I am wondering if there are any inference examples on pre-trained MoE models. I tried the `generate_text.sh` in the latest repo, but it raises a couple of issues. Namely, I will need to comment ou…
-
Hi,
I'm currently trying to replicate the performance of Qwen2-Audio on the AIR Bench. However, I noticed that the repository at [AIR-Bench](https://github.com/OFA-Sys/AIR-Bench/blob/main/score_cha…