-
Hello, congratulations on completing such solid work! Will the Benchmark Dataset be open-sourced? Also, is there a rough timeline available? Also, is there a timeline available?
-
A great initial effort was made by @DBCerigo @TNTran92 @alex-hh to create a user-friendly sktime benchmarking interface for quick univariate forecasting benchmarks. The decision to include Kotsu as pa…
-
**Is your feature request related to a problem? Please describe.**
Time series packages often provide their own benchmarks (e.g. [Nixtla/statsforecast](https://github.com/Nixtla/statsforecast/blob/…
-
Hi,
Thanks for your effort, which is really needed by the community!
I was wondering whether it wouldn't be easier if you provided datasets and metrics, and the user can then make predictions fo…
MUCDK updated
2 months ago
-
Hi,
I hope you are doing well.
I was trying to use BiLSTM using UoC database, using the command line below:
`python train.py --model_name BiLSTM1d --data_name UoC --data_dir ./Data/Mechanica…
-
## Issue
The goal of this issue is to implement the following baseline defences to evaluate on the Benchmark Datasets:
- Gradient Ascent
- RepNoise (see https://github.com/domenicrosati/represent…
-
We propose to add some basic unit test framework (likely pytest) and tests to the inference repo. Ideally, it should test:
- All configuration (mlperf.conf, user.conf) is valid and working (i.e. wi…
-
Hi,
From my understanding of the paper and the structure of this [file](https://github.com/meta-llama/PurpleLlama/blob/7aef978f57f6bfef6c3be498d3dc6578449f47b0/CybersecurityBenchmarks/datasets/mitr…
-
Hi, @haesleinhuepf recommended I post this here.
Because you guys are making this evaluation benchmark public, couldn't LLMs use this as training data and therefore overfit to it?
So, it will be h…
-
Hi and thank you for this interesting piece of work!
I would like to ask if you validate the model without fine-tuning the backbone and only train the decoder, in that sense the encoder is frozen.
…