issues
search
allenporter
/
home-assistant-datasets
This package is a collection of datasets for evaluating AI Models in the context of Home Assistant.
https://allenporter.github.io/home-assistant-datasets
22
stars
1
forks
source link
issues
Newest
Newest
Most commented
Recently updated
Oldest
Least commented
Least recently updated
Add scores for Llama 3.2 3B and 1B
#47
tannisroot
closed
3 days ago
1
Update dependency openai to v1.48.0
#46
renovate[bot]
closed
3 days ago
1
Update dependency pytest_homeassistant_custom_component to v0.13.165
#45
renovate[bot]
closed
3 days ago
1
Add results for qwen2.5
#44
tannisroot
closed
3 days ago
4
Add evaluation qwen2.5 LLM
#43
xiasi0
closed
3 days ago
2
Update dependency setuptools to v75
#42
renovate[bot]
closed
2 weeks ago
0
Update dependency datasets to v3
#41
renovate[bot]
closed
2 weeks ago
0
Add mistral-nemo to the test suite
#40
tannisroot
closed
4 days ago
2
Update dependency pytest_homeassistant_custom_component to v0.13.159
#39
renovate[bot]
closed
3 weeks ago
1
Update dependency setuptools to v74.1.1
#38
renovate[bot]
closed
3 weeks ago
1
Update dependency setuptools to v74
#37
renovate[bot]
closed
1 month ago
0
Update dependency syrupy to v4.7.1 - autoclosed
#36
renovate[bot]
closed
1 month ago
1
Update dependency setuptools to v73
#35
renovate[bot]
closed
1 month ago
0
Update pre-commit hook charliermarsh/ruff-pre-commit to v0.6.1
#34
renovate[bot]
closed
1 month ago
1
Update dependency datasets to v2.21.0
#33
renovate[bot]
closed
1 month ago
1
Update dependency setuptools to v72.2.0 - autoclosed
#32
renovate[bot]
closed
1 month ago
1
Berkley Gorilla OpenFunctions
#31
super-qua
opened
1 month ago
6
Update dependency openai to v1.41.0
#30
renovate[bot]
closed
1 month ago
1
Update dependency pytest_homeassistant_custom_component to v0.13.154
#29
renovate[bot]
closed
1 month ago
1
Multilanguage support
#28
gacekk
opened
1 month ago
1
Update dependency PyYAML to v6.0.2
#27
renovate[bot]
closed
1 month ago
2
Update dependency openai to v1.40.0
#26
renovate[bot]
closed
1 month ago
1
Update pre-commit hook psf/black to v24.8.0
#25
renovate[bot]
closed
1 month ago
1
Update pre-commit hook codespell-project/codespell to v2.3.0
#24
renovate[bot]
closed
1 month ago
1
Update pre-commit hook charliermarsh/ruff-pre-commit to v0.5.6
#23
renovate[bot]
closed
1 month ago
1
Update dependency pdoc to v14.6.0
#22
renovate[bot]
closed
1 month ago
1
Update dependency openai to v1.38.0
#21
renovate[bot]
closed
1 month ago
1
Update dependency mypy to v1.11.1
#20
renovate[bot]
closed
1 month ago
1
Update dependency google-generativeai to v0.7.2
#19
renovate[bot]
closed
1 month ago
1
Update dependency tqdm to v4.66.5
#18
renovate[bot]
closed
1 month ago
2
Update dependency mashumaro to v3.13.1
#17
renovate[bot]
closed
1 month ago
1
Update dependency ollama to v0.3.1
#16
renovate[bot]
closed
1 month ago
0
/eval link in Readme is broke
#15
mikey60
closed
1 month ago
2
Dependency Dashboard
#14
renovate[bot]
opened
2 months ago
0
Support floors
#13
allenporter
opened
3 months ago
0
Support core dev environment
#12
allenporter
closed
2 months ago
1
Create assist data collection tool
#11
allenporter
closed
3 months ago
1
Update model output for v1 device actions eval
#10
allenporter
closed
4 months ago
0
Add device action data for gpt-4o
#9
allenporter
closed
4 months ago
0
Update assistant baseline and add gemini evaluations
#8
allenporter
closed
4 months ago
0
Update the device actions evaluation
#7
allenporter
closed
4 months ago
0
Restructure evaluations to be self contained
#6
allenporter
closed
4 months ago
0
Evaluation improves for the device action eval
#5
allenporter
closed
4 months ago
0
Update dom1-pl dataset
#4
allenporter
closed
4 months ago
0
Create a basic device action dataset
#3
allenporter
closed
4 months ago
0
Example model evaluation for device actions
#2
allenporter
closed
4 months ago
0
Configure Renovate - autoclosed
#1
renovate[bot]
closed
2 months ago
0