pykeen benchmarking issues

pykeen / benchmarking

📊 Results from the reproducibility and benchmarking studies presented in "Bringing Light Into the Dark: A Large-scale Evaluation of Knowledge Graph Embedding Models Under a Unified Framework" (http://arxiv.org/abs/2006.13365)

MIT License

35 stars 4 forks source link

issues

Newest

Newest Most commented Recently updated Oldest Least commented Least recently updated

Using custom pykeen dataset for ablation study

#29 serenalotreck closed 1 year ago
3
Not able to reproduce numbers for fb15k237 dataset- TuckER model (probably I'm missing something)

#28 kaushik333 closed 1 year ago
2
Lower results than in the paper for a model (probably doing something wrong)

#27 Filco306 opened 1 year ago
7
Can't clone repository (invalid path)

#26 nomisto opened 2 years ago
1
🔝🏋 Script to find best configuration for the given setting

#25 mberr closed 2 years ago
1
Add experimental artifacts

#24 mali-git closed 3 years ago
0
Update Artifacts

#23 mali-git closed 3 years ago
0
Update Results

#22 mali-git closed 3 years ago
0
Epoch runtime estimates for all HPO trials

#21 mberr opened 4 years ago
1
Remove mapping of table entries for inverse relations

#20 mali-git opened 4 years ago
0
Dataset-model-configuration->hits@10 score table

#19 cthoyt closed 4 years ago
1
Update result table with published results

#18 mberr opened 4 years ago
0
Results table for comparison with published results

#17 mberr closed 2 years ago
7
Add published results in machine-readable format

#16 mberr closed 4 years ago
6
Change Size Tables for Reproducibility Study

#15 mberr opened 4 years ago
2
Collect additional metrics during collation

#14 mberr opened 4 years ago
3
Improve skyline plots

#13 mberr closed 4 years ago
4
Remove default setting for 'inverse_triples'

#12 mali-git closed 4 years ago
1
Skyline Plot: Performance (e.g. H@1) vs. Model Size

#11 mberr closed 4 years ago
4
Wrong directory structure

#10 cthoyt closed 4 years ago
5
Why Only Maximum Value?

#9 mali-git closed 4 years ago
4
Generate result table

#8 mali-git closed 4 years ago
6
For each model a figure showing the training time for each setting

#7 mali-git closed 4 years ago
2
For each model a figure showing the best result for each setting

#6 mali-git closed 4 years ago
1
Upload model files via git LFS

#5 mberr closed 2 years ago
11
New visualizations

#4 cthoyt closed 4 years ago
0
ValueError

#3 mali-git closed 4 years ago
0
Write script to collate all results

#2 cthoyt closed 4 years ago
0
Remove test folder

#1 cthoyt closed 4 years ago
1