Lightning-AI torchmetrics issues

Lightning-AI / torchmetrics

Machine learning metrics for distributed, scalable PyTorch applications.

https://lightning.ai/docs/torchmetrics/

Apache License 2.0

2.15k stars 409 forks source link

issues

Newest

Newest Most commented Recently updated Oldest Least commented Least recently updated

`RetrievalRecall` and `RetrievalMRR` seem to function differently for `world_size > 1` and `top_k=1`

#2852 AdrianM0 opened 1 day ago
3
`DiceScore(average="weighted")` produces scores bigger than 1.0

#2851 nkaenzig opened 1 day ago
0
`DiceScore` yields 1.0 scores when using `average="none"` for samples where class is not present

#2850 nkaenzig opened 1 day ago
0
Dice: The `ignore_index` 255 is not valid for inputs with 6 classes

#2849 robmarkcole opened 1 day ago
2
Fix issue with shared state of `MetricCollection` compute group when using `DiceScore(average="weighted")`

#2848 nkaenzig opened 1 day ago
1
`DiceScore(average="weighted")` doesn't work when in same compute group within `MetricCollection`

#2847 nkaenzig opened 1 day ago
0
`GeneralizedDiceScore` yields 0 scores when using `per_class=True` for samples where class is not present

#2846 nkaenzig opened 2 days ago
1
build(deps): bump pytest-rerunfailures from 14.0 to 15.0 in /requirements

#2845 dependabot[bot] closed 4 days ago
1
build(deps): bump lightning-utilities from 0.11.8 to 0.11.9 in /requirements

#2844 dependabot[bot] closed 4 days ago
1
build(deps): bump pytest-doctestplus from 1.2.1 to 1.3.0 in /requirements

#2843 dependabot[bot] closed 4 days ago
1
Where is the guide document for building?

#2842 zhaozheng09 closed 5 days ago
2
Make num_classes optional, in case of micro averaging

#2841 baskrahmer opened 1 week ago
2
Delete Device2Host caused by comm with device and host

#2840 zhaozheng09 opened 1 week ago
3
Fix `top_k` for `multiclass-f1score`

#2839 rittik9 opened 1 week ago
4
Fix typo in error message

#2838 ndrwrbgs closed 1 week ago
1
`num_classes` should not be required when using micro averaging

#2837 edmcman opened 2 weeks ago
2
CI: testing with next PyTorch 2.6

#2836 Borda opened 2 weeks ago
1
build(deps): update pygithub requirement from <2.5.0,>2.0.0 to >2.0.0,<2.6.0 in /requirements

#2835 dependabot[bot] closed 2 weeks ago
1
build(deps): update tqdm requirement from <4.67.0 to <4.68.0 in /requirements

#2834 dependabot[bot] closed 2 weeks ago
2
build(deps): update regex requirement from <=2024.9.11,>=2021.9.24 to >=2021.9.24,<=2024.11.6 in /requirements

#2833 dependabot[bot] closed 2 weeks ago
1
Fix segmentation `Dice` + `GeneralizedDice` for 2d index tensors

#2832 SkafteNicki closed 2 weeks ago
1
MathJax rendering difficult to read for dark mode

#2831 agkphysics opened 2 weeks ago
4
Fix mixed results of `rouge_score` with `accumulate='best'`

#2830 rittik9 closed 2 weeks ago
1
releasing minor `1.5.2` [rebase & merge]

#2829 Borda closed 3 weeks ago
1
Reference Metric in multiclass pecision recall unittests provides wrong answer when ```ignore_index``` is specified with ```average = 'macro'```

#2828 rittik9 opened 3 weeks ago
1
bump: drop support for python 3.8

#2827 Borda closed 3 weeks ago
2
ci: bump integration test to 3.9+ & patch `np.Inf`

#2826 Borda closed 3 weeks ago
1
build(deps): bump pytest-cov from 5.0.0 to 6.0.0 in /requirements

#2825 dependabot[bot] closed 2 weeks ago
2
build(deps): bump torch from 2.5.0 to 2.5.1 in /requirements

#2824 dependabot[bot] closed 3 weeks ago
1
build(deps): update onnxruntime requirement from <1.20,>=1.12.0 to >=1.12.0,<1.21 in /requirements

#2823 dependabot[bot] closed 3 weeks ago
1
build(deps): update numpy requirement from <2.0 to <3.0 in /requirements

#2822 dependabot[bot] closed 3 weeks ago
2
How to find recall for each class using MeanAveragePrecision

#2821 shanalikhan opened 3 weeks ago
4
ci: bump deprecated mac 12 to 13

#2820 Borda closed 3 weeks ago
1
[Bug] `torchmetrics.functional.classification.binary_auroc` gives wrong results when logits are large

#2819 zbingsong opened 4 weeks ago
1
build(deps): bump Lightning-AI/utilities from 0.11.7 to 0.11.8

#2818 dependabot[bot] closed 3 weeks ago
1
build(deps): bump pypa/gh-action-pypi-publish from 1.10.2 to 1.11.0

#2817 dependabot[bot] closed 3 weeks ago
1
GeneralizedDiceScore fails with 2D tensors and `input_format="index"`

#2816 fguiotte closed 2 weeks ago
1
tests: cleaning classif.

#2815 Borda closed 4 weeks ago
1
docs: specify directives

#2814 Borda closed 4 weeks ago
1
Fix `MetricCollection` compatibility with `torch.jit.script`

#2813 SkafteNicki closed 4 weeks ago
1
`MetricsCollection` is not Pytorch JIT-able due to its `metric_state` property

#2812 ethantang-db closed 4 weeks ago
1
fix assert in pit.py

#2811 StalkerShurik closed 1 month ago
1
build(deps): update numpy requirement from <2.0 to <3.0 in /requirements

#2810 dependabot[bot] closed 1 month ago
1
build(deps): bump cachier from 3.0.1 to 3.1.2 in /requirements

#2809 dependabot[bot] closed 1 month ago
1
build(deps): bump mypy from 1.11.2 to 1.13.0 in /requirements

#2808 dependabot[bot] closed 1 month ago
1
build(deps): update transformers requirement from <4.46.0,>4.4.0 to >4.4.0,<4.47.0 in /requirements

#2807 dependabot[bot] closed 1 month ago
1
Bugfix for empty preds or target in iou scores

#2806 SkafteNicki closed 1 month ago
4
Incorrect IntersectionOverUnion calculations when predictions or targets contain empty boxes

#2805 yurithefury closed 1 month ago
1
Re-adding `numpy` 2+ support

#2804 adamjstewart closed 1 month ago
1
ci: fix missed testing with oldest

#2803 Borda closed 1 month ago
2