encord-team text-to-image-eval issues

encord-team / text-to-image-eval

Evaluate custom and HuggingFace text-to-image/zero-shot-image-classification models like CLIP, SigLIP, DFN5B, and EVA-CLIP. Metrics include Zero-shot accuracy, Linear Probe, Image retrieval, and KNN accuracy.

https://encord.com

Apache License 2.0

35 stars 1 forks source link

issues

Newest

Newest Most commented Recently updated Oldest Least commented Least recently updated

chore: add evaluation save option in readme

#85 eloy-encord closed 3 months ago
0
chore: Improve download speed of Encord Datasets

#84 eloy-encord closed 3 months ago
0
Adding support for Hybrid-CLIP models such as MedCLIP variants also Evaluation Data saving.

#83 TennoSerra opened 3 months ago
1
add upcoming webinar banner

#82 frederik-encord closed 3 months ago
0
chore: update notebooks with python310

#81 eloy-encord closed 3 months ago
0
refactor: use faiss instead of autofaiss

#80 frederik-encord closed 3 months ago
0
downgrade requirements to python 3.10 and replace enum

#79 frederik-encord closed 3 months ago
0
chore: add quickstart colab notebooks

#78 eloy-encord closed 5 months ago
0
misc: update progress bar description

#77 eloy-encord closed 5 months ago
0
fix: set fixed evaluators order and title as classmethod

#76 eloy-encord closed 5 months ago
1
misc: minor updates

#75 eloy-encord closed 5 months ago
0
chore: shuffle data on the generated HF splits

#74 eloy-encord closed 5 months ago
0
fix: empty dataset splits

#73 eloy-encord closed 5 months ago
0
chore: update HF model naming convention

#72 eloy-encord closed 5 months ago
0
fix: error when Encord is the first downloaded dataset source

#71 eloy-encord closed 5 months ago
0
misc: add license tag and improved texts to readme

#70 eloy-encord closed 5 months ago
0
chore: add cli animate arguments

#69 eloy-encord closed 6 months ago
0
fix: typos in readme

#68 frederik-encord closed 6 months ago
0
chore: disclaimer on autofaiss

#67 frederik-encord closed 6 months ago
0
chore: add known results

#66 frederik-encord closed 6 months ago
0
add apache 2 license

#65 frederik-encord closed 6 months ago
0
fix broken urls

#64 frederik-encord closed 6 months ago
0
refactor: rename tool and update README

#63 frederik-encord closed 6 months ago
0
chore: add CTA

#62 eloy-encord closed 6 months ago
0
chore: remove imports from `common` submodule to other submodules

#61 eloy-encord closed 6 months ago
0
chore: link to HF models

#60 frederik-encord closed 6 months ago
0
chore: add how to dos and cleanup

#59 eloy-encord closed 6 months ago
0
Add support for multi-label classification datasets like `alkzar90/NIH-Chest-X-ray-dataset` from Hugging Face

#58 eloy-encord opened 6 months ago
0
Trouble adding `Qdrant/google-landmark-geo` Hugging Face geospatial dataset.

#57 eloy-encord opened 6 months ago
0
chore: refactor dataset and model types

#56 eloy-encord closed 6 months ago
0
misc: remove unused packages

#55 eloy-encord closed 6 months ago
0
chore: polish cli commands and descriptions

#54 eloy-encord closed 6 months ago
0
feat: detach resources from providers

#53 eloy-encord closed 6 months ago
0
feat: avoid refetch of downloaded encord data

#52 eloy-encord closed 6 months ago
0
feat: add splits to datasets

#51 eloy-encord closed 6 months ago
0
feat: add image retrieval model evaluation metric

#50 eloy-encord closed 6 months ago
0
fix: always overwrite embeddings in CLI's build

#49 eloy-encord closed 7 months ago
1
feat: enable multiuser access to HF datasets

#48 eloy-encord closed 7 months ago
0
feat: better model selection in animation code

#47 eloy-encord closed 7 months ago
0
Add text embeddings

#46 eloy-encord closed 7 months ago
0
chore: sort evaluation results

#45 eloy-encord closed 7 months ago
0
feat: allow choosing reduction type on animation

#44 eloy-encord closed 7 months ago
0
feat: support models from local sources

#43 eloy-encord closed 7 months ago
0
fix: missing column name check

#42 eloy-encord closed 7 months ago
0
fix: broken models

#41 eloy-encord closed 7 months ago
0
chore: store models in the global cache

#40 eloy-encord closed 7 months ago
0
feat: fix broken medical datasets

#39 eloy-encord closed 7 months ago
0
feat: interactive embedding interpolation plus prettier gifs

#38 frederik-encord closed 8 months ago
0
labels class property. Encord animations working okay

#37 Jim-Encord closed 8 months ago
0
fix: open clip device

#36 eloy-encord closed 8 months ago
0