argilla-io / argilla

Argilla is a collaboration tool for AI engineers and domain experts to build high-quality datasets
https://docs.argilla.io
Apache License 2.0
4k stars 378 forks source link

[BUG-python/deployment] #5677

Open alaeddine-13 opened 2 weeks ago

alaeddine-13 commented 2 weeks ago

Describe the bug Argilla client V2 is not compatible with Argilla server V1 for RankingQuestion Prerequisites

  1. create an annotation task with a RankingQuestion "rank", on an Argilla server v1 (1.29.0)
  2. Annotate the dataset with entries containing different ranking values Stacktrace and Code to create the bug Pull the dataset with python client v2 (2.4.0)
    
    client = rg.Argilla(
    api_url=ARGILLA_URL,
    api_key=ARGILLA_API_KEY,
    )

workspace = 'my-workspace' project ='my-project'

dataset = client.datasets(name=project, workspace=workspace) df = dataset.records.to_datasets().to_pandas()



The "rank" column has fixed ranking and they do not reflect the annotated entries

**Expected behavior**
Entries should reflect the annotation.

**Environment:**
 - Argilla server Version 1.29.0:
 - Argilla client Version 2.4.0
AmanLohia1009 commented 1 week ago

Also, suggestions for RankingQuestion do not display correctly in the UI. It shows a fixed order.

any workaround or solution for this?

rautnavnath commented 1 day ago

has anyone found fix for issue? The "rank" column has fixed ranking and they do not reflect the annotated entries

dvsrepo commented 1 day ago

hi! we would strongly recommend upgrading the server to a newer version, isn't that possible? otherwise install the client with the version of your server pip install argilla=1.29.0

rautnavnath commented 22 hours ago

hi! we would strongly recommend upgrading the server to a newer version, isn't that possible? otherwise install the client with the version of your server pip install argilla=1.29.0

I have latest image deployed through docker. and Argilla client Version 2.4.0