search

os-climate / aicoe-osc-demo

This repository is the central location for the demos the ET data science team is developing within the OS-Climate project. This demo shows how to use the tools provided by Open Data Hub (ODH) running on the Operate First cluster to perform ETL, create training and inference pipelines.
Apache License 2.0
10 stars 24 forks source link

TrinoUserError #238

Closed Jeevi281 closed 1 year ago

Jeevi281 commented 1 year ago

Describe the bug Getting error while executing create_result_table notebook

To Reproduce Steps to reproduce the behavior: After started running the pipeline

  1. Go to 'kubeflow'
  2. Click on 'Runs' Screenshot (232)

Error Message: TrinoUserError: TrinoUserError(type=USER_ERROR, name=INVALID_TABLE_PROPERTY, message="Catalog 'osc_datacommons_dev' table property 'external_location' does not exist", query_id=20221116_050359_00160_hqiev)

Expected behavior To execute susscessfully without any error

Screenshots If applicable, add screenshots to help explain your problem.

Additional context Add any other context about the problem here.

HeatherAck commented 1 year ago

@erikerlandson can you please take a look

Jeevi281 commented 1 year ago

@erikerlandson can you please help with this?

HeatherAck commented 1 year ago

adding @rynofinn and @Shreyanand

HeatherAck commented 1 year ago

@Jeevi281 - can u let us know if you are using osc ingest tools? can you let us know what version of software / image you are using and notebook? - please provide us link to github

Shreyanand commented 1 year ago

@Jeevi281 this seems like an old version of the notebook. You could pull in the latest changes from this repository that has the updated create_results_table notebook that uses the iceberg catalog. I'm working on creating a new docker image that includes the latest code directly.

On a separate note, what is your aim in running these notebooks? If you can describe your use case, I'd be able help better.

HeatherAck commented 1 year ago

@Jeevi281 - we assume the version is the problem. closing - please reopen if you have issues