search

lancedb / lance

Modern columnar data format for ML and LLMs implemented in Rust. Convert from parquet in 2 lines of code for 100x faster random access, vector index, and data versioning. Compatible with Pandas, DuckDB, Polars, Pyarrow, and PyTorch with more integrations coming..
https://lancedb.github.io/lance/
Apache License 2.0
3.97k stars 224 forks source link

Azure storage error with decode timeout #3122

Closed LuQQiu closed 1 week ago

LuQQiu commented 1 week ago

Using Azure storage blob container to store the dataset When doing the vector creation with 1 million rows dataset See a bunch of the following error

2024-11-13T19:44:32.140990Z DEBUG get_range{range=161793051..168084507}: lance_io::object_reader: Retrying range 161793051..168084507 from dev/lu-0-0.lance/data/a45d9cbe-7e38-4eca-95ef-a604c5afec64.lance (remaining retries: 3).  Error details: Generic { store: "MicrosoftAzure", source: reqwest::Error { kind: Decode, source: reqwest::Error { kind: Body, source: TimedOut } } }
2024-11-13T19:46:20.402431Z DEBUG get_range{range=494573287..500864743}: lance_io::object_reader: Retrying range 494573287..500864743 from dev/lu-0-0.lance/data/a45d9cbe-7e38-4eca-95ef-a604c5afec64.lance (remaining retries: 3).  Error details: Generic { store: "MicrosoftAzure", source: reqwest::Error { kind: Decode, source: reqwest::Error { kind: Body, source: TimedOut } } }
2024-11-13T19:46:20.402562Z DEBUG get_range{range=487860228..494151684}: lance_io::object_reader: Retrying range 487860228..494151684 from dev/lu-0-0.lance/data/a45d9cbe-7e38-4eca-95ef-a604c5afec64.lance (remaining retries: 3).  Error details: Generic { store: "MicrosoftAzure", source: reqwest::Error { kind: Decode, source: reqwest::Error { kind: Body, source: TimedOut } } }
2024-11-13T19:46:20.402643Z DEBUG get_range{range=481141664..487433120}: lance_io::object_reader: Retrying range 481141664..487433120 from dev/lu-0-0.lance/data/a45d9cbe-7e38-4eca-95ef-a604c5afec64.lance (remaining retries: 3).  Error details: Generic { store: "MicrosoftAzure", source: reqwest::Error { kind: Decode, source: reqwest::Error { kind: Body, source: TimedOut } } }
2024-11-13T19:47:14.597345Z DEBUG get_range{range=655683653..661975109}: lance_io::object_reader: Retrying range 655683653..661975109 from dev/lu-0-0.lance/data/a45d9cbe-7e38-4eca-95ef-a604c5afec64.lance (remaining retries: 3).  Error details: Generic { store: "MicrosoftAzure", source: reqwest::Error { kind: Decode, source: reqwest::Error { kind: Body, source: TimedOut } } }
2024-11-13T19:47:14.597476Z DEBUG get_range{range=648965828..655257284}: lance_io::object_reader: Retrying range 648965828..655257284 from dev/lu-0-0.lance/data/a45d9cbe-7e38-4eca-95ef-a604c5afec64.lance (remaining retries: 3).  Error details: Generic { store: "MicrosoftAzure", source: reqwest::Error { kind: Decode, source: reqwest::Error { kind: Body, source: TimedOut } } }
2024-11-13T19:47:14.597561Z DEBUG get_range{range=642245847..648537303}: lance_io::object_reader: Retrying range 642245847..648537303 from dev/lu-0-0.lance/data/a45d9cbe-7e38-4eca-95ef-a604c5afec64.lance (remaining retries: 3).  Error details: Generic { store: "MicrosoftAzure", source: reqwest::Error { kind: Decode, source: reqwest::Error { kind: Body, source: TimedOut } } }
2024-11-13T19:48:08.710299Z DEBUG get_range{range=816834411..823125867}: lance_io::object_reader: Retrying range 816834411..823125867 from dev/lu-0-0.lance/data/a45d9cbe-7e38-4eca-95ef-a604c5afec64.lance (remaining retries: 3).  Error details: Generic { store: "MicrosoftAzure", source: reqwest::Error { kind: Decode, source: reqwest::Error { kind: Body, source: TimedOut } } }
2024-11-13T19:48:08.710430Z DEBUG get_range{range=810116795..816408251}: lance_io::object_reader: Retrying range 810116795..816408251 from dev/lu-0-0.lance/data/a45d9cbe-7e38-4eca-95ef-a604c5afec64.lance (remaining retries: 3).  Error details: Generic { store: "MicrosoftAzure", source: reqwest::Error { kind: Decode, source: reqwest::Error { kind: Body, source: TimedOut } } }
2024-11-13T19:48:08.710512Z DEBUG get_range{range=803394384..809685840}: lance_io::object_reader: Retrying range 803394384..809685840 from dev/lu-0-0.lance/data/a45d9cbe-7e38-4eca-95ef-a604c5afec64.lance (remaining retries: 3).  Error details: Generic { store: "MicrosoftAzure", source: reqwest::Error { kind: Decode, source: reqwest::Error { kind: Body, source: TimedOut } } }
2024-11-13T19:48:53.857756Z DEBUG get_range{range=937665254..943956710}: lance_io::object_reader: Retrying range 937665254..943956710 from dev/lu-0-0.lance/data/a45d9cbe-7e38-4eca-95ef-a604c5afec64.lance (remaining retries: 3).  Error details: Generic { store: "MicrosoftAzure", source: reqwest::Error { kind: Decode, source: reqwest::Error { kind: Body, source: TimedOut } } }
2024-11-13T19:48:53.857901Z DEBUG get_range{range=964504607..970796063}: lance_io::object_reader: Retrying range 964504607..970796063 from dev/lu-0-0.lance/data/a45d9cbe-7e38-4eca-95ef-a604c5afec64.lance (remaining retries: 3).  Error details: Generic { store: "MicrosoftAzure", source: reqwest::Error { kind: Decode, source: reqwest::Error { kind: Body, source: TimedOut } } }
2024-11-13T19:50:28.688415Z DEBUG get_range{range=1226326966..1232618422}: lance_io::object_reader: Retrying range 1226326966..1232618422 from dev/lu-0-0.lance/data/a45d9cbe-7e38-4eca-95ef-a604c5afec64.lance (remaining retries: 3).  Error details: Generic { store: "MicrosoftAzure", source: reqwest::Error { kind: Decode, source: reqwest::Error { kind: Body, source: TimedOut } } }
2024-11-13T19:50:28.688567Z DEBUG get_range{range=1219609169..1225900625}: lance_io::object_reader: Retrying range 1219609169..1225900625 from dev/lu-0-0.lance/data/a45d9cbe-7e38-4eca-95ef-a604c5afec64.lance (remaining retries: 3).  Error details: Generic { store: "MicrosoftAzure", source: reqwest::Error { kind: Decode, source: reqwest::Error { kind: Body, source: TimedOut } } }
2024-11-13T19:50:42.364164Z DEBUG get_range{range=1313513532..1319804988}: lance_io::object_reader: Retrying range 1313513532..1319804988 from dev/lu-0-0.lance/data/a45d9cbe-7e38-4eca-95ef-a604c5afec64.lance (remaining retries: 3).  Error details: Generic { store: "MicrosoftAzure", source: reqwest::Error { kind: Decode, source: reqwest::Error { kind: Body, source: TimedOut } } }
2024-11-13T19:51:36.324817Z DEBUG get_range{range=1467755328..1474046784}: lance_io::object_reader: Retrying range 1467755328..1474046784 from dev/lu-0-0.lance/data/a45d9cbe-7e38-4eca-95ef-a604c5afec64.lance (remaining retries: 3).  Error details: Generic { store: "MicrosoftAzure", source: reqwest::Error { kind: Decode, source: reqwest::Error { kind: Body, source: TimedOut } } }
2024-11-13T19:51:36.324951Z DEBUG get_range{range=1427468035..1433759491}: lance_io::object_reader: Retrying range 1427468035..1433759491 from dev/lu-0-0.lance/data/a45d9cbe-7e38-4eca-95ef-a604c5afec64.lance (remaining retries: 3).  Error details: Generic { store: "MicrosoftAzure", source: reqwest::Error { kind: Decode, source: reqwest::Error { kind: Body, source: TimedOut } } }
2024-11-13T19:51:36.325294Z DEBUG get_range{range=1440897324..1447188780}: lance_io::object_reader: Retrying range 1440897324..1447188780 from dev/lu-0-0.lance/data/a45d9cbe-7e38-4eca-95ef-a604c5afec64.lance (remaining retries: 3).  Error details: Generic { store: "MicrosoftAzure", source: reqwest::Error { kind: Decode, source: reqwest::Error { kind: Body, source: TimedOut } } }
2024-11-13T19:52:30.500608Z DEBUG get_range{range=1581872941..1588164397}: lance_io::object_reader: Retrying range 1581872941..1588164397 from dev/lu-0-0.lance/data/a45d9cbe-7e38-4eca-95ef-a604c5afec64.lance (remaining retries: 3).  Error details: Generic { store: "MicrosoftAzure", source: reqwest::Error { kind: Decode, source: reqwest::Error { kind: Body, source: TimedOut } } }
2024-11-13T19:52:30.500746Z DEBUG get_range{range=1588589320..1594880776}: lance_io::object_reader: Retrying range 1588589320..1594880776 from dev/lu-0-0.lance/data/a45d9cbe-7e38-4eca-95ef-a604c5afec64.lance (remaining retries: 3).  Error details: Generic { store: "MicrosoftAzure", source: reqwest::Error { kind: Decode, source: reqwest::Error { kind: Body, source: TimedOut } } }