man-group / ArcticDB

ArcticDB is a high performance, serverless DataFrame database built for the Python Data Science ecosystem.
http://arcticdb.io
Other
1.4k stars 90 forks source link

LMDB windows, error when access with newly created library. #1673

Closed Shadow-Alex closed 2 weeks ago

Shadow-Alex commented 1 month ago

Describe the bug

Hi, I have a old arcticDB setup on LMDB windows. There is a working library which I can access via

import arcticdb as adb
ac = adb.Arctic('lmdb://D://arcticDB?map_size=1024GB')
lib = ac['intraday_ohlcv']

However I cannot create new library now. while the old library is still accessible.

import arcticdb as adb
ac = adb.Arctic('lmdb://D://arcticDB?map_size=1024GB')
ac.create_library('test')

the above lib creation code result in a Traceback error:

  File "E:\anaconda3\envs\quant\lib\site-packages\arcticdb\arctic.py", line 217, in create_library
    return self.get_library(name)
  File "E:\anaconda3\envs\quant\lib\site-packages\arcticdb\arctic.py", line 153, in get_library
    lib = self[name]
  File "E:\anaconda3\envs\quant\lib\site-packages\arcticdb\arctic.py", line 99, in __getitem__
    self._library_manager.get_library(lib_mgr_name, storage_override),
arcticdb_ext.exceptions.InternalException

I dont really know if the lib is created or not, I think its a bug halfway, as I manage to list the library after the unsuccessful creation.

ac.list_libraries()

image

Steps/Code to Reproduce

import arcticdb as adb
ac = adb.Arctic('lmdb://D://arcticDB?map_size=1024GB')
ac.create_library('test')

Expected Results

successfully created.

OS, Python Version and ArcticDB Version

Python: 3.10.13 | packaged by Anaconda, Inc. | (main, Sep 11 2023, 13:24:38) [MSC v.1916 64 bit (AMD64)] OS: Windows-10-10.0.19045-SP0 ArcticDB: 4.4.3

Backend storage used

LMDB

Additional Context

No response

alexowens90 commented 1 month ago

Hi @Shadow-Alex, thanks for raising, I just need a few more details: