search

heitzmann / gdstk

Gdstk (GDSII Tool Kit) is a C++/Python library for creation and manipulation of GDSII and OASIS files.
https://heitzmann.github.io/gdstk/
Boost Software License 1.0
335 stars 84 forks source link

Read Large OAS file #84

Open XDean opened 2 years ago

XDean commented 2 years ago

I have .oas file that larger than 5GB with billions polygons.

When I use gdstk to read, it used minutes time and memory > 5GB.

Is there a way to handle the large oas without read it all into memory at first time? Something like numpy.memmap.

Or is there a way to read it as several parts?

heitzmann commented 2 years ago

@XDean at this point, there is no way to read it partially. In the future, I plan to add a filter functionality similar to read_gds, but there are other issues I'm working on before that.

MarkMa1990 commented 2 years ago

I think there is always memory problem while reading large oas files, it consumes very big memory resources suddenly.