feat(radix): Reduce memory footprint of the C implementation

Darkheir commented 4 years ago

Try to reduce the memory foot print of the C implementation by:

Removing network and prefix from the struct keeping representing a node. Both are of type char[256] and it can take a bit of memory when have a lot of elements.
Setting the data attribute to NULL by default and make it read-wrtie. An empty python dict takes 240 bytes. This is a lot. It is now possible to store any type of value in data.

To not break the prefixes() method the prefixes are now calculated from the packed value, the family and the prefix length on the fly.

I decided to keep family and prefixlen in the struct so we can recreate ranges from the python side:

"{}/{}".format(
    socket.inet_ntop(rnode.family, rnode.packed),
    rnode.prefixlen
)

coveralls commented 4 years ago

Coverage remained the same at 90.33% when pulling 2a5666518653a96c2174660d27b88090cc9b60c2 on SEKOIA-IO:feat/reduce_memory_footprint into 52d70b050a1dcbf3a7849aa51b2420883e31539e on mjschultz:master.

Darkheir commented 4 years ago

My bad, this PR is breaking a lot of stuff and was not intended for the main repo.

mjschultz / py-radix

feat(radix): Reduce memory footprint of the C implementation #51