search

ShiftLeftSecurity / overflowdb

ShiftLeft OverflowDB
Apache License 2.0
112 stars 21 forks source link

Can OverflowDb load data from more than one file? #396

Open pangeneral opened 1 year ago

pangeneral commented 1 year ago

For example, I want to load data from A.kryo and B.kryo, is it possible?

mpollmeier commented 1 year ago

We don't support the kryo format as far as I'm aware... can you please be more specific what you're trying to do?

pangeneral commented 1 year ago

We don't support the kryo format as far as I'm aware... can you please be more specific what you're trying to do?

We're using version 1.90, it supports kryo. Did you remove kryo in the new version?

Previous, we persist the whole project under analysis into one database file such as project.kryo. Now we want to perform incremental program analysis based on overflowDB. So we need to cut the whole project into small pieces and persist them into different database files such as module1.kryo, module2.kryo and module3.kryo. When we want to analyze the project, we just need to read the three database files. Is it possible for writing and reading more than one database files?

mpollmeier commented 1 year ago

We removed Tinkerpop (along with it's kryo support) in 1.116, i.e. around early 2022.

The current storage format is based on mvstore (which also powers the H2 database). Each overflowdb graph corresponds to exactly one storage file. That being said, you can have multiple graphs open at the same time. Does that help?

pangeneral commented 1 year ago

We removed Tinkerpop (along with it's kryo support) in 1.116, i.e. around early 2022.

The current storage format is based on mvstore (which also powers the H2 database). Each overflowdb graph corresponds to exactly one storage file. That being said, you can have multiple graphs open at the same time. Does that help?

I want to query the data at the same time. Can I complete the functionality with multiple graphs?