muchdogesec / stix2arango

stix2arango is a command line tool that takes a group of STIX 2.1 objects in a bundle and inserts them into ArangoDB. It can also handle updates to existing objects in ArangoDB imported in a bundle.
GNU Affero General Public License v3.0
1 stars 0 forks source link

Issue importing very large objects #1

Closed himynamesdave closed 4 weeks ago

himynamesdave commented 1 month ago

See the x-mitre-collection object in this bundle

https://raw.githubusercontent.com/mitre-attack/attack-stix-data/master/enterprise-attack/enterprise-attack-15.1.json

It is 1000's of lines long.

It does not import when trying to import this bundle using stix2arango (although no warnings are shown)

I suspect Arango might have a limit. If so, we should warn user that some objects were skipped in CLI at end of run, e.g.

x objects inserted successfully x objects failed

fqrious commented 1 month ago

I'll need more info than that, I can see that this object with 86000 lines x-mitre-collection was successfully inserted

fqrious commented 1 month ago

image

Ran this and every single object in the file was uploaded

himynamesdave commented 4 weeks ago

Now appears to be working. Must have been a local error, or more likely, user error :)