Achieve 1hr ingestion on Boeing/Grammatech 2.6M relationship load

ge-high-assurance / RACK

DARPA's Automated Rapid Certification of Software (ARCOS) project called Rapid Assurance Curation Kit (RACK)

BSD 3-Clause "New" or "Revised" License

20 stars 6 forks source link

Achieve 1hr ingestion on Boeing/Grammatech 2.6M relationship load #454

Closed cuddihyge closed 3 years ago

cuddihyge commented 3 years ago

Will depend on machine and configuration. This seems to be CPU limited, so number of cores will be critical. Try to achieve <1hr on a "standard laptop"

cuddihyge commented 3 years ago

This is now in the latest docker dev built around 11am 7/9/2021 Eastern da1260f945294361682a0f74fcbd6cfd1ea7748e8b549fdac7a21b7f42f28412

AbhaMoitra commented 3 years ago

I tested the dev release. I was able to load in the GT data in 61 minutes (after GE data was loaded).

AbhaMoitra commented 3 years ago

Ingestion timing has been done by Dan, Eric, Abha.