search

GaloisInc / adapt

ADAPT software for Transparent Computing
BSD 3-Clause "New" or "Revised" License
6 stars 3 forks source link

PPM Tree alarm files not saving #262

Closed nlschimanski closed 5 years ago

nlschimanski commented 5 years ago

java -Xms82000m -Xmx82000m -XX:ReservedCodeCacheSize=512m -XX:MaxMetaspaceSize=1024m -jar /usr/share/sbt/bin/sbt-launch.jar -Dadapt.runflow=e3 -Dadapt.runtime.dbkeyspace=cadets_e3 -Dadapt.ingest.produceadm=yes -Dadapt.ingest.producecdm=no -Dadapt.ppm.pluckingdelay=100000 -Dadapt.ppm.shouldsave=yes -Dadapt.pmm.saveintervalseconds=1200 -Dadapt.ppm.basedir=/data/cadets-training/ -Dadapt.ppm.iforestenabled=no -Dadapt.adm.mapdb=cadets-map.db -Dadapt.adm.mapdbbypasschecksum=yes -Dadapt.adm.mapdbtransactions=yes -Dadapt.adm.ignoreeventremaps=true -Dadapt.adm.uuidRemapperShards=4 -Dadapt.ppm.loadfilesuffix=-cadets -Dadapt.ppm.rotatescriptpath= -Dadapt.ingest.startatoffset=0 -Dadapt.ingest.quitafteringest=no -Dadapt.ingest.data.0.provider=cadets -Dadapt.ingest.data.0.files.0=/data/cadets-e3-data/ta1-cadets-e3-official.bin -Dadapt.ingest.data.0.files.1=/data/cadets-e3-data/ta1-cadets-e3-official.bin.1 -Dadapt.ingest.data.0.files.2=/data/cadets-e3-data/ta1-cadets-e3-official.bin.2 -Dadapt.ingest.data.1.provider=cadets-1 -Dadapt.ingest.data.1.files.0=/data/cadets-e3-data/ta1-cadets-e3-official-1.bin -Dadapt.ingest.data.1.files.1=/data/cadets-e3-data/ta1-cadets-e3-official-1.bin.1 -Dadapt.ingest.data.1.files.2=/data/cadets-e3-data/ta1-cadets-e3-official-1.bin.2 -Dadapt.ingest.data.1.files.3=/data/cadets-e3-data/ta1-cadets-e3-official-1.bin.3 -Dadapt.ingest.data.1.files.4=/data/cadets-e3-data/ta1-cadets-e3-official-1.bin.4 -Dadapt.ingest.data.2.provider=cadets-2 -Dadapt.ingest.data.2.files.0=/data/cadets-e3-data/ta1-cadets-e3-official-2.bin -Dadapt.ingest.data.2.files.1=/data/cadets-e3-data/ta1-cadets-e3-official-2.bin.1 run

is running but in the log file it says:

...
Not going to periodically save PPM trees.
Starting the web server at: http://0.0.0.0:8080
Loading no data for tree: CDM-Event
Loading no alarms for tree: CDM-Event
Loading no data for tree: CDM-Subject
Loading no alarms for tree: CDM-Subject
Loading no data for tree: CDM-Netflow
nlschimanski commented 5 years ago

I believe it is related to the change in line 181 in Application.scala

rrwright commented 5 years ago

-Dadapt.ppm.shouldsave=yes

nlschimanski commented 5 years ago

Both

-Dadapt.ppm.shouldsave=yes

and

-Dadapt.ppm.shouldsave=true

produce the line "Not going to periodically save PPM trees." in the log file when -Dadapt.pmm.saveintervalseconds=1200 is set.

rrwright commented 5 years ago

On the current head of the master brach:

sbt -mem 12000 -Dadapt.runflow=e3 -Dadapt.ingest.loadfiles.0=/Volumes/ADAPT/e3/ta1-cadets-e3-official.bin -Dadapt.ppm.saveintervalseconds=1200 -Dadapt.ppm.shouldsave=yes run
...
Saving PPM trees every 1200 seconds
...
nlschimanski commented 5 years ago

I do not know why it won't work when I try it on bbn 5 and bbn 6; I tried a few different things and got the same results. Since I really need to see the alarm/novelty files produced by running this thing, I just edited the application.conf file directly and now it's working.

nlschimanski commented 5 years ago

ppm spelled wrong!