search

McGill-DMaS / Kam1n0-Community

The Kam1n0 Assembly Analysis Platform
Apache License 2.0
615 stars 127 forks source link

large files indexing error #25

Open TakahiroHaruyama opened 5 years ago

TakahiroHaruyama commented 5 years ago

I tested Kam1n0 indexing for 104 unique idb/i64 files but the job stopped in 57 files (about half of files indexed?), judging from the homepage information. I checked the log and found the following but not sure if it's related to the problem.

2018-11-28 00:41:42.538 ERROR 3756 --- [DefaultQuartzScheduler_Worker-1] c.m.s.d.k.a.c.BinaryIndexProcedureLSHMR : Failed to process the BinaryIndexProcedure job from hoge

Any thought? Thanks.

steven-hh-ding commented 5 years ago

Hi Takahiro. Thank you for your interest in our research. Could you share more details in the log file? Is there any exception message in the log file? Which version are you using? Thanks!

TakahiroHaruyama commented 5 years ago

Thanks for quick reply, Steven!

I use the latest version and the clone search app is Asm2Vec.

I'm attaching the log file. There is com.fasterxml.jackson.databind.exc.InvalidFormatException before the error. spring.log.txt

steven-hh-ding commented 5 years ago

It looks like the processor is not in our list of defined architectures (hard-coded for JSON parsing). Let me push an update. It gonna take 1-2 days. Would you mind sharing with us the processor family that you are working on?

TakahiroHaruyama commented 5 years ago

Steven, I don't rush so you can take your time.

The file is Portable Executable 32 .NET Assembly code.

steven-hh-ding commented 5 years ago

Hi Takahiro.

Sorry for getting back to you so late. I did some preliminary tests with the .net assemblies. Our existing scripts are not compatible yet. We need more time to develop a specialized model for .net. However, .net native should be supported out-of-the-box. We are adding the .net assembly support to our to-do list. The readme file will be updated accordingly. Please stay tuned, and sorry for the wait. This issue will keep open. Let us know if you have any suggestion.

Steven

TakahiroHaruyama commented 5 years ago

Thanks Steven! I look forward to seeing the future version. Again, I don't rush so it's ok even if the priority is low.