search

kr0st / fpgui

GUI application for convenient browsing through fplog-generated log messages
MIT License
0 stars 0 forks source link

Pre-process json strings before sorting with script compare function #10

Closed kr0st closed 6 years ago

kr0st commented 6 years ago

Sorting performance is very poor for large strings therefore need to strip json fields that are not specifically used in sorting before attempting to sort the list with Lua.

kr0st commented 6 years ago

Used rapidjson, done some optimizations however despite at least 2.5x improvement in processing speed, we still are in the range of 13+ seconds for 1000 5-10 meg strings sorting. Yet this scenario should not be too frequent and therefore the performance might be deemed acceptable.