search

ruben2020 / codequery

A code-understanding, code-browsing or code-search tool. This is a tool to index, then query or search C, C++, Java, Python, Ruby, Go and Javascript source code. It builds upon the databases of cscope and ctags, and provides a nice GUI tool.
https://ruben2020.github.io/codequery/
Mozilla Public License 2.0
685 stars 86 forks source link

Unicode support #56

Closed sivakov512 closed 7 years ago

sivakov512 commented 7 years ago

Hi! Can it support unicode? 2017-02-16-144101_710x197_scrot

ruben2020 commented 7 years ago

That's a good point. I've never tested it before. I guess it's now a good time as any to add Unicode support. But I'm not sure about the different Unicode formats like plain Unicode, UTF-8, UTF-16 etc.

sivakov512 commented 7 years ago

Maybe set UTF-8 initially, but still allow users to set any other format? Or implement only UTF-8 support. I think UTF-8 is a good choice.

ruben2020 commented 7 years ago

By default, it should be using the ISO-8859-1 (Latin 1) encoding, but I need to switch it to UTF-8 which should be easy. I will also decide if I need to make it a setting in the options menu to switch between UTF-8 and ISO-8859-1. Based on historical trends, these are are two most popular encoding formats. From 2010 to 2016, the "market share" of UTF-8 has increased from 50.6% to 88.6%. ISO-8859-1 remains the second most popular choice. https://w3techs.com/technologies/history_overview/character_encoding/ms/y

ruben2020 commented 7 years ago

Hi @cryptomaniac512 I have added UTF-8 support. That should be sufficient. If you're building yourself, please use the latest of branch develop. I will release a new version soon. I've found that it is sufficient to support only UTF-8 in all cases. Thank you for your support and feedback.

sivakov512 commented 7 years ago

Works great! Thank you!