search

albfan / jmeld

A visual diff and merge tool
44 stars 31 forks source link

tokenizers #34

Closed albfan closed 8 years ago

albfan commented 8 years ago

on branch tokenizers there's a char tokenizer (most simple tokenizer avaliable) to allow fine grain solution)

An old tokenizer based on non words is recovered.

A config section is needed to change this dinamically

albfan commented 8 years ago

Config added and synchronized with open diffs