saulalbert / unixclan

Utility scripts for TalkBank's CLAN
0 stars 0 forks source link

CHAT2CAlite converts ▁delimiters▁ into ↓↓delimiters↓↓ #26

Closed saulalbert closed 6 years ago

saulalbert commented 6 years ago

Double arrows cause problems for CHECK, so we use the unicode symbol '▁':

(U+2581 : LOWER ONE EIGHTH BLOCK)

As a delimited, but convert it to a CA-like '↓↓' delimiter.

So

hello how are ▁you▁

becomes

hello how are ↓↓you↓↓