There are a number of open questions over this, but chiefly: is it better to silently swallow illegal characters or replace them with a placeholder. In this implementation I went for the latter, replacing them with question marks. Also if the latter, do we also add the ability to choose the placeholder?
I'd quite like to get a move on with this rather than debate it to death, but if needs be I'll maintain this fix on a fork of our own until this is sorted.
This is a strawman PR for #71
There are a number of open questions over this, but chiefly: is it better to silently swallow illegal characters or replace them with a placeholder. In this implementation I went for the latter, replacing them with question marks. Also if the latter, do we also add the ability to choose the placeholder?
I'd quite like to get a move on with this rather than debate it to death, but if needs be I'll maintain this fix on a fork of our own until this is sorted.
Test included.