double-encoding of Arabic text

[Rick James]

http://bugs.mysql.com/bug.php?id=30277

FULLTEXT is designed for English, I suspect it has problems with other languages and other character sets.

Sorry, the text was double-encoded as it was stored. This will render any collation 'incorrect'. My document somewhat discusses how to fix the data (assuming it is not beyond repair).

SELECT HEX(CONVERT(CONVERT(UNHEX( 'C398C2AF') USING utf8) USING latin1));
--> D8AF, which is the utf8 for Arabic DAL.
SELECT CONVERT(CONVERT(UNHEX( 'C398C2AF') USING utf8) USING latin1);
--> that character.

Utf8 encodings for Basic Arabic characters:
http://lcweb2.loc.gov/diglib/codetables/33.html