Collations utf8_general_ci and utf8_unicode_ci and character equivalence

[chrislb]

I was getting dublicate entry warnings when adding new data when I found out that some characters under collations utf8_general_ci and utf8_unicode_ci are treated the same. So entries containing an ü (u-Umlaut) can be similar to entries having an u at this position.

This behaviour seems fairly bad when viewed from an avarage user's perspective, and switching to some collation that doesn't fit to the original language (as many collations (still?) don't exist) isn't a good solution either.

In my case I am using chinese pinyin that can contain the u-Umlaut and use it under the turkish collation.

My questions thus are
1) Why is utf8_general_ci and utf8_unicode_ci not applicable to the general case?
2) Will there ever by collations for other languages apart from the existing european ones for utf8?

Chris