Navigation
  • Home
  • Recent
  • Most Active
  • Popular
  • Credits
  • RSS
  •  
      Help
  • How to Edit
  • Help



  • [Edit]


    Unicode has a certain amount of duplication due to aiming to allow legacy encodings to be converted to Unicode without losing any information. Sometimes these characters are rendered identically, other times they are rendered with different sizes or styles at least in the fonts intended to match up with the expectations of legacy systems.

        Duplicate characters in Unicode
            Weaknesses of duplicate characters
            CJK fullwidth forms
            Greek
            Roman numerals

    top

    Weaknesses of duplicate characters
    The similarity of some Unicode characters can be used as an attack vector in Phishing scams. Standard domain names for internet sites allow a limited Latin character set, but the Punycode standard has recently enabled Internationalized domain names in all languages supported by Unicode. This makes it possible to register a domain name with homographs for a legitimate site. For more information, see IDN homograph attack.

    top

    CJK fullwidth forms
    In traditional CJK encodings characters usually took either a single byte (known as halfwidth) or two bytes (known as fullwidth). Characters that took a single byte were generally displayed at half the width of those that took two bytes. Some characters such as the latin alphabet were available in both halfwidth and fullwidth versions. As the halfwidth versions were more commonly used they were generally the ones mapped to the standard code points for those characters. Therefore a separate section was needed for the fullwidth forms to preserve the distinction.

    top

    Greek
    Many Greek letters are used as technical symbols. All of the Greek letters are encoded in the Greek section of Unicode but many are encoded a second time under the name of the technical symbol they represent. Of these, micro sign is in the Latin-1 range and most of the rest are in the Letterlike Symbols range. The "micro sign" (U+00B5, µ) is obviously inherited from ISO 8859-1, but the origin of the others is less clear.

    Technically these are not duplicate characters in that the consortium viewed these symbols used in mathematics as distinct characters from their twins in the Greek alphabet. For example, the upper-case character pi (U+03A0, &
      x03A0;) typically shares the same glyph with the mathematical character n-ary product (U+220F, &
        x220F;). These are two different characters because they each represent different semantics — different meanings. They nevertheless share similar presentational form: the glyph. Humans can typically perceive the difference in characters through the context in which the glyph appears. On the other hand, it is difficult to develop software that can distinguish these different meanings through context: hence the justification for providing different characters for these different meanings.

    top

    Roman numerals
    Unicode has a number of characters specifically designated as Roman numerals, as part of the Number Forms range from U+2160 to U+2183. For example, MCMLXXXVIII could alternatively be written as
    ⅯⅭⅯⅬⅩⅩⅩⅧ. This range includes both upper- and lowercase numerals, as well as pre-combined glyphs for numbers up to 12 (Ⅻ or XII), mainly intended for the clock faces for compatibility with non–West-European encodings. The pre-combined glyphs should only be used to represent the individual numbers where the use of individual glyphs is not wanted, and not to replace compounded numbers. Similarly precombined ligatures for 5000 and 10000 exist.


    uppercase oneU+2160&
      x2160;
    uppercase twoU+2161&
      x2161;
    uppercase threeU+2162&
      x2162;
    uppercase fourU+2163&
      x2163;
    uppercase fiveU+2164&
      x2164;
    uppercase sixU+2165&
      x2165;
    uppercase sevenU+2166&
      x2166;
    uppercase eightU+2167&
      x2167;
    uppercase nineU+2168&
      x2168;
    uppercase tenU+2169&
      x2169;
    uppercase elevenU+216A&
      x216A;
    uppercase twelveU+216B&
      x216B;
    uppercase fiftyU+216C&
      x216C;
    uppercase one hundredU+216D&
      x216D;
    uppercase five hundredU+216E&
      x216E;
    uppercase one thousandU+216F&
      x216F;
    lowercase oneU+2170&
      x2170;
    lowercase twoU+2171&
      x2171;
    lowercase threeU+2172&
      x2172;
    lowercase fourU+2173&
      x2173;
    lowercase fiveU+2174&
      x2174;
    lowercase sixU+2175&
      x2175;
    lowercase sevenU+2176&
      x2176;
    lowercase eightU+2177&
      x2177;
    lowercase nineU+2178&
      x2178;
    lowercase tenU+2179&
      x2179;
    lowercase elevenU+217A&
      x217A;
    lowercase twelveU+217B&
      x217B;
    lowercase fiftyU+217C&
      x217C;
    lowercase one hundredU+217D&
      x217D;
    lowercase five hundredU+217E&
      x217E;
    lowercase one thousandU+217F&
      x217F;
    one thousand C DU+2180&
      x2180;
    five thousandU+2181&
      x2181;
    ten thousandU+2182&
      x2182;
    reverse one hundredU+2183&
      x2183;


    Some of these characters are considered duplicates by Unicode methodology because many of these characters can be composed from the other characters. For example, one can combine &
      x2169; with &
        x2170; to mean roman numeral eleven (&
          x2169;&
            x2160;), so U+2170 is a pre-composed character. Such characters are also referred to as composite compatibility characters or decomposable compatibility characters. Such characters would not normally have been included within the Unicode standard except for compatibility with other existing encodings. The goal was to accommodate simple translation from existing encodings into unicode. This makes translations in the opposite direction complicated because multiple Unicode characters may map to a single character in another encoding. Without the compatibility concerns the only characters necessary would be: &
              x2160;, &
                x2164;, &
                  x2169;, &
                    x216C;, &
                      x216D;, &
                        x216E;, &
                          x216F;, &
                            x2170;, &
                              x2174;, &
                                x2179;, &
                                  x217C;, &
                                    x217D;, &
                                      x217E;, &
                                        x217F;, &
                                          x2180;, &
                                            x2181;, &
                                              x2182;, &
                                                x2183;. All other roman numerals can be composed from these.




     

    -->
    Search more:
     

       
    Source Privacy License Download Contact Us Atlas
    Scientus.org Dictionary (Yet Another Wiki) RC : 1.41
    MIT OpenCourseWare
    This article is licensed under the GNU Free Documentation License [copyleft]. It uses material from the Wikipedia article "Duplicate characters in Unicode". link