Copy stable/10@r272459 to releng/10.1 as part of
the 10.1-RELEASE process.

Approved by: re (implicit)
Sponsored by: The FreeBSD Foundation

Copy head (r256279) to stable/10 as part of the 10.0-RELEASE cycle.

Approved by: re (implicit)
Sponsored by: The FreeBSD Foundation

Add lv_LV, move lt_LT to common part

Fix printing of some wide-characters by iswprint() on ja_JP.eucJP
and ja_JP.SJIS locale

The iswprint() function does not return non-zero if used for
some wide-character that it code was 0x824f-0x8258 on ja_JP.SJIS
and 0xa3b0-0xa3b9 on ja_JP.eucJP locale. But those are right
Japanese wide-character code.

PR: conf/124511
Submitted by: Michihiro NAKAJIMA <ggcueroad@gmail.com>
MFC after: 1 week

add ca_AD, ca_FR and ca_IT locales

Catalan language is not only spoken in Spain (ca_ES), but also
in Andorra, France and Italy. In Andorra it is the official
language.

(see http://en.wikipedia.org/wiki/Catalan_language#Geographic_distribution)

Add a bunch of symlinks to between ca_ES and ca_AD, ca_FR and ca_IT.

PR: conf/92541
Submitted by: <rmh@io.debian.net>
MFC after: 1 week

"NONE" -> "ASCII" encoding

Implement Turkish locale

Submitted by: Ismail YENIGUL <ismail.yenigul@endersys.com.tr>

Add comment stating that UCS-4 really used here, not UTF-8

Use dummy definitions for codeset 3 and 4 like in ko_KR.eucKR.src

PR: 51085
Submitted by: Yamazaki Atsushi <ats@mbi.nifty.com>

Add locales for nb_NO and nn_NO.

Reviewed by: philip

Add mn_MN.UTF-8

- Use SWIDTH0 for combining characters. [1]
- Unicode 4.1 related changes:
- Add definitions for a new range of code points
U+1DC0..U+1DFF "Combining Diacritical Marks Supplement".
- Add U+04F6 and U+04F7 to the Cyrillic range.
- Mark U+034F "Combining Grapheme Joiner" as non-printable.
- Add new combining characters in the range U+0350..U+035F
to the section "Combining Diacritical Marks".

PR: misc/100212 [1]
Submitted by: "J.R. Oldroyd" <<fbsd AT opal.com>>
Reviewed by: "J.R. Oldroyd" <<fbsd AT opal.com>> (revised patch)

Add SWIDTH information for zh_CN.eucCN.

Submitted by: ume
Obtained from: NetBSD
MFC Candidate.

Provide SWIDTH information so that applications like tcsh(1) can properly
handle with zh_CN.GBK locale, which is quite common for users who uses
Simplified Chinese.

MFC Candidate.

Add SWIDTH to zh_TW.Big5 locale, to fix problem with tcsh(1)

Submitted by: Rong-En Fan <rafan at infor dot org>
PR: conf/93844

Add definitions of SWIDTH. It fixes the problem that tcsh 6.14
doesn't work correctly with ko_KR.eucKR locale.

Tested by: cjh at the CBUG party
Obtained from: NetBSD
MFC after: 1 week

Enable SWIDTH.
It makes tcsh(1) work correctly with ja_JP.SJIS locale.

MFC after: 1 week

The wcwidth(3) should return 2 about characters in JISX0208 codeset.
But it returned 1.
It fixes the problem reported by many Japanese people that tcsh 6.14
doesn't work correctly with ja_JP.eucJP locale.

PR: conf/79701
Submitted by: Kazuaki Oda <ybbkaz__at__yahoo.co.jp>
Tested by: many people
MFC after: 1 week

Comments correction

Submitted by: Yury Tarasievich <spytar@yahoo.com>

New Ukrainian locale: uk_UA.CP1251.

Submitted by: Alexander Peresunko

Utilize FILES and SYMLINKS.

Add Basque (Spain) locales: eu_ES.ISO8859-1, eu_ES.ISO8859-15, eu_ES.UTF-8.

(This differs somewhat from the version originally submitted - any mistakes
are my own.)

PR: 68524
Submitted by: J. Vicente Carrasco -Bixen-

Add an Israel Hebrew locale: he_IL.UTF-8.

PR: 65826
Submitted by: Hye-Shik Chang

Add UTF-8 versions of all the currently supported system locales. Most of
the hard work was done by Hye-Shik Chang in the misc/utf8locale port; I made
a few minor adjustments and merged the makefiles.

PR: 44307

Add kk_KZ.PT154

Submitted by: Birsh T <tim@zhezu.kz>

Add be_BY.*

Submitted by: Yury Tarasievich <grog@grsu.by>

Change encoding to GBK to get correct first byte range

Add zh_HK.Big5HKSCS

PR: 59799
Submitted by: Statue <statue@freebsd.sinica.edu.tw>

Enable GB2312 locale.

Add GB2312 encoding file.

Fix ascii compatibility

Submitted by: Liu Kang <liukang@bjpu.edu.cn>

Fix comment

Add ko_KR.CP949 locale

PR: 55341
Submitted by: Hye-Shik Chang <perky@freebsd.org>

DIGIT can be only 0-9 according to POSIX

Support for the Amharic locale.

Fix error in comment

Add GB18030 locale

PR: 51729
Submitted by: Kang Liu <liukang@bjpu.edu.cn>

Add ARMSCSII-8 locale

Submitted by: Vahe Khachikyan <vahe@khachikyan.de>
PR: 53944

Add ru_RU.CP1251

Add zh_CN.GBK

PR: 51504
Submitted by: Statue <statue@freebsd.sinica.edu.tw>

Add ca_ES locale

PR: 45874
Submitted by: Joan Picanyol i Puig <joan-dev@biaix.org>

Add lt_LT.ISO8859-13

PR: 44268
Submitted by: Kestutis Paulikas <kestas@elen.ktu.lt>

Add sr_YU locales

Submitted by: Toni Andjelkovic <toni@soth.at>

Add LC_CTYPE information for characters with lead bytes ED, EE, FA, FB, FC.

Drop support for COPY, -c has been the default mode of install(1)
for a long time now.

Approved by: bde

Recognize 0xbe as an uppercase character.

Approved by: ache

Link tr_TR.ISO8859-9's LC_CTYPE to UA-ASCII's. It's not completely correct,
but better than nothing.

Add pt_BR.ISO8859-1 (Brazilian Portuguese) locale

Submitted (partly) by: dcs

Fix 0x8b and 0x9b upper/lower mapping

Add ro_RO

PR: 33343
Submitted by: Adrian Penisoara <ady@warpnet.ro>

Optimize locale data Makefiles as well as make their style more consistent.

Add uk_UA.ISO8859-5 locale

PR: 32450
Submitted by: partially by Alexey Klimov <kao@wiuu.kiev.ua>

Fix codes

Fix codes

PR: 33031
Submitted by: Statue <statue@softwareliberty.org>

Properly classify 0x80 - 0xa0 range

Add 0x98 to CONTROL section

Start every data line with keyword

Cleanup: cosmetique, standards conformance, BLANK/SPACE/GRAPH relation

Clean DIGIT/XDIGIT sections

Back out national digits support, POSIX explicetely disallows it:

The definition of character class digit requires that only ten characters
-the ones defining digits- can be specified; alternate digits (for
example, Hindi or Kanji) cannot be specified here. However, the encoding
may vary if an implementation supports more than one encoding.

The definition of character class xdigit requires that the characters
included in character class digit are included here also and allows for
different symbols for the hexadecimal digits 10 through 15.

Add hi_IN.ISCII-DEV

Fix upper/lower mapping

PR: 32133
Submitted by: Basileios Anastasatos <B.Anastasatos@MyRealBox.com>

Add bg_BG.CP1251

PR: 25472
Submitted by: Peter Pentchev <roam@ringlet.net>

Fix encoding info

Add more *.US-ASCII family

Fix ISO_ sneaked

Switch to new locale names

Add sk_SK

PR:
Submitted by:
Reviewed by:
Approved by:
Obtained from:

Don't link et_EE with 8859-1

Add et_EE

DIS_8859-15 -> ISO_8859-15 rename

Add Greek support

PR: 24324
Submitted by: past@netmode.ntua.gr

Get rid of deprecated ru_SU.* locales. ru_RU.* will be used instead.

Correct uk_UA.KOI8-U locale ALPHAs specification

Submitted by: Vadim Chekan <vadim@etc.lviv.ua> (PR: conf/17826)
Submitted by: <matey@cis.ohio-state.edu> via ache

Fix cut&paste error

Add 8859-4 and lt_LT

Submitted by: Ricardas Cepas <rch@writeme.com>

lt_LN->la_LN

Add cs_CZ

Submitted by: Cejka Rudolf <cejkar@dcse.fee.vutbr.cz>

add uk_UA.KOI8-U

Submitted by: Alexey Zelkin <phantom@cris.net>

restore 8859-5, remove BUILD_TOOLS define

sync with earlier change removing broken locale.

ISO8859-5 locale

Submitted by: Nikolai Saoukh <nms@ethereal.ru>

$Id$ -> $FreeBSD$

Change locale name of Traditional Chinese : zh_TW.BIG5 -> zh_TW.Big5.
It makes compatible with IANA charset defination, and let existent I18N
app happier.

Ref: <http://www.isi.edu/in-notes/iana/assignments/character-sets>

Support the IANA definition of Shift Jis nameley ja_JP.Shift_JIS
as well as the X11 version ja_JP.SJIS

Added support for DIS 8859-15 based locales using patch
from Kaleb.

Obtained from: Kaleb Keithley <kaleb@ics.com>

I have added the support for BIG5 encoding into libc/libxpg4/mklocale.
the diff is attached below. This is done on the 3.0 source-tree.
I have test this on 2.2-stable before, but I don't have a 3.0 machine
right now.

This patch is mainly to make libc support BIG5 encoding, thus add
zh_TW.BIG5 locale to 3.0.

Submitted by: Chen Hsiung Chan <frankch@waru.life.nthu.edu.tw>

Remove half the file, somehow it got doubled...

I have been running with these locale data for a while now and
I hope some other people might find them useful. They are for
zh_CN.EUC (GB) only. I'm not familiar with the BIG5 encoding,
so I could only hope someone else would fill the gap.

PR: 7310
Submitted by: Luoqi Chen <luoqi@chen.ml.org>

add Hungarian ctype

Use the installed version of mklocale for `make all'. It is now
bootstrapped by `make world'. The version just built in ".."
normally won't work if the target system is not binary compatible.

Don't build or install anything if _BUILD_TOOLS is defined. Then
we only want to build and install the mklocale binary, but the layout
of the mklocale tree forces recursing to mklocale/data for at least
the obj target even when _BUILD_TOOLS is defined.

Add Slovene link

Add link to Polish locale

Submitted by: Sin'ichiro MIYATANI / Phase One, Inc <siu@phaseone.co.jp>
Basic support for the Shift JIS encoding of japanese.
(and one tiny typo fixed in a comment)

Fixed bogus existence check related to searching for a nearby obj directory.
Now the search is as incomplete as elsewhere instead of broken.

Add fake codesets 3 & 4
Submitted by: junker@jazz.snu.ac.kr

Update Korean locale

Should go into 2.2

minor nit

Add lt_LN.ISO_8859-2.src.
Use '.for' loop from make(1), not sh(1) 'for' loops.

Submitted by: Slaven Reziæ (Tomiæ) <eserte@cs.tu-berlin.de>

Add Korean CTYPE locale
Submitted by: Choi Jun Ho <junker@jazz.snu.ac.kr>

Revert $FreeBSD$ to $Id$

Make the long-awaited change from $Id$ to $FreeBSD$

This will make a number of things easier in the future, as well as (finally!)
avoiding the Id-smashing problem which has plagued developers for so long.

Boy, I'm glad we're not using sup anymore. This update would have been
insane otherwise.

Fix non-break space attrs

Bring in my changes for removing the pestilent obj links (unless you
really want them) from /usr/src. This is the final version of the
patches, incorporating the feedback I've received from -current.

Add $id$ and ${COPY}

Cleanup make process per Bruce suggestions

Add quick description of rules how to build locale name,
f.e. iso_8859_1 name is completely incorrect