Revert _RuneLocale struct changes until mklocale reacharound
can be untangled.

Problem noted by tb@

Since we only do US-ASCII and UTF-8, several parts of the locale
data are unused and unnecessary, so delete them: rl_tabs, rl_magic,
rl_encoding, and rl_invalid_rune.

ok schwarze@

Simplify wctype() and wctype_l(): we have one set of classification
types used by all (== both) locales; put their implementation in one
file and make the mapping static there. The rl_wctype member of
_RuneLocale and its initialization go away at the same time.

ok schwarze@

Delete some abstraction that we don't and won't need.
Declare functions rather than generating declarations with macros.
Just call functions rather than mainting function pointer tables.
Purge unused arguments. Simplify mbstate_t casting.
Garbage collect one empty and one unused function.

As a bonus, make mbsinit(3) work at all, it returned garbage
in the past due to a missing cast when passing mbstate_t.
Apart from that, no functional change.

No libc bump needed; only private functions are removed and
change prototype and only private structs change size.

OK stsp@ mpi@; deraadt@ likes the general direction.

Remove excessive sys/cdefs.h inclusion
ok guenther millert kettenis

Sync ctype definitions for the UTF-8 locale to FreeBSD, fixing width of
various zero-width characters (e.g. diacritical marks). Also fix runetype
mask definitions so that mklocale interprets zero width properly.
Diff from Alexander Polakov.
Character definition changes checked against Unicode 5.2 by me.
ok matthew nicm

attribute packed -> __packed

OK millert

activate LC_CTYPE for 8 bits locale.
Make sure tolower/toupper use the whole 8 bits.

okay deraadt@
thanks to everyone who tested

Add a few missing functions so that wctype.h/wchar.h are more or less
uptodate, namely, wcsto(u)l(l) family, wcstod, stubs from wctrans/towctrans

crank minor.

okay millert@, jmc@.

major abi changes:

* introduce the mbstate_t typedef.
impacts gnu libiconv, which has already been taken care of.

* Prepare for mb stuff to really exist, replace macro MB_CUR_MAX with
an external variable __mb_cur_max (impacts libX11 and various ports).

* use mbstate in all the mb <-> wchar functions with state.
* add a stub iswctype function allowing some ports to compile.

bash and gdiff are missing wcscoll, and need to be told there's no i18n
until this is fixed.

Discussed and matthieu, otto, millert, kettenis, deraadt.

Major libc bump

introduce some wchar functions (from citrus and an itojun@ diff)
okay deraadt@, cloder@, pvalchev@
thanks to everyone who commented on that.

Simplify wctype() and wctype_l(): we have one set of classification
types used by all (== both) locales; put their implementation in one
file and make the mapping static there. The rl_wctype member of
_RuneLocale and its initialization go away at the same time.

ok schwarze@

Delete some abstraction that we don't and won't need.
Declare functions rather than generating declarations with macros.
Just call functions rather than mainting function pointer tables.
Purge unused arguments. Simplify mbstate_t casting.
Garbage collect one empty and one unused function.

As a bonus, make mbsinit(3) work at all, it returned garbage
in the past due to a missing cast when passing mbstate_t.
Apart from that, no functional change.

No libc bump needed; only private functions are removed and
change prototype and only private structs change size.

OK stsp@ mpi@; deraadt@ likes the general direction.

Remove excessive sys/cdefs.h inclusion
ok guenther millert kettenis

Sync ctype definitions for the UTF-8 locale to FreeBSD, fixing width of
various zero-width characters (e.g. diacritical marks). Also fix runetype
mask definitions so that mklocale interprets zero width properly.
Diff from Alexander Polakov.
Character definition changes checked against Unicode 5.2 by me.
ok matthew nicm

attribute packed -> __packed

OK millert

activate LC_CTYPE for 8 bits locale.
Make sure tolower/toupper use the whole 8 bits.

okay deraadt@
thanks to everyone who tested

Add a few missing functions so that wctype.h/wchar.h are more or less
uptodate, namely, wcsto(u)l(l) family, wcstod, stubs from wctrans/towctrans

crank minor.

okay millert@, jmc@.

major abi changes:

* introduce the mbstate_t typedef.
impacts gnu libiconv, which has already been taken care of.

* Prepare for mb stuff to really exist, replace macro MB_CUR_MAX with
an external variable __mb_cur_max (impacts libX11 and various ports).

* use mbstate in all the mb <-> wchar functions with state.
* add a stub iswctype function allowing some ports to compile.

bash and gdiff are missing wcscoll, and need to be told there's no i18n
until this is fixed.

Discussed and matthieu, otto, millert, kettenis, deraadt.

Major libc bump

introduce some wchar functions (from citrus and an itojun@ diff)
okay deraadt@, cloder@, pvalchev@
thanks to everyone who commented on that.

Delete some abstraction that we don't and won't need.
Declare functions rather than generating declarations with macros.
Just call functions rather than mainting function pointer tables.
Purge unused arguments. Simplify mbstate_t casting.
Garbage collect one empty and one unused function.

As a bonus, make mbsinit(3) work at all, it returned garbage
in the past due to a missing cast when passing mbstate_t.
Apart from that, no functional change.

No libc bump needed; only private functions are removed and
change prototype and only private structs change size.

OK stsp@ mpi@; deraadt@ likes the general direction.

Remove excessive sys/cdefs.h inclusion
ok guenther millert kettenis

Sync ctype definitions for the UTF-8 locale to FreeBSD, fixing width of
various zero-width characters (e.g. diacritical marks). Also fix runetype
mask definitions so that mklocale interprets zero width properly.
Diff from Alexander Polakov.
Character definition changes checked against Unicode 5.2 by me.
ok matthew nicm

attribute packed -> __packed

OK millert

activate LC_CTYPE for 8 bits locale.
Make sure tolower/toupper use the whole 8 bits.

okay deraadt@
thanks to everyone who tested

Add a few missing functions so that wctype.h/wchar.h are more or less
uptodate, namely, wcsto(u)l(l) family, wcstod, stubs from wctrans/towctrans

crank minor.

okay millert@, jmc@.

major abi changes:

* introduce the mbstate_t typedef.
impacts gnu libiconv, which has already been taken care of.

* Prepare for mb stuff to really exist, replace macro MB_CUR_MAX with
an external variable __mb_cur_max (impacts libX11 and various ports).

* use mbstate in all the mb <-> wchar functions with state.
* add a stub iswctype function allowing some ports to compile.

bash and gdiff are missing wcscoll, and need to be told there's no i18n
until this is fixed.

Discussed and matthieu, otto, millert, kettenis, deraadt.

Major libc bump

introduce some wchar functions (from citrus and an itojun@ diff)
okay deraadt@, cloder@, pvalchev@
thanks to everyone who commented on that.