Copy stable/11@r303970 to releng/11.0 as part of the 11.0-RELEASE
cycle.

Prune svn:mergeinfo from the new branch, and rename it to RC1.

Update __FreeBSD_version.

Use the quarterly branch for the default FreeBSD.conf pkg(8) repo and
the dvd1.iso packages population.

Approved by: re (implicit)
Sponsored by: The FreeBSD Foundation

Copy head@r302406 to stable/11 as part of the 11.0-RELEASE cycle.
Prune svn:mergeinfo from the new branch, as nothing has been merged
here.

Additional commits post-branch will follow.

Approved by: re (implicit)
Sponsored by: The FreeBSD Foundation

libc: spelling fixes.

Mostly on comments.

Make it clear that the "size" argument is for the dst string.

The rest of the manpage already referenced 'dstsize' but did not rename
the variable in the prototype in r257646.

MFC after: 3 days
Sponsored by: EMC / Isilon Storage Division

Add a standards compliance note for strtok_r as suggested by cpercival.

Reviewed by: cpercival
MFC after: 1 week

Avoid reading pass the end of the source buffer when it is not NUL
terminated.

If this buffer is adjacent to an unmapped page or a version of C with
bounds checked is used this may result in a crash.

PR: 206178
Submitted by: Alexander Cherepanov <cherepan@mccme.ru>
MFC after: 1 week

Avoid reading pass the end of the source buffer when it is not NUL
terminated.

If this buffer is adjacent to an unmapped page or a version of C with
bounds checked is used this may result in a crash.

PR: 206177
Submitted by: Alexander Cherepanov <cherepan@mccme.ru>
MFC after: 1 week

Improve collation string and locales support

Merge collation support from Illumos and DragonflyBSD.

Locales are now generated with the new localedef(1) tool from CLDR POSIX files.
The generated files are now identified as "BSD 1.0" format.

The libc now only read "BSD 1.0" locales definitions, all other version will be
set to "C"
The localedef(1) tool has been imported from Illumos and modified to use tree(3)
instead of the CDDL avl(3)
A set of tool created by edwin@ and extended by marino@ for dragonfly has been
added to be able to generate locales and the Makefiles from the vanilla CLDR
unicode databases + a universal UTF-8 charmap (by marino@)
Update the locales to unicode v27
Given our regex(3) does not support multibyte (yet) it has been forced to always
use locale C
Remove now unused colldef(1) and mklocale(1)
Finish implementing the numeric BSD extension for ctypes
The number of supported locales has grown from 175 to 250 locales. Among the new
locales: 6 Arabic locales (AE EG JO MA QA SA), Different variations of spanish
locales.
Added new 3 components locales for mn_Cyrl_MN, sr_Cyrl_RS sr_Latn_RS,
zh_Hans_CN, zh_Hant_HK and zh_Hant_TW. Some aliases has been for 2 components
version when possible.

Thanks: Garrett D'Amore (Illumos) who made sure all his work was done under
BSD license!, Edwin Groothuis (edwin@) for the work he made on tools to be able
to generate locales definition usable in freebsd sources out of vanilla CLDR
definitions, John Marino (DragonflyBSD) who first merge the Illumos work into
Dragonfly and spent hours tracking down bugs.

Document bitset(9)

Add declaration to eliminate -Wmissing-prototypes warning.

Replace strndup with OpenBSD's implementation.

MFC after: 2 weeks

Fix spelling.

Reviewed by: wblock, pfg
Approved by: bapt (mentor)
Differential Revision: D3380

Update bzero(3) manpage to following the Posix Standard.

Reviewed by: wblock, pfg
Approved by: bapt (mentor)
Differential Revision: D3380

Make clear the bcopy(3) manpage regards when it was marked as LEGACY
as well as when it was removed from POSIX specification.

Reviewed by: theraven, wblock, bapt, rodrigc
Approved by: bapt, rodrigc (mentor)
Differential Revision: D3374

Remove the mention of memcpy(3) that is build on top of bcopy(3).
Fix some phrases to make it more clear.

Differential Revision: D3378
Reported by: bde@
Reviewed by: wblock
Approved by: bapt, rodrigc (mentor)
Sponsored by: gandi.net

Describe that bcopy(3) is deprecated and marked as LEGACY in
POSIX.1-2001 and removed from the specification in POSIX.1-2008.
New softwares shall use memcpy(3) or memmove(3).

Differential Revision: D3358
Reviewed by: wblock
Approved by: rodrigc
Sponsored by: gandi.net

strchr(3): Mdoc fixes.

memmem(3): empty little string matches the beginning of the big string

This function originated in glibc, and this matches their behaviour
(and NetBSD, OpenBSD, and musl).

An empty big string (arg "l") is handled by the existing
l_len < s_len test.

Reviewed by: bapt, ngie
Sponsored by: The FreeBSD Foundation
Differential Revision: https://reviews.freebsd.org/D2657

Make strlcpy/strlcat slightly easier to read.

Bring small upstream updates.

Obtained from: OpenBSD

Various mdoc fixes and a few EOL whitespace removals.

Found with: mandoc -Tlint

Remove duplicated code.

Suggested by: jmg

Add MLINK for explicit_bzero(3) and bump .Dd date.

MFC after: 2 weeks

Add explicit_bzero(3) and its kernel counterpart.

Obtained from: OpenBSD
MFC after: 2 weeks

use .Mt to mark up email addresses consistently (part4)

PR: 191174
Submitted by: Franco Fichtner <franco at lastsummer.de>

Fix strcasecmp_l() and strncasecmp_l() POSIX 2008 compliance.

POSIX.1-2008 specifies that those two functions should be declared by
including <strings.h>, not <string.h> (the latter only has strcoll_l()
and strxfrm_l()):

http://pubs.opengroup.org/onlinepubs/9699919799/functions/strcasecmp.html

Obtained from: DragonFlyBSD
Reviewed by: theraven
MFC after: 2 weeks

Emphasis on 'do not' and 'complement' in the strcspn(3)
Replace literal parentheses with .Po/.Pc

Approved by: wblock (mentor)

Merge strcspn.3 into strspn.3 and clarify the explaination of what they do
Detach strcspn.3 from the build
Add strcspn.3 to MLINKS do it will be symlinked to strspn.3

Approved by: eadler (mentor), bcr (mentor)

libc man pages: Remove reference to non-existent FreeBSD Security
Architecture

MFC After: 3 days

Replace use of ${.CURDIR} by ${LIBC_SRCTOP} and define ${LIBC_SRCTOP}
if not already defined. This allows building libc from outside of
lib/libc using a reach-over makefile.

A typical use-case is to build a standard ILP32 version and a COMPAT32
version in a single iteration by building the COMPAT32 version using a
reach-over makefile.

Obtained from: Juniper Networks, Inc.

Fix typo: site_t -> size_t

Obtained From: DragonflyBSD (1ac92c8c857a15dc010924c5f066da404e568640)

Fix .Dd after r257646.
DST affects the day by one hour, but the number of days in the
week stay the same.

Use OpenBSD's revamped description of strlcpy and strlcat.

This explanation is supposed to be simpler and better. In particular
"comparing it to the snprintf API provides lots of value, since it raises the
bar on understanding, so that programmers/auditors will a better job calling
all 3 of these functions."

Requested by: deraadt@cvs.openbsd.org
Obtained From: OpenBSD
Reviewed by: cperciva

libc: Always use our own copy of sys_errlist and sys_nerr (.so only).

This ensures strerror() and friends continue to work correctly even if a
(non-PIE) executable linked against an older libc imports sys_errlist (which
causes sys_errlist to refer to the executable's copy with a size fixed when
that executable was linked).

The executable's use of sys_errlist remains broken because it uses the
current value of sys_nerr and may access past the bounds of the array.

Different from the message "Using sys_errlist from executables is not
ABI-stable" on freebsd-arch, this change does not affect the static library.
There seems no reason to prevent overriding the error messages in the static
library.

Renumber clauses to reduce diffs to other versions

NetBSD, OpenBSD, and Android's Bionic number the clauses 1 through 3,
so follow suit to make comparison easier.

Create a symlink from strchrnul.3 to strchr.3.
This was forgotten in the initial commit of strchrnul()

Approved by: theraven

Add strchrnul(), a GNU function similar to strchr(), except that it returns
a pointer to the end of the string, rather than NULL, if the character was
not found.

Approved by: theraven

clarify the wording for 'first' and 'last'

Approved by: wblock
MFC after: 3 days

strsignal(): Reindent.

strsignal(): Do not append signal numbers to messages for known signals.

Messages for known signals looked like "Terminated: 15" instead of
"Terminated".

Correct BUGS description of static buffer use

Since r142667 strerror has unconditionally returned a pointer to a
static buffer.

MFC after: 1 week

Add the functions documented in the man pages in commit 237393 to the
relevant Makefile.

Reminded by: gavin
Approved by: gabor (mentor)
MFC after: 5 days

Add more locale-specific functions to the relevant man pages:
- libc/string/strcoll.3
- libc/string/strstr.3
- libc/string/strxfrm.3
- libc/string/strcasecmp.3

Reviewed by: theraven, gabor
Approved by: gabor (mentor)
MFC after: 5 days

General mdoc(7) and typo fixes.

PR: 167734
Submitted by: Nobuyuki Koganemaru (kogane!jp.freebsd.org)
MFC after: 3 days

Remove trailing whitespace per mdoc lint warning

Disussed with: gavin
No objection from: doc
Approved by: joel
MFC after: 3 days

Fix indentation.

MFC after: 3 days

POSIX mandates that swab do nothing when len < 0

PR: kern/140690
Submitted by: Jeremy Huddleston <jeremyhu@apple.com>
Approved by: cperciva
MFC after: 2 weeks

Add err(3) to strerror(3) SEE ALSO section

PR: docs/164940
Submitted by: Niclas Zeising <zeising@daemonic.se>
Approved by: cperciva
MFC after: 3 days

Change index() and rindex() to a weak alias.

This allows people to still write statically linked applications that
call strchr() or strrchr() and have a local variable or function called
index.

Discussed with: bde@

Merge index() and strchr() together.

As I looked through the C library, I noticed the FreeBSD MIPS port has a
hand-written version of index(). This is nice, if it weren't for the
fact that most applications call strchr() instead.

Also, on the other architectures index() and strchr() are identical,
meaning we have two identical pieces of code in the C library and
statically linked applications.

Solve this by naming the actual file strchr.[cS] and let it use
__strong_reference()/STRONG_ALIAS() to provide the index() routine. Do
the same for rindex()/strrchr().

This seems to make the C libraries and static binaries slightly smaller,
but this reduction in size seems negligible.

Revert r227812 and r227808 per discussion

Reviewed by: many
Approved by: des

- fix some style(9) nits with my last commit
- add a comment explaining why I used '|' instead of '||'

Submitted by: danfe@
Approved by: emaste@

- add check for pointer equality prior to performing the O(n) pass
- while here change 's' to 's1' in strcoll

Submitted by: eadler@
Reviewed by: theraven@
Approved by: brooks@
MFC after: 2 weeks

(Hopefully) Fix the build with clang by removing a typedef that's no longer needed.

Approved by: brooks (mentor)

Implement xlocale APIs from Darwin, mainly for use by libc++. This adds a
load of _l suffixed versions of various standard library functions that use
the global locale, making them take an explicit locale parameter. Also
adds support for per-thread locales. This work was funded by the FreeBSD
Foundation.

Please test any code you have that uses the C standard locale functions!

Reviewed by: das (gdtoa changes)
Approved by: dim (mentor)

Fix prototype for ffsll(3) and fls(3).

PR: docs/156796
Submitted by: Jean-Yves Migeon <jeanyves.migeon free.fr>
MFC after: 3 days

Allow strerror(0) and strerror_r(0, ...).

Of course, strerror_r() may still fail with ERANGE.

Although the POSIX specification said this could fail with EINVAL and
doing this likely indicates invalid use of errno, most other
implementations permitted it, various POSIX testsuites require it to
work (matching the older sys_errlist array) and apparently some
applications depend on it.

PR: standards/151316
MFC after: 1 week

index(3): Mention that index/rindex are deprecated and not specified by
POSIX.1-2008.

MFC after: 1 week

Powerpc is special here. powerpc and powerpc64 use different ABIs, so
their implementations aren't in the same files. Introduce LIBC_ARCH
and use that in preference to MACHINE_CPUARCH. Tested by amd64 and
powerpc64 builds (thanks nathanw@)

MFtbemd:

Prefer MACHNE_CPUARCH to MACHINE_ARCH in most contexts where you want
to test of all the CPUs of a given family conform.

mdoc: move CAVEATS, BUGS and SECURITY CONSIDERATIONS sections to the
bottom of the manpages and order them consistently.

GNU groff doesn't care about the ordering, and doesn't even mention
CAVEATS and SECURITY CONSIDERATIONS as common sections and where to put
them.

Found by: mdocml lint run
Reviewed by: ru

Correct bugs fixed but not merged from my own tree.

Pointy hat to: delphij
MFC after: 1 month

Follow up commit to reindent the code.

MFC after: 1 month

Two optimizations to MI strlen(3) inspired by David S. Miller's
blog posting [1].

- Use word-sized test for unaligned pointer before working
the hard way.

Memory page boundary is always integral multiple of a word
alignment boundary. Therefore, if we can access memory
referenced by pointer p, then (p & ~word mask) must be also
accessible.

- Better utilization of multi-issue processor's ability of
concurrency.

The previous implementation utilized a formular that must be
executed sequentially. However, the ~, & and - operations can
actually be caculated at the same time when the operand were
different and unrelated.

The original Hacker's Delight formular also offered consistent
performance regardless whether the input would contain
characters with their highest-bit set, as it catches real
nul characters only.

These two optimizations has shown further improvements over the
previous implementation on microbenchmarks on i386 and amd64 CPU
including Pentium 4, Core Duo 2 and i7.

[1] http://vger.kernel.org/~davem/cgi-bin/blog.cgi/2010/03/08#strlen_1

MFC after: 1 month

Mark up "unsigned char".

Implement strndup(3) using strnlen(3).

This makes the implementation a bit more consistent with strdup(3),
which uses strlen(3).

Make strsignal(3) thread-safe.

MFC after: 2 weeks

Add a missing word to a sentence in the return values section.

Add an .Nm for strncat.

PR: 141037
Submitted by: Jeremy Huddleston <jeremyhu@apple.com>
MFC after: 3 days

Purge some duplicate mergeinfo.

Correct the information about when the respective functionality first
appeared in FreeBSD.

PR: 133785
Submitted by: Ulrich Spoerlein <uqs@spoerlein.net>
MFC after: 3 days

There is no way for strmode(3) to append '+' if the file has ACL,
because there is no way to figure that out based on the file mode
itself. Make the manual page match reality.

Add wide character variants of string manipulations routines to 'SEE ALSO'.

Approved by: rwatson (mentor)

7.2 will be the first release where strndup() appears.

Submitted by: Florian Smeets <flo kasimir com>
MFC after: 3 days

Add wcpcpy(3) and wcpncpy(3).

Add restrict qualifiers.
I missed this file in my previous commit.

- Add getdelim(), getline(), stpncpy(), strnlen(), wcsnlen(),
wcscasecmp(), and wcsncasecmp().
- Make some previously non-standard extensions visible
if POSIX_VISIBLE >= 200809.
- Use restrict qualifiers in stpcpy().
- Declare off_t and size_t in stdio.h.
- Bump __FreeBSD_version in case the new symbols (particularly
getline()) cause issues with ports.

Reviewed by: standards@

Add restrict qualifiers to the parameters to strlcpy() and strlcat().
The annotation mainly just serves as a hint that they're not intended
for use with overlapping strings.

Make sure the comparison is done with an unsigned char.

Fix the functions to match prototypes. The K&R definitions differ
from the ANSI-C prototype due to the 'int promotion' rule.

- ANSIfy function definitions
- use nul when we are looking for a terminating character where appropriate

Approved by: imp

- Fix grammar. [1]
- Use the correct term 'long mode'. [2]
- style(9) for return value. [3]

Submitted by: Ben Kaduk <minimarmot gmail com> [1],
obrien [2], scf [3]

Rewrite of MI strlen(3) in a way that can better utilize modern hardware by
reducing branches and doing word-sized operation.

The idea is taken from J.T. Conklin's x86_64 optimized version of strlen(3)
for NetBSD, and reimplemented in C by me.

Discussed on: -arch@

Document that ffsll(3) and flsll(3) functions first appeared in
FreeBSD 7.1

Submitted by: Jan Henrik Sylvester <me janh de>
MFC after: 3 days

o Language improvements from OpenBSD;
o Use an ISC-style license as did by the author.

Obtained from: OpenBSD

o ANSIfy.
o Use ISC style copyright as did by the author.

Obtained from: OpenBSD

Sort MLINKS.

o Use full month name in .Dd macro.

Import the strndup(3) function.
Copyright attribution is kept the same as in original NetBSD source.

Submitted by: Florian Smeets <flo kasimir com>
Obtained from: NetBSD
MFC after: 2 weeks

Order the str*.c files mostly alphabetical.

Submitted by: Florian Smeets <flo kasimir com>
MFC after: 2 weeks

Add an easier example.

Reviewed by: trasz

Add the ffsll and flsll functions. These are ffs and fls operating
on long long arguments.

Reviewed by: bde (previous version, that included asm implementation
for all ffs and fls functions on i386 and amd64)
MFC after: 2 weeks

Fix style.

- License change to a less restrictive one;
- ANSIfy;
- Convert do {} while loop -> while {} for clarity;
- Sync RCS ID with OpenBSD;

Obtained from: OpenBSD

Further simplify the code.

Submitted by: Christoph Mallon <christoph.mallon gmx.de>

Use strlcpy() in !localized case to avoid the -1's.

Add memrchr(3).

Obtained from: OpenBSD

Remove license clause 3 to agree with the now-standard BSD license.

Prompted by: Glenn Halperin, Symbian Software

Use C comments since we now preprocess these files with CPP.

Per Regents of the University of Calfornia letter, remove advertising
clause.

# If I've done so improperly on a file, please let me know.

Don't say "rightmost" when referring to the least significant bit.

PR: docs/94803
MFC after: 3 days

Improve the wording. Remove the appositive about strcmp, putting the
first sentence back to the way it was. Add a second sentence that
explains the case when strcmp is called.

o Make grep ^strlcpy work: put a return value type on separate line.

Add each directory's symbol map file to SYM_MAPS.

Add symbol maps and initial symbol version definitions to libc.

Reviewed by: davidxu

Fix prototype.

Fix up markup.

Remove references to nonexistent "FreeBSD Security Architecture" document.

Added a sentence to explain what "span" means.

PR: docs/84850
Submitted by: garys
MFC after: 3 days
Approved by: keramida

Add the function memmem(3) as found in glibc and others.
It is the binary equivalent to strstr(3).

void *memmem(const void *big, size_t big_len,
const void *little, size_t little_len);

Submitted by: Pascal Gloor <pascal.gloor at spale.com>
MFC after: 3 days

Add an implementation of the semi-standard wcsdup() function, as found
on Microsoft and GNU systems.

Replace the current strspn() and strcspn() with significantly faster
implementations inspired by the ones in DragonFly. Unlike the
DragonFly versions, these have a small data cache footprint, and my
tests show that they're never slower than the old code except when the
charset or the span is 0 or 1 characters. This implementation is
generally faster than DragonFly until either the charset or the span
gets in the ballpark of 32 to 64 characters.

Unbreak strsignal(). This is an MFC candidate.

Reported by: Sean McNeil <sean@mcneil.com>

Unbreak !NLS case

Add NLS catalogs support to strerror(), strerror_r() and strsignal().
Controlled by NLS define, currently disabled by default.

Idea obtained from: NetBSD

Don't read more than the given 'len' bytes from the 'big' string.

PR: misc/77369
Submitted by: Ed Maste <emaste@phaedrus.sandvine.ca>
MFC after: 1 week

Sort sections.

Date business, update.

According to the information on:
http://www.opengroup.org/onlinepubs/009695399/functions/swab.html
the prototype for swab() should be in <unistd.h> and not in <string.h>.
Move it, and update to match SUS. Leave the prototype in string.h for
now, for backwards compat.

PR: 74751
Submitted by: Craig Rodrigues <rodrigc@crodrigues.org>
Discussed with: das

Enable building with LIBC_SCCS defined.

Bug submitted by: Andrea Campi <andrea+freebsd_current@webcom.it>

Remove extra closing parenthesis added in revision 1.4.

Noticed by: Andrea Campi

Correctly document the return value of strerror() and strerror_r() and
the contents of the returned buffer for unknown error codes.

PR: docs/72578
Submitted by: Jilles Tjoelker <jilles@stack.nl>
MFC after: 3 days

Mechanically kill hard sentence breaks.

Markup, grammar, and spelling fixes.

Prepare to handle state-dependent encodings. This mainly involves not
taking shortcuts when it comes to storing and passing around conversion
states.

Translate from GNU C to ISO C.

Add and document ffsl(), fls() and flsl().

Brucification: Don't initialize in declaration, make sure extra lines
follow declaration section.

Do comparison using appropriate casting first, as per SUSv3 (search for first
[last] character, not int).

Pass NULL instead of a pointer to a zeroed mbstate_t object.

Pacify gcc about casting pointers to integers (for the lowest few bits).

mdoc(7): Use the new feature of the .In macro.

Move a sentence about the terminating \0 from the RETURN VALUES section
(where it didn't really belong), to the DESCRIPTION section.

English advice: ceri
Requested by: das
MFC after: 4 weeks

* Merge index(3) and rindex(3) to index(3) since the two functions are
almost identical.
* Merge strchr(3) and strrchr(3) to strchr(3) since the two functions
are almost identical.
* Make the wording of index(3) and strchr(3) more similar.
* mdoc(7) cleanup.

Submitted by: SUZUKI Koichi <metal@gc5.so-net.ne.jp>, keramida, myself
PR: docs/32054
Reviewed by: ru
Approved by: ceri (mentor)

o strmode(3) returns void not 0.

PR: docs/53488
Submitted by: Andrey Simonenko <simon@comsys.ntu-kpi.kiev.ua>
MFC after: 1 week

Back out the `hiding' of strlcpy and strlcat. Several people
vocally objected to this safety belt.

`Hide' strlcpy and strlcat (using the namespace.h / __weak_reference
technique) so that we don't wind up calling into an application's
version if the application defines them.

Inspired by: qpopper's interfering and buggy version of strlcpy

MFp4: Make `spanp' const.

Optimize errstr() by reducing the number of times it walks a string.
As a side effect, it makes the code easier to read and requires less
pointer arithmetic.

Test by: strerror regression test
Submitted by: Tim Kientzle <kientzle@acm.org>

Stylistic changes:
o Fix an English error (comma splice) and poorly worded sentence.
o Fix KNF ordering of variables (pointers come before arithmetic types).
o Restore hand-optimization of sizeof()-1, instead of strlen().
o Remove unneeded local variables in strerror_r().

Test by: strerror regression test
Requested by: bde
Reviewed by: bde

Add back the Standards section claiming conformance to 1003.1-2001 and
C99 now that all known standards-related bugs have been fixed.

mdoc(7) police: "The .Fa argument.".

Rearrange strerror() so that its itoa procedure can be used with
strerror_r(). Doing this allows us to ensure that strerror_r() always
fills the supplied buffer regardless of EINVAL or ERANGE errors.

strerror()'s semantics have changed slightly such that an argument of
0 is now considered invalid and errno is set to EINVAL.

Remove internal regression test for strerror() and strerror_r(). This
will be reincarnated in src/tools/regression/lib/libc/string.

In strerror(3), add a comment about strerror()'s bogus return type.

PR: 44356

mdoc(7) police: Fixed abuses of the .Ar and .Em macros.

mdoc(7) police: "The .Fn function".

mdoc(7) police: tiny nits.

Approved by: re

mdoc(7) police: formatting nits.

Approved by: re

libc_r wasn't so tied to libc for 22 months.

Replace wcsstr() with an implementation based on strstr(), which is far
more efficient. The problem with the previous implementation was that it
calculated the length of the first argument ("big") with wcslen() when
it was not necessary.

Restore Berkeley SCCS id.

Remove the Standards section again until we get these functions sorted
out. This will probably have to wait until after 5.0-R.

Fix the NetBSD RCS id's on these files; somehow they were initially
committed with the tags unexpanded.

Reimplement more efficiently, using a single forward scan (like strrchr(3))
instead of scanning forwards to find the end of the string then scanning
backwards to find the character.

Reimplement, handling the case where c == L'\0' correctly and fixing
some style(9) bugs.

Add a Standards section, claiming conformance to IEEE Std. 1003.1-2001.
Also add a note to the Bugs section pointing out that strerror() and
perror() share the same static buffer.

Translate to English.

Replace this wcsncpy() implementation with one based on strncpy.c to fix
two major bugs:
- off-by-one overflow when the length of the source string exceeds or
equals the destination buffer size.
- old version was not padding the destination buffer with null wide chars

C89 does not specifiy strsep(), so our strsep() implementation cannot
conform to it.

Obtained from: OpenBSD

Add cross-references to the wide character counterparts of these functions.

Remove stray comma at the end of the See Also list.

Fix another spelling mistake.

Correct a spelling mistake.

Add a placeholder implementation of wcscoll() and wcsxfrm() which gives
locale-sensitive collation only in single-byte locales, and just does
binary comparison for the others with extended character sets.

Add stpcpy(3).

Add an example showing how to use wcstok(). Fix ordering of See Also section.

Simplify by removing unneeded local variables and explicit null termination.

Simplify by removing useless local variables and explicit null termination.

Remove unnecessary #include <assert.h>; it was used to bring in the
_DIAGASSERT macro on NetBSD, but we don't need it.

Replace a stray reference to strtok() with one to wcstok().

Add an implementation of wcstok(), based on strtok_r().

Sync prototypes with <wchar.h> with respect to the restrict qualifier.

Add restrict qualifiers where C99 permits them. All of these already had
restrict qualifiers on their prototypes in <wchar.h>.

Call strtok_r() via a libc private name from within strtok().

Style: One space between "restrict" qualifier and "*".

- Let their manual pages show the reader that the bzero(3) and
bcopy(3) functions are prototyped in <strings.h> and not in
<string.h> anymore.
- Add a sentence about that to the respective HISTORY sections.
In the C source files:
- Include <string.h> or <strings.h> depending on what function
is to be compiled.
- Use ANSI-C function definitions.

Add the 'restrict' type qualifier to the function prototype
of the swab(3) function in its manual page to match the
standardization by POSIX.1-2001.

- Update the manual page of bcmp(3) by replacing
.In string.h
with
.In strings.h
and adding a sentence to the HISTORY section.
- Use an ANSI-C function definition.
- Include <strings.h> instead of <string.h>.
- Apply style(9): Put a space after return keywords.

- Convert the function definition to declare its arguments
in the ANSI-C format.
- Change the code a bit to hopefully save some cycles.
I.e. (simplified) change

a = b + 1;
while (--b & 0x7)
/* ... */
to
a = b;
for (; b & 0x7; b--)
/* ... */
and
while (--a >= 0)
/* ... */
to
for (; a > 0; a--)
/* ... */
- Equip two function arguments of swab() with the 'restrict'
type qualifier in form of the '__restrict' macro. This is
specified by POSIX.1-2001.

- Update the manual pages of index() and rindex() to show
<strings.h> as the associated header file.
The prototypes have been moved there from <string.h> because
POSIX.1-2001 said so.
- Conditionally include either <strings.h> or <string.h> based
on whether the [r]index() or str[r]chr() functions are
compiled, respectively.
- Style(9) tells us to
- put a space after the return keyword
- to check for a NUL character without using the ! operator.
- use NULL instead of (type *)NULL where the compiler knows
the type.
Apply these rules.
- Rather use ANSI-C function definitions than K&R ones.
- For index(3), correct second function argument's type; it was
declared to be a `const char' before and is now an `int'.

- Update the manual page to show that the associated header file
is <strings.h> and not <string.h> anymore.
- Tell the reader about this change in the HISTORY section.
- Switch to use an ANSI-C function definition.
- Include <strings.h> instead of <string.h> in the source file.

- Update strcasecmp(3)/strncasecmp(3) to reflect the fact that
the prototypes for both functions are now in the <strings.h>
header, as required by IEEE Std 1003.1-2001.
- Add one sentence about that in the HISTORY section.
- Include <strings.h> in the source file to have the prototypes
in scope when the _ANSI_SOURCE macro is defined.

Add a manual page for wcswidth().

Move just committed version of wcswidth.c here (from "locale"),
a bit optimized now.

- Add the 'restrict' qualifier to the definitions of the string
concatenation and copy functions using the '__restrict' macro.
This is to satisfy IEEE Std 1003-1.2001.
- Use ANSI-C function definitions.
- Add the 'restrict' keyword to the manual pages, too.

- Add the 'restrict' qualifier required by IEEE Std 1003.1-2001
to the function definition of strxfrm(3) in form of our
'__restrict' macro.
- Use an ANSI-C function definition for strxfrm(3).
- Change the manual page accordingly.

Correct an inaccuracy in this man page regarding detecting empty fields.

MFC after: 2 days

Fix off-by-one error.

PR: misc/40104
Submitted by: Neal Fachan <neal@isilon.com>
MFC after: 3 days

Fix the style of the SCM ID's.
I believe have made all of libc .c's as consistent as possible.

Remove 'register' keyword.

Revert last commit. stdio.h include is for perror(), not strerror()

strerror(3) is in string.h, not stdio.h

MFC after: 1 week

Add a few cleanups from rev 1.1:
o Restore vendor ID.
o Order variable types by size.
o Remove a gratuitous temporary variable.

Submitted by: bde

o Add prototype for printf(3).

style(9):
o Order variables in declarations.
o Move initialization out of declaration.
o Fix over-indents in previous delta.

style(9)

Submitted by: Joseph Mallett <jmallett@xmach.org>
Reviewed by: md5(1)

mdoc(7) police:

Stop abusing the .%J macro for where the .Pa macro should have been used.

Suggest using memmove(3) if src and dst may overlap.

PR: 33298
Submitted by: Tim J. Robbins <tim@robbins.dropbear.id.au>

Add a new `SECURITY CONSIDERATIONS' section. Sample code similar to
the first revision of strcpy(3)'s section is included, but should be
removed as the Security Architecture document is committed and
completed.

Obtained from: TrustedBSD Project
Sponsored by: DARPA, NAI Labs

Include a section cross-reference to `EXAMPLES' in `SECURITY
CONSIDERATIONS' as a source for relevant sample code.

Obtained from: TrustedBSD Project
Sponsored by: DARPA, NAI Labs

Remove the example from SECURITY CONSIDERATIONS. This is mostly
duplicated code from EXAMPLES.

Obtained from: TrustedBSD Project
Sponsored by: DARPA, NAI Labs

Copy the sample `SECURITY CONSIDERATIONS' section from sec-doc.7.
This will be trimmed as the FreeBSD Security Architecture document
is fleshed out and committed.

Obtained from: TrustedBSD Project
Sponsored by: DARPA, NAI Labs

mdoc(7) police: minor markup nits.

Make strerror and strerror_r use sys_errlist[0] for errnum = 0. Be
more careful about reporting truncation with ERANGE in strerror_r.
Set errno to EINVAL for "unknown" errnum in strerror as required
by P1003.1-200x Draft June 14, 2001.

More carefully document the handling of strerrbuf when errors
(ERANGE, EINVAL) are encountered in strerror_r.

Reviewed by: bde (ongoing discussion)

New, improved, more Posix-compliant strerror_r implementation,
complete with documentation.

Reviewed by: mike@ gad@
MFC after: 1 week

Must link strerror manpage to strerror_r.

Thanks for the review, Mike.

Submitted by: Mike Barcroft <mike@FreeBSD.org>

Add strerror_r function per Posix prototype.

Reviewed by: Mike Barcroft <mike@FreeBSD.org>
MFC after: 2 weeks

mdoc(7) police: minor markup and spelling fixes.

Increment the loop counter.

PR: bin/29218
Submitted by: Goran Lowkrantz <goran.lowkrantz@ismobile.com>

rcsid[]->__FBSDID

Note that strncmp() will not compare characters after a NUL character.
Add a missing word. Bump document date.

Inspired by: IEEE Std 1003.1-200x (Draft 7)
MFC after: 3 days

Clarify that strnstr() will stop searching after in encounters a NUL
character. Bump document date. Add a missing comma.

Implement strcasestr() which many others (f.e. Linux) already have.

Document the fact that the strnstr(3) function is not portable.

Requested by: brian, gad

Add a new libc function, strnstr(3), which allows one to limit the
number of characters that are searched. This is especially useful
with file operations and non-NUL terminated strings.

Silence from: -audit, -hackers
MFC after: 5 days

Fixed syntax errors in synopsis. The restrict keyword doesn't exist yet.
The corresponding bugs in <wchar.h> have no effect because the function
prototypes there don't have args so the __restrict "keyword" is
misinterpreted as an arg.

mdoc(7) police: Use the new .In macro for #include statements.

Note that strdup(3) will set errno if memory allocation fails. This
is also required by the forthcoming POSIX.1-200x standard.

Obtained from: malloc.3

o Various mdoc fixes.
o Replace strncpy examples with less confusing ones from
OpenBSD. These examples give more detail and also suggest
using strlcpy(3).

Reviewed by: des, ru, sheldonh
Obtained from: OpenBSD
MFC after: 3 days

mdoc(7) police: expand plain text xrefs.

Only pull in the MD files if they exist. This allows for progressive
implementation and compilation when bringing up a new architecture.

Sync to OpenBSD (update comment and minor style change).

Obtained from: OpenBSD
MFC after: 1 week

Sync to OpenBSD:

Clarify that if strlcat() does not find a NUL within siz byte it
will not NUL terminate either.

Document boundary condition when size < strlen(dst).

"of", not "on" (from Henric Jungheim)

Obtained from: OpenBSD
MFC After: 1 week

Don't claim that strncpy() is the same as strcpy().

PR: 29002
Submitted by: Joseph Mallett <jmallett@xMach.org>

mdoc(7) police: Add strncpy() to the NAME section.

Remove whitespace at EOL.

style nits

mdoc(7) police: removed HISTORY info from the .Os call.

Make the rcsid and FreeBSD IDs more sane in the wcs* and wmem* files.
Do the same for the non-wcs*/wmem* files while I'm here.

... but we do provide .St -isoC-99, and it is not required to have the
history info as:

: .Sh STANDARDS If the command, library function or file adheres to a
: specific implementation such as IEEE Std 1003.2
: (``POSIX.2'') or ANSI X3.159-1989 (``ANSI C'') this
: should be noted here. If the command does not adhere
: to any standard, its history should be noted in the
: HISTORY section.

Unbreak world; _DIAGASSERT macro is not available in FreeBSD.

adapt to FreeBSD.
- enable locale-insensitive functions of wchar.h:
wcscat.c wcschr.c wcscmp.c wcscpy.c wcscspn.c wcslcat.c wcslcpy.c
wcslen.c wcsncat.c wcsncmp.c wcsncpy.c wcspbrk.c wcsrchr.c wcsspn.c
wcsstr.c wmemchr.c wmemcmp.c wmemcpy.c wmemmove.c wmemset.c
XXX: wcswidth.c is not enabled yet.
- enable wmemchr(3) man page.
XXX: FreeBSD lacks .St -isoC99 and .St -isoC-amd1.

initial import of locale insensitive wcs* and wmem* functions.

Obtained from: NetBSD and Citrus.

mdoc(7) police: add RETURN VALUES section.

PR: docs/27161
Submitted by: Kazuhiro KONDOU <k-fuji@za2.so-net.ne.jp>

MAN[1-9] -> MAN.

.St -ansiC -> .St -isoC

mdoc(7) police: split punctuation characters + misc fixes.

Clarify comments referring to strlcat() usage

Obtained from: OpenBSD

- Reverse the order of two loop invariant to ensure strlcat() does not
attempt to read memory when siz is 0
- Clarify comments referring to strlcat() usage

PR: 24278, 24295
Submitted by: Tony Finch <dot@dotat.at>
Richard Kettlewell <rjk@greenend.org.uk>
Reviewed by: -audit

mdoc(7) police: Ft/Vt now accept punctuation-type arguments.

Prepare for mdoc(7)NG.

mdoc(7) police: removed history info from the .Os FreeBSD call.

MAXPATHNAMELEN -> MAXPATHLEN

Submitted by: ianm@kashmir.cit.nepean.uws.edu.au via OpenBSD
Obtained from: OpenBSD

mdoc(7) police: use certified section headers wherever possible.

Avoid use of direct troff requests in mdoc(7) manual pages.

Add:
The implementation will behave as if no library function calls strtok().

Drop the references to index(3) and rindex(3), which are non-standard
and people shouldn't be encouraged to use them.

Asked by: sheldonh

Add SEE ALSO section, as with the other string functions.

Submitted by: dcs

Introduce ".Lb" macro to libc manpages.

More libraries manpages updates following.

Remove single-space hard sentence breaks. These degrade the quality
of the typeset output, tend to make diffs harder to read and provide
bad examples for new-comers to mdoc.

Grammar: "be even number" -> "be an even number"

Backout the prev. commit. It's a bad idea to make-up terms. I believe
there is no good solution here.

Set-on-the-straight-and-narrow by: bde

Add ".Xref tolower 3" since its internal use is inferred in DESCRIPTION.

Avoid the potentially confusing term "a null pointer" and say "the NULL
pointer" instead. The potential confusion arises because the string/*.3
pages use the term "null-terminated string" (which is permissable). Moreover,
this also makes these two manpages more consistent with the other string/*.3
manpages.

Remove x-ref to itself.

Reviewed by: mpp

Add HISTORY.

Xref strlcat, strlcpy

Inspired by: NetBSD commit message describing this.

__collate_substitute() do something non-trivial only for German. For everyone
else, it is equivalent to strdup(). So, we will check if the substitution
tables are trivial at the load time, and possibly save 2 calls to
__collate_substitute() in strcoll().

Still, __collate_substitute() should not exist.

Add $FreeBSD$ lines to man pages that are missing them to make
it easier for translation teams.

PR: docs/13418
Submitted by: Alexey Zelkin <phantom@cris.net>

$Id$ -> $FreeBSD$

Various man page cleanup:

- Sort xrefs
- FreeBSD.ORG -> FreeBSD.org
- Be consistent with section names as outlines in mdoc(7)
- Other misc mdoc cleanup.

PR: doc/13144
Submitted by: Alexy M. Zelkin <phantom@cris.net>

Use the latest version of these files from OpenBSD.

1) Safty change from casper dik was added to OpenBSD's sources since I
grabbed them. milltert@openbsd.org
2) Split up strlcpy to improve efficiency of the common case.
milltert@openbsd.org
3) Cleanup of cross references for man page. {alex,aaron}@openbsd.org

Pointed out by: deraadt@openbsd.org

Import strl{cat,cpy} from OpenBSD.

Obtained from: OpenBSD

Add $Id$, to make it simpler for members of the translation teams to
track.

The $Id$ line is normally at the bottom of the main comment block in the
man page, separated from the rest of the manpage by an empty comment,
like so;

.\" $Id$
.\"

If the immediately preceding comment is a @(#) format ID marker than the
the $Id$ will line up underneath it with no intervening blank lines.
Otherwise, an additional blank line is inserted.

Approved by: bde

Fixed a minor style nit in the EXAMPLE section.

Fix a minor style nit in the NAME section.

Move the description of the strncmp() function from the RETURN VALUES
section to the DESCRIPTION section.

PR: 12133
Submitted by: Sheldon Hearn <sheldonh@uunet.co.za>

Fixed disordering and duplication of MLINKS in previous commit to
libc/string/Makefile.inc. psignal.3 doesn't live in libc/string.

Add a strsignal(3) (like strerror(3)) for libc compatability with other
systems. NetBSD, Linux, SVR4 etc all have it.

More egcs warning fixes:
o use braces to avoid potentially ambiguous else
o don't default to type int (and also remove a useless register
modifier).
o Use parens around assignment values used as truth values.
o Remove unused function.

Reviewed by: obrien and chuckr

Corrected use of backslash escaping in sample code.

PR: docs/10284
Submitted by: Alfred Perlstein <bright@cygnus.rush.net>

remove BUGS section, now behaviour is predictable enough

more words about return value

re-phrase things a bit

fix wrong return result
fix n=0 case
improve manpage

Install man page link for strtok_r.

Spell check and minor grammar fix.

Reviewed by: JKH
Submitted by: Wes Peters

Added strtok_r (reentrant) function and man page.

(Whoops: make it better instead of worse this time). Clarify
processing of the string argument by perror().

Clarify processing of the string argument by perror().

Fix handling more than 1 char with non-C locale
Misc. cleanup
PR: 6825
Submitted by: Sergey Gershtein <sg@mplik.ru>

Cast a pointer to a long, not an int before masking it.

Pedantry (NULL -> NUL).

Change MACHINE references to MACHINE_ARCH.

PR: 5573
Submitted by: garbanzo@hooked.net
Add strncasecmp, strncmp to NAME field.

The terminating character in strings is `NUL', not `NULL'.

Sorted lists.

Handle machine-dependent (m-d) (string) sources more automatically.
The names of m-d variants are now added (manually) to MDSRCS instead
of to SRCS, and the names of all machine-independent (m-i) variants
that can reasonably be replaced by an m-d variant are now added
(manually) to MISRCS instead of to SRCS, so that a simple substitution
can be used to discard the unused m-i variants. MISRCS is potentially
all m-i sources, but the substitution is too simple to be fast, so
MISRCS should be kept reasonably small.

libc/Makefile.inc:
Do the substitution.

libc/i386/string/Makefile.inc:
Add to MDSRCS instead of to SRCS. Add the names of all sources in this
directory, but no others.

libc/string/Makefile.inc
Add to MISRCS instead of to SRCS. Add the names of all sources in this
directory. Don't use (broken) explicit rules for special cases.

Removed the subdirectory paths from the definitions of MAN[1-9]. They
were a workaround for limitations in bsd.man.mk that were fixed about
2 years ago.

Added some 2-line source files to get a direct correspondence
between sources and objects. This will be used to avoid messy
special cases in Makefile.inc.

Added bounds checking to the example after chasing down someone's
broken code where they'd copied the example basically verbatim and
blew an array. (engage brain before typing 'make')

kill the undead

This commit was generated by cvs2svn to compensate for changes in r27180,
which included commits to RCS files with non-trunk default branches.

Changed all paths to be relative to src/lib instead of src/lib/libc
so that all these makefiles can be used to build libc_r too.

Added .if ${LIB} == "c" tests to restrict man page builds to libc
to avoid needlessly building them with libc_r too.

Split libc Makefile into Makefile and Makefile.inc to allow the
libc_r Makefile to include Makefile.inc too.

Fixed #include and/or prototype bugs in synopsis.

Merge from Lite2 (whiteout/unionfs)

This commit was generated by cvs2svn to compensate for changes in r23658,
which included commits to RCS files with non-trunk default branches.

Revert $FreeBSD$ to $Id$

Sort cross references.

Make the long-awaited change from $Id$ to $FreeBSD$

This will make a number of things easier in the future, as well as (finally!)
avoiding the Id-smashing problem which has plagued developers for so long.

Boy, I'm glad we're not using sup anymore. This update would have been
insane otherwise.

delete doubled words, e.g.: "the the" -> "the"

add missing comma(s) in .Xr macros

Fixed the easy cases of const poisoning in the kernel. Cosmetic.

Correctly use .Fn instead of .Nm to reference function names
in a bunch of man pages.

Use the correct .Bx (BSD UNIX) or .At (AT&T UNIX) macros
instead of explicitly specifying the version in the text
in a bunch of man pages.

Back out fallback approximation changes, they are not so right to live

General -Wall warning cleanup, part I.
Submitted-By: Kent Vander Velden <graphix@iastate.edu>

Use better approximation if collate info not available.
Fix bug: strxfrm+strcmp != strcoll, if collate info not available

Localize it.
(it was NOT localized initially, it does some trick instead!)

``mv'' -> ``mv -f''
``rm'' -> ``rm -f''
so mv/rm may not ask for confirmation if you are not root

Added `const' to types of sys_errlist and sys_nerr.

Use .Va instead of .Fa to describe these variables.

Say a little about inconsistent declarations of sys_errlist in the BUGS
section.

Update the description of strncat to accurately describe how many
bytes are copied to the destination string. Closes PR#1000.

Submitted by: Dave Glowacki <dglo@ssec.wisc.edu>

Another round of man page cleanups.

Down to only about 100 items left to cleanup! :-)

Fix even more spelling errors in some more man pages.

Correct the strspn() man page so that it no longer references
itself as strcspn().

Obtained from: NetBSD-bugs mailing list (PR# 1905)

This commit was generated by cvs2svn to compensate for changes in r13122,
which included commits to RCS files with non-trunk default branches.

Remove trailing whitespace.

If locale not available, fallback to strcasecmp, not to strcmp

Don't build swab.o here. It gets built in libc/i386/string. Previously
the copy built from here was overwritten by the other copy and the other
copy was put in library-building command lines twice. ld now objects to
duplicated modules.

Minor optimization.

Copyrights cleanup

Add 8bit collate stuff
Submitted by: alex@elvisti.kiev.ua

Obtained from: 386BSD-0.1 patchkit; also fixed in 1.1.5

Compare unsigned chars.
Return the place after where the character was found and not the start
of the string.

Use latest Arthur Olson timezone code rather than that supplied with
4.4. The code is almost identical to the 4.4 versions, but this organization
should make it easier to merge new versions in the future.

Don't include <sys/types.h> to get u_int or use u_int for a bogus cast.

Modernize bcopy -> memcpy.

Fix printing of weird errno's: negative values were printed as large
unsigned's; null termination was only guaranteed for the first call.

Fix lint: don't declare externs internally; they were both out of date.

First crack at making libc work with the new make macros. It compiles on
my machine, and a simple static (genassym) and shared (sysctl) executable
both work. Still to be done: RPCand YP merge.

This commit was generated by cvs2svn to compensate for changes in r1573,
which included commits to RCS files with non-trunk default branches.