Improved the performance of kernel profiling on MULTIPROCESSOR, and possible to get profiling data for each CPU.

In the current implementation, locks are acquired at the entrance of the mcount
internal function, so the higher the number of cores, the more lock conflict
occurs, making profiling performance in a MULTIPROCESSOR environment unusable
and slow. Profiling buffers has been changed to be reserved for each CPU,
improving profiling performance in MP by several to several dozen times.

- Eliminated cpu_simple_lock in mcount internal function, using per-CPU buffers.
- Add ci_gmon member to struct cpu_info of each MP arch.
- Add kern.profiling.percpu node in sysctl tree.
- Add new -c <cpuid> option to kgmon(8) to specify the cpuid, like openbsd.
For compatibility, if the -c option is not specified, the entire system can be
operated as before, and the -p option will get the total profiling data for
all CPUs.

Overhaul the API used to fetch and store individual memory cells in
userspace. The old fetch(9) and store(9) APIs (fubyte(), fuword(),
subyte(), suword(), etc.) are retired and replaced with new ufetch(9)
and ustore(9) APIs that can return proper error codes, etc. and are
implemented consistently across all platforms. The interrupt-safe
variants are no longer supported (and several of the existing attempts
at fuswintr(), etc. were buggy and not actually interrupt-safe).

Also augmement the ucas(9) API, making it consistently available on
all plaforms, supporting uniprocessor and multiprocessor systems, even
those that do not have CAS or LL/SC primitives.

Welcome to NetBSD 8.99.37.

branches: 1.48.4;
Add a proper defflag for GPROF, and include opt_gprof.h, otherwise we're
not gonna go very far.

don't cast void * in c.

branches: 1.46.2;
Ensure that the top level sysctl nodes (kern, vfs, net, ...) exist before
the sysctl link sets are processed, and remove redundancy.

Shaves >13kB off of an amd64 GENERIC, not to mention >1k duplicate
lines of code.

branches: 1.45.12; 1.45.22; 1.45.26;
Replace few USER_TO_UAREA/UAREA_TO_USER uses, reduce sys/user.h inclusions.

Fix comment for arg types of sys_profil().

branches: 1.43.10; 1.43.12;
Convert all the system call entry points from:
int foo(struct lwp *l, void *v, register_t *retval)
to:
int foo(struct lwp *l, const struct foo_args *uap, register_t *retval)
Fixup compat code to not write into 'uap' and (in some cases) to actually
pass a correctly formatted 'uap' structure with the right name to the
next routine.
A few 'compat' routines that just call standard ones have been deleted.
All the 'compat' code compiles (along with the kernels required to test
build it).
98% done by automated scripts.

branches: 1.42.4; 1.42.8;
machine/{bus,cpu,intr}.h -> sys/{bus,cpu,intr}.h

branches: 1.41.6; 1.41.8; 1.41.12;
Merge some of the less invasive changes from the vmlocking branch:

- kthread, callout, devsw API changes
- select()/poll() improvements
- miscellaneous MT safety improvements

branches: 1.40.2; 1.40.4;
use char* for the kernel representation of the user profile buffer
address too, for consistency
(we've lost some abstraction here)

Kill caddr_t; there will be some MI fallout, but it will be fixed shortly.

branches: 1.38.2;
Merge newlock2 to head.

add missing initializer.

branches: 1.36.2;
remove some __unused from function parameters.

- sprinkle __unused on function decls.
- fix a couple of unused bugs
- no more -Wno-unused for i386

lowercase roundup/down

branches: 1.33.20; 1.33.22;
merge ktrace-lwp.

branches: 1.32.2;
Use ANSI function decls.

Lots of sysctl descriptions (if someone wants to help out here, that
would be good) mostly copied from sysctl(3). This takes care of the
top-level, most of kern.* and hw.* (modulo the ath and bge stuff), and
all of proc.*.

If you don't want the added rodata in your kernel, use "options
SYSCTL_NO_DESCR" in your kernel config.

branches: 1.30.2;
Tango on sysctl_createv() and flags. The flags have all been renamed,
and sysctl_createv() now uses more arguments.

Dynamic sysctl.

Gone are the old kern_sysctl(), cpu_sysctl(), hw_sysctl(),
vfs_sysctl(), etc, routines, along with sysctl_int() et al. Now all
nodes are registered with the tree, and nodes can be added (or
removed) easily, and I/O to and from the tree is handled generically.

Since the nodes are registered with the tree, the mapping from name to
number (and back again) can now be discovered, instead of having to be
hard coded. Adding new nodes to the tree is likewise much simpler --
the new infrastructure handles almost all the work for simple types,
and just about anything else can be done with a small helper function.

All existing nodes are where they were before (numerically speaking),
so all existing consumers of sysctl information should notice no
difference.

PS - I'm sorry, but there's a distinct lack of documentation at the
moment. I'm working on sysctl(3/8/9) right now, and I promise to
watch out for buses.

Move UCB-licensed code from 4-clause to 3-clause licence.

Patches provided by Joel Baker in PR 22364, verified by myself.

branches: 1.27.2;
Add extensible malloc types, adapted from FreeBSD. This turns
malloc types into a structure, a pointer to which is passed around,
instead of an int constant. Allow the limit to be adjusted when the
malloc type is defined, or with a function call, as suggested by
Jonathan Stone.

Merge the nathanw_sa branch.

add RCSIDs

Don't need to include <uvm/uvm_extern.h> just to include <sys/sysctl.h>
anymore.

branches: 1.23.2; 1.23.6;
Before allowing kgmon to do anything, check that we managed to allocate the
profiling buffer at startup. If not, pretend the kernel doesn't have
profiling support at all.

branches: 1.22.2;
Introduce PROC_PC(), which is used to get a process's user PC. If this is
defined, call addupc_intr() directly from statclock() in the system time case,
using the same P_OWEUPC path if the copyin/copyout fails.
Use this in i386 to remove profiling code from the normal userret() path.

remove include of <vm/vm.h>

Get rid of register declarations.

branches: 1.19.12;
Abolition of bcopy, ovbcopy, bcmp, and bzero, phase one.
bcopy(x, y, z) -> memcpy(y, x, z)
ovbcopy(x, y, z) -> memmove(y, x, z)
bcmp(x, y, z) -> memcmp(x, y, z)
bzero(x, y) -> memset(x, 0, y)

fix sizeofs so they comply with the KNF style guide. yes, it is pedantic.

branches: 1.17.2;
Merge with Lite2 + local changes

Add #include <sys/sysctl.h>, which in turn needs #include <vm/vm.h>.

As discussed, replace KERNBASE with kernel_text.

backout previous kprintf change

printf -> kprintf, sprintf -> ksprintf

remove include of <sys/cpu.h>

Remove extraneous argument from sysctl_doprof().
Fix a printf format.

More proto fixes

First pass at prototyping

change definition of profil() to make it 64-bit friendly. This has
no practical consequence on 32-bit systems. old prototype was
int profil(char *, int, int, int), and new one is int profile(char *,
size_t, u_long, u_int). the size_t is the size of the buffer,
and the u_long is the 'starting offset'. (I changed the last int
to u_int, because it's treated as a u_int everywhere, and isn't
logically a signed value.)

Prefix names of system call implementation functions with `sys_'.

Make system calls conform to a standard prototype and bring those
prototypes into scope.

Use %p.

update for new syscall args description mechanism

New RCS ID's, take two. they're more aesthecially pleasant, and use 'NetBSD'

sysctl kernel prof info

branches: 1.1.1;
lots of changes: prototype migration, move lots of variables, definitions,
and structure elements around. kill some unnecessary type and macro
definitions. standardize clock handling. More changes than you'd want.

Overhaul the API used to fetch and store individual memory cells in
userspace. The old fetch(9) and store(9) APIs (fubyte(), fuword(),
subyte(), suword(), etc.) are retired and replaced with new ufetch(9)
and ustore(9) APIs that can return proper error codes, etc. and are
implemented consistently across all platforms. The interrupt-safe
variants are no longer supported (and several of the existing attempts
at fuswintr(), etc. were buggy and not actually interrupt-safe).

Also augmement the ucas(9) API, making it consistently available on
all plaforms, supporting uniprocessor and multiprocessor systems, even
those that do not have CAS or LL/SC primitives.

Welcome to NetBSD 8.99.37.

Add a proper defflag for GPROF, and include opt_gprof.h, otherwise we're
not gonna go very far.

don't cast void * in c.

branches: 1.46.2;
Ensure that the top level sysctl nodes (kern, vfs, net, ...) exist before
the sysctl link sets are processed, and remove redundancy.

Shaves >13kB off of an amd64 GENERIC, not to mention >1k duplicate
lines of code.

branches: 1.45.12; 1.45.22; 1.45.26;
Replace few USER_TO_UAREA/UAREA_TO_USER uses, reduce sys/user.h inclusions.

Fix comment for arg types of sys_profil().

branches: 1.43.10; 1.43.12;
Convert all the system call entry points from:
int foo(struct lwp *l, void *v, register_t *retval)
to:
int foo(struct lwp *l, const struct foo_args *uap, register_t *retval)
Fixup compat code to not write into 'uap' and (in some cases) to actually
pass a correctly formatted 'uap' structure with the right name to the
next routine.
A few 'compat' routines that just call standard ones have been deleted.
All the 'compat' code compiles (along with the kernels required to test
build it).
98% done by automated scripts.

branches: 1.42.4; 1.42.8;
machine/{bus,cpu,intr}.h -> sys/{bus,cpu,intr}.h

branches: 1.41.6; 1.41.8; 1.41.12;
Merge some of the less invasive changes from the vmlocking branch:

- kthread, callout, devsw API changes
- select()/poll() improvements
- miscellaneous MT safety improvements

branches: 1.40.2; 1.40.4;
use char* for the kernel representation of the user profile buffer
address too, for consistency
(we've lost some abstraction here)

Kill caddr_t; there will be some MI fallout, but it will be fixed shortly.

branches: 1.38.2;
Merge newlock2 to head.

add missing initializer.

branches: 1.36.2;
remove some __unused from function parameters.

- sprinkle __unused on function decls.
- fix a couple of unused bugs
- no more -Wno-unused for i386

lowercase roundup/down

branches: 1.33.20; 1.33.22;
merge ktrace-lwp.

branches: 1.32.2;
Use ANSI function decls.

Lots of sysctl descriptions (if someone wants to help out here, that
would be good) mostly copied from sysctl(3). This takes care of the
top-level, most of kern.* and hw.* (modulo the ath and bge stuff), and
all of proc.*.

If you don't want the added rodata in your kernel, use "options
SYSCTL_NO_DESCR" in your kernel config.

branches: 1.30.2;
Tango on sysctl_createv() and flags. The flags have all been renamed,
and sysctl_createv() now uses more arguments.

Dynamic sysctl.

Gone are the old kern_sysctl(), cpu_sysctl(), hw_sysctl(),
vfs_sysctl(), etc, routines, along with sysctl_int() et al. Now all
nodes are registered with the tree, and nodes can be added (or
removed) easily, and I/O to and from the tree is handled generically.

Since the nodes are registered with the tree, the mapping from name to
number (and back again) can now be discovered, instead of having to be
hard coded. Adding new nodes to the tree is likewise much simpler --
the new infrastructure handles almost all the work for simple types,
and just about anything else can be done with a small helper function.

All existing nodes are where they were before (numerically speaking),
so all existing consumers of sysctl information should notice no
difference.

PS - I'm sorry, but there's a distinct lack of documentation at the
moment. I'm working on sysctl(3/8/9) right now, and I promise to
watch out for buses.

Move UCB-licensed code from 4-clause to 3-clause licence.

Patches provided by Joel Baker in PR 22364, verified by myself.

branches: 1.27.2;
Add extensible malloc types, adapted from FreeBSD. This turns
malloc types into a structure, a pointer to which is passed around,
instead of an int constant. Allow the limit to be adjusted when the
malloc type is defined, or with a function call, as suggested by
Jonathan Stone.

Merge the nathanw_sa branch.

add RCSIDs

Don't need to include <uvm/uvm_extern.h> just to include <sys/sysctl.h>
anymore.

branches: 1.23.2; 1.23.6;
Before allowing kgmon to do anything, check that we managed to allocate the
profiling buffer at startup. If not, pretend the kernel doesn't have
profiling support at all.

branches: 1.22.2;
Introduce PROC_PC(), which is used to get a process's user PC. If this is
defined, call addupc_intr() directly from statclock() in the system time case,
using the same P_OWEUPC path if the copyin/copyout fails.
Use this in i386 to remove profiling code from the normal userret() path.

remove include of <vm/vm.h>

Get rid of register declarations.

branches: 1.19.12;
Abolition of bcopy, ovbcopy, bcmp, and bzero, phase one.
bcopy(x, y, z) -> memcpy(y, x, z)
ovbcopy(x, y, z) -> memmove(y, x, z)
bcmp(x, y, z) -> memcmp(x, y, z)
bzero(x, y) -> memset(x, 0, y)

fix sizeofs so they comply with the KNF style guide. yes, it is pedantic.

branches: 1.17.2;
Merge with Lite2 + local changes

Add #include <sys/sysctl.h>, which in turn needs #include <vm/vm.h>.

As discussed, replace KERNBASE with kernel_text.

backout previous kprintf change

printf -> kprintf, sprintf -> ksprintf

remove include of <sys/cpu.h>

Remove extraneous argument from sysctl_doprof().
Fix a printf format.

More proto fixes

First pass at prototyping

change definition of profil() to make it 64-bit friendly. This has
no practical consequence on 32-bit systems. old prototype was
int profil(char *, int, int, int), and new one is int profile(char *,
size_t, u_long, u_int). the size_t is the size of the buffer,
and the u_long is the 'starting offset'. (I changed the last int
to u_int, because it's treated as a u_int everywhere, and isn't
logically a signed value.)

Prefix names of system call implementation functions with `sys_'.

Make system calls conform to a standard prototype and bring those
prototypes into scope.

Use %p.

update for new syscall args description mechanism

New RCS ID's, take two. they're more aesthecially pleasant, and use 'NetBSD'

sysctl kernel prof info

branches: 1.1.1;
lots of changes: prototype migration, move lots of variables, definitions,
and structure elements around. kill some unnecessary type and macro
definitions. standardize clock handling. More changes than you'd want.

Add a proper defflag for GPROF, and include opt_gprof.h, otherwise we're
not gonna go very far.

don't cast void * in c.

branches: 1.46.2;
Ensure that the top level sysctl nodes (kern, vfs, net, ...) exist before
the sysctl link sets are processed, and remove redundancy.

Shaves >13kB off of an amd64 GENERIC, not to mention >1k duplicate
lines of code.

branches: 1.45.12; 1.45.22; 1.45.26;
Replace few USER_TO_UAREA/UAREA_TO_USER uses, reduce sys/user.h inclusions.

Fix comment for arg types of sys_profil().

branches: 1.43.10; 1.43.12;
Convert all the system call entry points from:
int foo(struct lwp *l, void *v, register_t *retval)
to:
int foo(struct lwp *l, const struct foo_args *uap, register_t *retval)
Fixup compat code to not write into 'uap' and (in some cases) to actually
pass a correctly formatted 'uap' structure with the right name to the
next routine.
A few 'compat' routines that just call standard ones have been deleted.
All the 'compat' code compiles (along with the kernels required to test
build it).
98% done by automated scripts.

branches: 1.42.4; 1.42.8;
machine/{bus,cpu,intr}.h -> sys/{bus,cpu,intr}.h

branches: 1.41.6; 1.41.8; 1.41.12;
Merge some of the less invasive changes from the vmlocking branch:

- kthread, callout, devsw API changes
- select()/poll() improvements
- miscellaneous MT safety improvements

branches: 1.40.2; 1.40.4;
use char* for the kernel representation of the user profile buffer
address too, for consistency
(we've lost some abstraction here)

Kill caddr_t; there will be some MI fallout, but it will be fixed shortly.

branches: 1.38.2;
Merge newlock2 to head.

add missing initializer.

branches: 1.36.2;
remove some __unused from function parameters.

- sprinkle __unused on function decls.
- fix a couple of unused bugs
- no more -Wno-unused for i386

lowercase roundup/down

branches: 1.33.20; 1.33.22;
merge ktrace-lwp.

branches: 1.32.2;
Use ANSI function decls.

Lots of sysctl descriptions (if someone wants to help out here, that
would be good) mostly copied from sysctl(3). This takes care of the
top-level, most of kern.* and hw.* (modulo the ath and bge stuff), and
all of proc.*.

If you don't want the added rodata in your kernel, use "options
SYSCTL_NO_DESCR" in your kernel config.

branches: 1.30.2;
Tango on sysctl_createv() and flags. The flags have all been renamed,
and sysctl_createv() now uses more arguments.

Dynamic sysctl.

Gone are the old kern_sysctl(), cpu_sysctl(), hw_sysctl(),
vfs_sysctl(), etc, routines, along with sysctl_int() et al. Now all
nodes are registered with the tree, and nodes can be added (or
removed) easily, and I/O to and from the tree is handled generically.

Since the nodes are registered with the tree, the mapping from name to
number (and back again) can now be discovered, instead of having to be
hard coded. Adding new nodes to the tree is likewise much simpler --
the new infrastructure handles almost all the work for simple types,
and just about anything else can be done with a small helper function.

All existing nodes are where they were before (numerically speaking),
so all existing consumers of sysctl information should notice no
difference.

PS - I'm sorry, but there's a distinct lack of documentation at the
moment. I'm working on sysctl(3/8/9) right now, and I promise to
watch out for buses.

Move UCB-licensed code from 4-clause to 3-clause licence.

Patches provided by Joel Baker in PR 22364, verified by myself.

branches: 1.27.2;
Add extensible malloc types, adapted from FreeBSD. This turns
malloc types into a structure, a pointer to which is passed around,
instead of an int constant. Allow the limit to be adjusted when the
malloc type is defined, or with a function call, as suggested by
Jonathan Stone.

Merge the nathanw_sa branch.

add RCSIDs

Don't need to include <uvm/uvm_extern.h> just to include <sys/sysctl.h>
anymore.

branches: 1.23.2; 1.23.6;
Before allowing kgmon to do anything, check that we managed to allocate the
profiling buffer at startup. If not, pretend the kernel doesn't have
profiling support at all.

branches: 1.22.2;
Introduce PROC_PC(), which is used to get a process's user PC. If this is
defined, call addupc_intr() directly from statclock() in the system time case,
using the same P_OWEUPC path if the copyin/copyout fails.
Use this in i386 to remove profiling code from the normal userret() path.

remove include of <vm/vm.h>

Get rid of register declarations.

branches: 1.19.12;
Abolition of bcopy, ovbcopy, bcmp, and bzero, phase one.
bcopy(x, y, z) -> memcpy(y, x, z)
ovbcopy(x, y, z) -> memmove(y, x, z)
bcmp(x, y, z) -> memcmp(x, y, z)
bzero(x, y) -> memset(x, 0, y)

fix sizeofs so they comply with the KNF style guide. yes, it is pedantic.

branches: 1.17.2;
Merge with Lite2 + local changes

Add #include <sys/sysctl.h>, which in turn needs #include <vm/vm.h>.

As discussed, replace KERNBASE with kernel_text.

backout previous kprintf change

printf -> kprintf, sprintf -> ksprintf

remove include of <sys/cpu.h>

Remove extraneous argument from sysctl_doprof().
Fix a printf format.

More proto fixes

First pass at prototyping

change definition of profil() to make it 64-bit friendly. This has
no practical consequence on 32-bit systems. old prototype was
int profil(char *, int, int, int), and new one is int profile(char *,
size_t, u_long, u_int). the size_t is the size of the buffer,
and the u_long is the 'starting offset'. (I changed the last int
to u_int, because it's treated as a u_int everywhere, and isn't
logically a signed value.)

Prefix names of system call implementation functions with `sys_'.

Make system calls conform to a standard prototype and bring those
prototypes into scope.

Use %p.

update for new syscall args description mechanism

New RCS ID's, take two. they're more aesthecially pleasant, and use 'NetBSD'

sysctl kernel prof info

branches: 1.1.1;
lots of changes: prototype migration, move lots of variables, definitions,
and structure elements around. kill some unnecessary type and macro
definitions. standardize clock handling. More changes than you'd want.