Arrange to update cached LWP credentials in userret() rather than during
syscall/trap entry, eliminating a test+branch on every syscall/trap.

This wasn't possible in the 3.99.x timeframe when l->l_cred came about
because there wasn't a reliable/timely way to force an ONPROC LWP running on
a remote CPU into the kernel (which is just about the only new thing in
this scheme).

For kernel mode address error, do not overwrite tf->tf_spc and tf->tf_r0
*before* checking pcb->pbc_onfault != NULL.

Should fix part of

PR port-sh3/56382
PR port-sh3/56401

i.e., DDB will no longer wrongly indicate NULL as fault PC for kernel mode
address error (and 0xe == EFAULT as r0).

Yes, we have another bugs that cause panics described in the two PRs, but
now we can examine them more easily :).

One more tweak.

tlb_exception: in slow path, check for usermode before calling userret().

sh3: make ASTs work as expected, and fix a few things in the TLB refill path.
With help from uwe@ and martin@.

Revert previous. Looks like it requires a more extensive fix.

PR port-sparc/54718 (sparc install hangs since recent scheduler changes)

- userret() must be called every time we return to user, it's not optional.
- If clearing the AST with interrupts off, you must loop over userret().

mi_userret(): take care of calling preempt(), set spc_curpriority directly,
and remove MD code that does the same.

Overhaul the API used to fetch and store individual memory cells in
userspace. The old fetch(9) and store(9) APIs (fubyte(), fuword(),
subyte(), suword(), etc.) are retired and replaced with new ufetch(9)
and ustore(9) APIs that can return proper error codes, etc. and are
implemented consistently across all platforms. The interrupt-safe
variants are no longer supported (and several of the existing attempts
at fuswintr(), etc. were buggy and not actually interrupt-safe).

Also augmement the ucas(9) API, making it consistently available on
all plaforms, supporting uniprocessor and multiprocessor systems, even
those that do not have CAS or LL/SC primitives.

Welcome to NetBSD 8.99.37.

branches: 1.66.4;
tlb_exception - set ksi_addr to va also when a userland page is not found.
Helps SIGSEGV handlers for PROT_NONE red zones.

Use vmspace::vm_minsaddr instead of hardcoding USRSTACK.
Requested by joerg@.

branches: 1.64.10;
Handle EINVAL in the fault path and send SIGBUS on mmap'd access past EOF.

From martin@

branches: 1.63.2; 1.63.16;
The MDP_USEDFPU (amd64 and sh3) and MDP_SSTEP (sh3) are lwp flags not
process ones, rename to MDL_xxx.

Remove COMPAT_SA / KERN_SA. Welcome to 6.99.3!
Approved by core@.

branches: 1.61.4; 1.61.8;
Implement PT_STEP.

general_exception: when printing current mode in the panic message,
test "usermode" directly instead of testing for EXP_USER bit.

branches: 1.59.2; 1.59.4;
Retire struct user, remove sys/user.h inclusions. Note sys/user.h header
as obsolete. Remove USER_TO_UAREA/UAREA_TO_USER macros.

Various #include fixes and review by matt@.

one more line for lwp_getpcb() conversion.

use lwp_getpcb() to hide the detail about how struct pcb is populated.

Move counting of faults, traps, intrs, soft[intr]s, syscalls, and nswtch
from uvmexp to per-cpu cpu_data and move them to 64bits. Remove unneeded
includes of <uvm/uvm_extern.h> and/or <uvm/uvm.h>.

fix copy{in,out}{,str}() to return the error returned by uvm_fault().
fixes PR 41813.

branches: 1.54.2; 1.54.4;
Use lwp_getpcb() on mips, powerpc and sh3, clean from struct user usage.

Fix remaining archs (arm, luna68k, powerpc and sh3) that were still
using a proc argument instead of an expected lwp for ADDUPROF macro.

ok by christos.

branches: 1.52.2;
upcallret() will work much better if it's not in the middle of another
routine!

Merge wrstuden-revivesa into HEAD.

branches: 1.50.4;
Pass trap code to kgdb_trap().

Move EXPEVT_BREAK case next to EXPEVT_TRAPA case, they both generate
SIGTRAP and it's easier to read when they are together.

Remove unneeded playing about with kernel_lock.

Add semicolon that was lost some 5 years ago.
Reported missing by proper do-while macro hygiene in systm.h.

branches: 1.46.6; 1.46.8; 1.46.10; 1.46.12;
Use __arraycount.

Revert previous, it's too noisy and misleading (e.g. single stepping
in ddb is not "fatal"). Need to redo it, but not now.

In general_exception() in do_panic case print error message *before*
we drop into ddb.

branches: 1.43.2; 1.43.8;
Merge the ppcoea-renovation branch to HEAD.

This branch was a major cleanup and rototill of many of the various OEA
cpu based PPC ports that focused on sharing as much code as possible
between the various ports to eliminate near-identical copies of files in
every tree. Additionally there is a new PIC system that unifies the
interface to interrupt code for all different OEA ppc arches. The work
for this branch was done by a variety of people, too long to list here.

TODO:
bebox still needs work to complete the transition to -renovation.
ofppc still needs a bunch of work, which I will be looking at.
ev64260 still needs to be renovated
amigappc was not attempted.

NOTES:
pmppc was removed as an arch, and moved to a evbppc target.

Make want_resched a member of cpu_info.

Do RAS check in sh_vector_interrupt, don't abuse ast() for that.

branches: 1.40.2; 1.40.4;
Move child_return() and startlwp() to be in the same file with
cpu_lwp_fork() that is used to call them.

Changes to make ktrace LKM friendly and reduce ifdef KTRACE. Proposed
on tech-kern.

branches: 1.38.4; 1.38.8;
merge yamt-idlelwp branch. asked by core@. some ports still needs work.

from doc/BRANCHES:

idle lwp, and some changes depending on it.

1. separate context switching and thread scheduling.
(cf. gmcgarry_ctxsw)
2. implement idle lwp.
3. clean up related MD/MI interfaces.
4. make scheduler(s) modular.

branches: 1.37.4;
Re-enable interrupts in tlb_exception too.

Convert _lock_cas to RAS. Check for restart in ast() on return from interrupt.

branches: 1.35.4; 1.35.6;
Replace the Mach-derived boolean_t type with the C99 bool type. A
future commit will replace use of TRUE and FALSE with true and false.

branches: 1.34.2;
Merge newlock2 to head.

branches: 1.33.2; 1.33.4;
general_exception() is called with all interrupts masked in SR
(effectively we were running syscalls with interrupts disabled).
splx back to previous interrupt level from tf->tf_ssr.

XXX: tlb_exception() still has that problem.

branches: 1.32.2; 1.32.4;
general_exception: g/c infinite loop after the call to panic.

tlb_exception: Move and indent TLB_ASSERT to reduce visual clutter.
Fix function name in the panic message. Print expevt on panic.
Split panic message so that the dumped numbers are on a separate line.

exp_type[] was constified in exception.c but an extern declaration in
db_interface.c was not updated. Declare it publicly. While here,
constify the array itself too.

Report traps from user break controller as ksi_code = TRAP_TRACE

Minor cosmetics.

- Hold a reference to the process credentials in each struct lwp.
- Update the reference on syscall and user trap if p_cred has changed.
- Collect accounting flags in the LWP, and collate on LWP exit.

Transform to new signature for uvm_fault() by dropping the third arg.
Discussed with drochner.

branches: 1.25.2;
Syscall debug tracing is handled by trace_enter() / trace_exit(). Change
trace_is_enabled() to return TRUE if SYSCALL_DEBUG is defined, and g/c
all of the SYSCALL_DEBUG handling from individual system call dispatch
routines.

Clean up fallout proc_is_traced_p() change:
- proc_is_traced_p() -> trace_is_enabled(), to match trace_enter() and
trace_exit().
- trace_is_enabled() becomes a real function.
- Remove unnecessary include files from various files that used to care
about KTRACE and SYSTRACE, but do no more.

branches: 1.23.4; 1.23.6; 1.23.8;
merge ktrace-lwp.

Implement syscall_intern for sh3.

branches: 1.21.2;
PR/29607: Christian Biere systrace doesn't handle interrupted syscalls properly
Instead of jumping to the default "bad" case, jump to the error handling
switch, so that we can deal with ERESTART/EJUSTRETURN properly.

Constify as -Wcast-qual seyeth.

Move
(c) TNF
line from 4-clause UCB to 3-clause UCB license; in other words,
remove UCB's ad clause from the license TNF grants.
There is no point in TNF demanding that UCB's ad clause be followed
when even UCB doesn't demand it any longer.

Ok'd by board@ and agc@.

add kernel part of concurrency support for SA on MP systems
- move per VP data into struct sadata_vp referenced from l->l_savp
* VP id
* lock on VP data
* LWP on VP
* recently blocked LWP on VP
* queue of LWPs woken which ran on this VP before sleep
* faultaddr
* LWP cache for upcalls
* upcall queue
- add current concurrency and requested concurrency variables
- make process exit run LWP on all VPs
- make signal delivery consider all VPs
- make timer events consider all VPs
- add sa_newsavp to allocate new sadata_vp structure
- add sa_increaseconcurrency to prepare new VP
- make sys_sa_setconcurrency request new VP or wakeup idle VP
- make sa_yield lower current concurrency
- set sa_cpu = VP id in upcalls
- maintain cached LWPs per VP

general_exception() now receives TEA as a third argument. For user
mode EXPEVT_ADDR_ERR_{LD,ST} traps pass it as ksi_addr, also use it to
decide if this is a SIGBUS (unaliged access) or SIGSEGV (kernel VA
access).

Report EXPEVT_TLB_PROT_LD as SEGV_ACCERR, not SEGV_MAPERR.

While here, consistently use standard uint32_t instead of u_int32_t.

Implement siginfo for sh3.

Don't pass the (unused) return value args to the
trace_enter()/systrace_enter() functions.

When signaling SIGTRAP for debugger break adjust pc to point back to
the TRAPA instruction. This makes gdb much happier.

tlb_exception: pacify -Wuninitialized by adding default case.

Don't compare an integer to NULL.

add MD part of SA/pthread pagefault handling on sh3

Move UCB-licensed code from 4-clause to 3-clause licence.

Patches provided by Joel Baker in PR 22364, verified by myself.

__KERNEL_RCSID()

branches: 1.8.2;
Back out the lwp/ktrace changes. They contained a lot of colateral damage,
and need to be examined and discussed more.

Pass lwp pointers throughtout the kernel, as required, so that the lwpid can
be inserted into ktrace records. The general change has been to replace
"struct proc *" with "struct lwp *" in various function prototypes, pass
the lwp through and use l_proc to get the process pointer when needed.

Bump the kernel rev up to 1.6V

In tlb_exception(), don't panic immediately on access at va == 0
from kernel mode if fault hander is set.

Merge the nathanw_sa branch.

Pass the system call table to trace_enter() and ktrsys() so that it is
possible to use alternate system call tables. This is usefull for
displaying correctly the arguments in Mach binaries traces.

If NULL is given, then the regular systam call table for the process is used.

Add a realcode argument to trace_enter and ktrsyscall. realcode is the
original system call number, which can be negative for a Mach trap.
We cannot just replace code by realcode, because ktrsyscall uses it as
an index in the system call table, thus crashing the kernel when the
value is negative.

branches: 1.2.2; 1.2.4; 1.2.6;
MD systrace gluons.

branches: 1.1.2;
rework general exception, and TLB exception handling for new pmap.
all exception staffs are moved to exception.[ch]

For kernel mode address error, do not overwrite tf->tf_spc and tf->tf_r0
*before* checking pcb->pbc_onfault != NULL.

Should fix part of

PR port-sh3/56382
PR port-sh3/56401

i.e., DDB will no longer wrongly indicate NULL as fault PC for kernel mode
address error (and 0xe == EFAULT as r0).

Yes, we have another bugs that cause panics described in the two PRs, but
now we can examine them more easily :).

One more tweak.

tlb_exception: in slow path, check for usermode before calling userret().

sh3: make ASTs work as expected, and fix a few things in the TLB refill path.
With help from uwe@ and martin@.

Revert previous. Looks like it requires a more extensive fix.

PR port-sparc/54718 (sparc install hangs since recent scheduler changes)

- userret() must be called every time we return to user, it's not optional.
- If clearing the AST with interrupts off, you must loop over userret().

mi_userret(): take care of calling preempt(), set spc_curpriority directly,
and remove MD code that does the same.

Overhaul the API used to fetch and store individual memory cells in
userspace. The old fetch(9) and store(9) APIs (fubyte(), fuword(),
subyte(), suword(), etc.) are retired and replaced with new ufetch(9)
and ustore(9) APIs that can return proper error codes, etc. and are
implemented consistently across all platforms. The interrupt-safe
variants are no longer supported (and several of the existing attempts
at fuswintr(), etc. were buggy and not actually interrupt-safe).

Also augmement the ucas(9) API, making it consistently available on
all plaforms, supporting uniprocessor and multiprocessor systems, even
those that do not have CAS or LL/SC primitives.

Welcome to NetBSD 8.99.37.

branches: 1.66.4;
tlb_exception - set ksi_addr to va also when a userland page is not found.
Helps SIGSEGV handlers for PROT_NONE red zones.

Use vmspace::vm_minsaddr instead of hardcoding USRSTACK.
Requested by joerg@.

branches: 1.64.10;
Handle EINVAL in the fault path and send SIGBUS on mmap'd access past EOF.

From martin@

branches: 1.63.2; 1.63.16;
The MDP_USEDFPU (amd64 and sh3) and MDP_SSTEP (sh3) are lwp flags not
process ones, rename to MDL_xxx.

Remove COMPAT_SA / KERN_SA. Welcome to 6.99.3!
Approved by core@.

branches: 1.61.4; 1.61.8;
Implement PT_STEP.

general_exception: when printing current mode in the panic message,
test "usermode" directly instead of testing for EXP_USER bit.

branches: 1.59.2; 1.59.4;
Retire struct user, remove sys/user.h inclusions. Note sys/user.h header
as obsolete. Remove USER_TO_UAREA/UAREA_TO_USER macros.

Various #include fixes and review by matt@.

one more line for lwp_getpcb() conversion.

use lwp_getpcb() to hide the detail about how struct pcb is populated.

Move counting of faults, traps, intrs, soft[intr]s, syscalls, and nswtch
from uvmexp to per-cpu cpu_data and move them to 64bits. Remove unneeded
includes of <uvm/uvm_extern.h> and/or <uvm/uvm.h>.

fix copy{in,out}{,str}() to return the error returned by uvm_fault().
fixes PR 41813.

branches: 1.54.2; 1.54.4;
Use lwp_getpcb() on mips, powerpc and sh3, clean from struct user usage.

Fix remaining archs (arm, luna68k, powerpc and sh3) that were still
using a proc argument instead of an expected lwp for ADDUPROF macro.

ok by christos.

branches: 1.52.2;
upcallret() will work much better if it's not in the middle of another
routine!

Merge wrstuden-revivesa into HEAD.

branches: 1.50.4;
Pass trap code to kgdb_trap().

Move EXPEVT_BREAK case next to EXPEVT_TRAPA case, they both generate
SIGTRAP and it's easier to read when they are together.

Remove unneeded playing about with kernel_lock.

Add semicolon that was lost some 5 years ago.
Reported missing by proper do-while macro hygiene in systm.h.

branches: 1.46.6; 1.46.8; 1.46.10; 1.46.12;
Use __arraycount.

Revert previous, it's too noisy and misleading (e.g. single stepping
in ddb is not "fatal"). Need to redo it, but not now.

In general_exception() in do_panic case print error message *before*
we drop into ddb.

branches: 1.43.2; 1.43.8;
Merge the ppcoea-renovation branch to HEAD.

This branch was a major cleanup and rototill of many of the various OEA
cpu based PPC ports that focused on sharing as much code as possible
between the various ports to eliminate near-identical copies of files in
every tree. Additionally there is a new PIC system that unifies the
interface to interrupt code for all different OEA ppc arches. The work
for this branch was done by a variety of people, too long to list here.

TODO:
bebox still needs work to complete the transition to -renovation.
ofppc still needs a bunch of work, which I will be looking at.
ev64260 still needs to be renovated
amigappc was not attempted.

NOTES:
pmppc was removed as an arch, and moved to a evbppc target.

Make want_resched a member of cpu_info.

Do RAS check in sh_vector_interrupt, don't abuse ast() for that.

branches: 1.40.2; 1.40.4;
Move child_return() and startlwp() to be in the same file with
cpu_lwp_fork() that is used to call them.

Changes to make ktrace LKM friendly and reduce ifdef KTRACE. Proposed
on tech-kern.

branches: 1.38.4; 1.38.8;
merge yamt-idlelwp branch. asked by core@. some ports still needs work.

from doc/BRANCHES:

idle lwp, and some changes depending on it.

1. separate context switching and thread scheduling.
(cf. gmcgarry_ctxsw)
2. implement idle lwp.
3. clean up related MD/MI interfaces.
4. make scheduler(s) modular.

branches: 1.37.4;
Re-enable interrupts in tlb_exception too.

Convert _lock_cas to RAS. Check for restart in ast() on return from interrupt.

branches: 1.35.4; 1.35.6;
Replace the Mach-derived boolean_t type with the C99 bool type. A
future commit will replace use of TRUE and FALSE with true and false.

branches: 1.34.2;
Merge newlock2 to head.

branches: 1.33.2; 1.33.4;
general_exception() is called with all interrupts masked in SR
(effectively we were running syscalls with interrupts disabled).
splx back to previous interrupt level from tf->tf_ssr.

XXX: tlb_exception() still has that problem.

branches: 1.32.2; 1.32.4;
general_exception: g/c infinite loop after the call to panic.

tlb_exception: Move and indent TLB_ASSERT to reduce visual clutter.
Fix function name in the panic message. Print expevt on panic.
Split panic message so that the dumped numbers are on a separate line.

exp_type[] was constified in exception.c but an extern declaration in
db_interface.c was not updated. Declare it publicly. While here,
constify the array itself too.

Report traps from user break controller as ksi_code = TRAP_TRACE

Minor cosmetics.

- Hold a reference to the process credentials in each struct lwp.
- Update the reference on syscall and user trap if p_cred has changed.
- Collect accounting flags in the LWP, and collate on LWP exit.

Transform to new signature for uvm_fault() by dropping the third arg.
Discussed with drochner.

branches: 1.25.2;
Syscall debug tracing is handled by trace_enter() / trace_exit(). Change
trace_is_enabled() to return TRUE if SYSCALL_DEBUG is defined, and g/c
all of the SYSCALL_DEBUG handling from individual system call dispatch
routines.

Clean up fallout proc_is_traced_p() change:
- proc_is_traced_p() -> trace_is_enabled(), to match trace_enter() and
trace_exit().
- trace_is_enabled() becomes a real function.
- Remove unnecessary include files from various files that used to care
about KTRACE and SYSTRACE, but do no more.

branches: 1.23.4; 1.23.6; 1.23.8;
merge ktrace-lwp.

Implement syscall_intern for sh3.

branches: 1.21.2;
PR/29607: Christian Biere systrace doesn't handle interrupted syscalls properly
Instead of jumping to the default "bad" case, jump to the error handling
switch, so that we can deal with ERESTART/EJUSTRETURN properly.

Constify as -Wcast-qual seyeth.

Move
(c) TNF
line from 4-clause UCB to 3-clause UCB license; in other words,
remove UCB's ad clause from the license TNF grants.
There is no point in TNF demanding that UCB's ad clause be followed
when even UCB doesn't demand it any longer.

Ok'd by board@ and agc@.

add kernel part of concurrency support for SA on MP systems
- move per VP data into struct sadata_vp referenced from l->l_savp
* VP id
* lock on VP data
* LWP on VP
* recently blocked LWP on VP
* queue of LWPs woken which ran on this VP before sleep
* faultaddr
* LWP cache for upcalls
* upcall queue
- add current concurrency and requested concurrency variables
- make process exit run LWP on all VPs
- make signal delivery consider all VPs
- make timer events consider all VPs
- add sa_newsavp to allocate new sadata_vp structure
- add sa_increaseconcurrency to prepare new VP
- make sys_sa_setconcurrency request new VP or wakeup idle VP
- make sa_yield lower current concurrency
- set sa_cpu = VP id in upcalls
- maintain cached LWPs per VP

general_exception() now receives TEA as a third argument. For user
mode EXPEVT_ADDR_ERR_{LD,ST} traps pass it as ksi_addr, also use it to
decide if this is a SIGBUS (unaliged access) or SIGSEGV (kernel VA
access).

Report EXPEVT_TLB_PROT_LD as SEGV_ACCERR, not SEGV_MAPERR.

While here, consistently use standard uint32_t instead of u_int32_t.

Implement siginfo for sh3.

Don't pass the (unused) return value args to the
trace_enter()/systrace_enter() functions.

When signaling SIGTRAP for debugger break adjust pc to point back to
the TRAPA instruction. This makes gdb much happier.

tlb_exception: pacify -Wuninitialized by adding default case.

Don't compare an integer to NULL.

add MD part of SA/pthread pagefault handling on sh3

Move UCB-licensed code from 4-clause to 3-clause licence.

Patches provided by Joel Baker in PR 22364, verified by myself.

__KERNEL_RCSID()

branches: 1.8.2;
Back out the lwp/ktrace changes. They contained a lot of colateral damage,
and need to be examined and discussed more.

Pass lwp pointers throughtout the kernel, as required, so that the lwpid can
be inserted into ktrace records. The general change has been to replace
"struct proc *" with "struct lwp *" in various function prototypes, pass
the lwp through and use l_proc to get the process pointer when needed.

Bump the kernel rev up to 1.6V

In tlb_exception(), don't panic immediately on access at va == 0
from kernel mode if fault hander is set.

Merge the nathanw_sa branch.

Pass the system call table to trace_enter() and ktrsys() so that it is
possible to use alternate system call tables. This is usefull for
displaying correctly the arguments in Mach binaries traces.

If NULL is given, then the regular systam call table for the process is used.

Add a realcode argument to trace_enter and ktrsyscall. realcode is the
original system call number, which can be negative for a Mach trap.
We cannot just replace code by realcode, because ktrsyscall uses it as
an index in the system call table, thus crashing the kernel when the
value is negative.

branches: 1.2.2; 1.2.4; 1.2.6;
MD systrace gluons.

branches: 1.1.2;
rework general exception, and TLB exception handling for new pmap.
all exception staffs are moved to exception.[ch]

One more tweak.

tlb_exception: in slow path, check for usermode before calling userret().

sh3: make ASTs work as expected, and fix a few things in the TLB refill path.
With help from uwe@ and martin@.

Revert previous. Looks like it requires a more extensive fix.

PR port-sparc/54718 (sparc install hangs since recent scheduler changes)

- userret() must be called every time we return to user, it's not optional.
- If clearing the AST with interrupts off, you must loop over userret().

mi_userret(): take care of calling preempt(), set spc_curpriority directly,
and remove MD code that does the same.

Overhaul the API used to fetch and store individual memory cells in
userspace. The old fetch(9) and store(9) APIs (fubyte(), fuword(),
subyte(), suword(), etc.) are retired and replaced with new ufetch(9)
and ustore(9) APIs that can return proper error codes, etc. and are
implemented consistently across all platforms. The interrupt-safe
variants are no longer supported (and several of the existing attempts
at fuswintr(), etc. were buggy and not actually interrupt-safe).

Also augmement the ucas(9) API, making it consistently available on
all plaforms, supporting uniprocessor and multiprocessor systems, even
those that do not have CAS or LL/SC primitives.

Welcome to NetBSD 8.99.37.

branches: 1.66.4;
tlb_exception - set ksi_addr to va also when a userland page is not found.
Helps SIGSEGV handlers for PROT_NONE red zones.

Use vmspace::vm_minsaddr instead of hardcoding USRSTACK.
Requested by joerg@.

branches: 1.64.10;
Handle EINVAL in the fault path and send SIGBUS on mmap'd access past EOF.

From martin@

branches: 1.63.2; 1.63.16;
The MDP_USEDFPU (amd64 and sh3) and MDP_SSTEP (sh3) are lwp flags not
process ones, rename to MDL_xxx.

Remove COMPAT_SA / KERN_SA. Welcome to 6.99.3!
Approved by core@.

branches: 1.61.4; 1.61.8;
Implement PT_STEP.

general_exception: when printing current mode in the panic message,
test "usermode" directly instead of testing for EXP_USER bit.

branches: 1.59.2; 1.59.4;
Retire struct user, remove sys/user.h inclusions. Note sys/user.h header
as obsolete. Remove USER_TO_UAREA/UAREA_TO_USER macros.

Various #include fixes and review by matt@.

one more line for lwp_getpcb() conversion.

use lwp_getpcb() to hide the detail about how struct pcb is populated.

Move counting of faults, traps, intrs, soft[intr]s, syscalls, and nswtch
from uvmexp to per-cpu cpu_data and move them to 64bits. Remove unneeded
includes of <uvm/uvm_extern.h> and/or <uvm/uvm.h>.

fix copy{in,out}{,str}() to return the error returned by uvm_fault().
fixes PR 41813.

branches: 1.54.2; 1.54.4;
Use lwp_getpcb() on mips, powerpc and sh3, clean from struct user usage.

Fix remaining archs (arm, luna68k, powerpc and sh3) that were still
using a proc argument instead of an expected lwp for ADDUPROF macro.

ok by christos.

branches: 1.52.2;
upcallret() will work much better if it's not in the middle of another
routine!

Merge wrstuden-revivesa into HEAD.

branches: 1.50.4;
Pass trap code to kgdb_trap().

Move EXPEVT_BREAK case next to EXPEVT_TRAPA case, they both generate
SIGTRAP and it's easier to read when they are together.

Remove unneeded playing about with kernel_lock.

Add semicolon that was lost some 5 years ago.
Reported missing by proper do-while macro hygiene in systm.h.

branches: 1.46.6; 1.46.8; 1.46.10; 1.46.12;
Use __arraycount.

Revert previous, it's too noisy and misleading (e.g. single stepping
in ddb is not "fatal"). Need to redo it, but not now.

In general_exception() in do_panic case print error message *before*
we drop into ddb.

branches: 1.43.2; 1.43.8;
Merge the ppcoea-renovation branch to HEAD.

This branch was a major cleanup and rototill of many of the various OEA
cpu based PPC ports that focused on sharing as much code as possible
between the various ports to eliminate near-identical copies of files in
every tree. Additionally there is a new PIC system that unifies the
interface to interrupt code for all different OEA ppc arches. The work
for this branch was done by a variety of people, too long to list here.

TODO:
bebox still needs work to complete the transition to -renovation.
ofppc still needs a bunch of work, which I will be looking at.
ev64260 still needs to be renovated
amigappc was not attempted.

NOTES:
pmppc was removed as an arch, and moved to a evbppc target.

Make want_resched a member of cpu_info.

Do RAS check in sh_vector_interrupt, don't abuse ast() for that.

branches: 1.40.2; 1.40.4;
Move child_return() and startlwp() to be in the same file with
cpu_lwp_fork() that is used to call them.

Changes to make ktrace LKM friendly and reduce ifdef KTRACE. Proposed
on tech-kern.

branches: 1.38.4; 1.38.8;
merge yamt-idlelwp branch. asked by core@. some ports still needs work.

from doc/BRANCHES:

idle lwp, and some changes depending on it.

1. separate context switching and thread scheduling.
(cf. gmcgarry_ctxsw)
2. implement idle lwp.
3. clean up related MD/MI interfaces.
4. make scheduler(s) modular.

branches: 1.37.4;
Re-enable interrupts in tlb_exception too.

Convert _lock_cas to RAS. Check for restart in ast() on return from interrupt.

branches: 1.35.4; 1.35.6;
Replace the Mach-derived boolean_t type with the C99 bool type. A
future commit will replace use of TRUE and FALSE with true and false.

branches: 1.34.2;
Merge newlock2 to head.

branches: 1.33.2; 1.33.4;
general_exception() is called with all interrupts masked in SR
(effectively we were running syscalls with interrupts disabled).
splx back to previous interrupt level from tf->tf_ssr.

XXX: tlb_exception() still has that problem.

branches: 1.32.2; 1.32.4;
general_exception: g/c infinite loop after the call to panic.

tlb_exception: Move and indent TLB_ASSERT to reduce visual clutter.
Fix function name in the panic message. Print expevt on panic.
Split panic message so that the dumped numbers are on a separate line.

exp_type[] was constified in exception.c but an extern declaration in
db_interface.c was not updated. Declare it publicly. While here,
constify the array itself too.

Report traps from user break controller as ksi_code = TRAP_TRACE

Minor cosmetics.

- Hold a reference to the process credentials in each struct lwp.
- Update the reference on syscall and user trap if p_cred has changed.
- Collect accounting flags in the LWP, and collate on LWP exit.

Transform to new signature for uvm_fault() by dropping the third arg.
Discussed with drochner.

branches: 1.25.2;
Syscall debug tracing is handled by trace_enter() / trace_exit(). Change
trace_is_enabled() to return TRUE if SYSCALL_DEBUG is defined, and g/c
all of the SYSCALL_DEBUG handling from individual system call dispatch
routines.

Clean up fallout proc_is_traced_p() change:
- proc_is_traced_p() -> trace_is_enabled(), to match trace_enter() and
trace_exit().
- trace_is_enabled() becomes a real function.
- Remove unnecessary include files from various files that used to care
about KTRACE and SYSTRACE, but do no more.

branches: 1.23.4; 1.23.6; 1.23.8;
merge ktrace-lwp.

Implement syscall_intern for sh3.

branches: 1.21.2;
PR/29607: Christian Biere systrace doesn't handle interrupted syscalls properly
Instead of jumping to the default "bad" case, jump to the error handling
switch, so that we can deal with ERESTART/EJUSTRETURN properly.

Constify as -Wcast-qual seyeth.

Move
(c) TNF
line from 4-clause UCB to 3-clause UCB license; in other words,
remove UCB's ad clause from the license TNF grants.
There is no point in TNF demanding that UCB's ad clause be followed
when even UCB doesn't demand it any longer.

Ok'd by board@ and agc@.

add kernel part of concurrency support for SA on MP systems
- move per VP data into struct sadata_vp referenced from l->l_savp
* VP id
* lock on VP data
* LWP on VP
* recently blocked LWP on VP
* queue of LWPs woken which ran on this VP before sleep
* faultaddr
* LWP cache for upcalls
* upcall queue
- add current concurrency and requested concurrency variables
- make process exit run LWP on all VPs
- make signal delivery consider all VPs
- make timer events consider all VPs
- add sa_newsavp to allocate new sadata_vp structure
- add sa_increaseconcurrency to prepare new VP
- make sys_sa_setconcurrency request new VP or wakeup idle VP
- make sa_yield lower current concurrency
- set sa_cpu = VP id in upcalls
- maintain cached LWPs per VP

general_exception() now receives TEA as a third argument. For user
mode EXPEVT_ADDR_ERR_{LD,ST} traps pass it as ksi_addr, also use it to
decide if this is a SIGBUS (unaliged access) or SIGSEGV (kernel VA
access).

Report EXPEVT_TLB_PROT_LD as SEGV_ACCERR, not SEGV_MAPERR.

While here, consistently use standard uint32_t instead of u_int32_t.

Implement siginfo for sh3.

Don't pass the (unused) return value args to the
trace_enter()/systrace_enter() functions.

When signaling SIGTRAP for debugger break adjust pc to point back to
the TRAPA instruction. This makes gdb much happier.

tlb_exception: pacify -Wuninitialized by adding default case.

Don't compare an integer to NULL.

add MD part of SA/pthread pagefault handling on sh3

Move UCB-licensed code from 4-clause to 3-clause licence.

Patches provided by Joel Baker in PR 22364, verified by myself.

__KERNEL_RCSID()

branches: 1.8.2;
Back out the lwp/ktrace changes. They contained a lot of colateral damage,
and need to be examined and discussed more.

Pass lwp pointers throughtout the kernel, as required, so that the lwpid can
be inserted into ktrace records. The general change has been to replace
"struct proc *" with "struct lwp *" in various function prototypes, pass
the lwp through and use l_proc to get the process pointer when needed.

Bump the kernel rev up to 1.6V

In tlb_exception(), don't panic immediately on access at va == 0
from kernel mode if fault hander is set.

Merge the nathanw_sa branch.

Pass the system call table to trace_enter() and ktrsys() so that it is
possible to use alternate system call tables. This is usefull for
displaying correctly the arguments in Mach binaries traces.

If NULL is given, then the regular systam call table for the process is used.

Add a realcode argument to trace_enter and ktrsyscall. realcode is the
original system call number, which can be negative for a Mach trap.
We cannot just replace code by realcode, because ktrsyscall uses it as
an index in the system call table, thus crashing the kernel when the
value is negative.

branches: 1.2.2; 1.2.4; 1.2.6;
MD systrace gluons.

branches: 1.1.2;
rework general exception, and TLB exception handling for new pmap.
all exception staffs are moved to exception.[ch]

sh3: make ASTs work as expected, and fix a few things in the TLB refill path.
With help from uwe@ and martin@.

Revert previous. Looks like it requires a more extensive fix.

PR port-sparc/54718 (sparc install hangs since recent scheduler changes)

- userret() must be called every time we return to user, it's not optional.
- If clearing the AST with interrupts off, you must loop over userret().

mi_userret(): take care of calling preempt(), set spc_curpriority directly,
and remove MD code that does the same.

Overhaul the API used to fetch and store individual memory cells in
userspace. The old fetch(9) and store(9) APIs (fubyte(), fuword(),
subyte(), suword(), etc.) are retired and replaced with new ufetch(9)
and ustore(9) APIs that can return proper error codes, etc. and are
implemented consistently across all platforms. The interrupt-safe
variants are no longer supported (and several of the existing attempts
at fuswintr(), etc. were buggy and not actually interrupt-safe).

Also augmement the ucas(9) API, making it consistently available on
all plaforms, supporting uniprocessor and multiprocessor systems, even
those that do not have CAS or LL/SC primitives.

Welcome to NetBSD 8.99.37.

branches: 1.66.4;
tlb_exception - set ksi_addr to va also when a userland page is not found.
Helps SIGSEGV handlers for PROT_NONE red zones.

Use vmspace::vm_minsaddr instead of hardcoding USRSTACK.
Requested by joerg@.

branches: 1.64.10;
Handle EINVAL in the fault path and send SIGBUS on mmap'd access past EOF.

From martin@

branches: 1.63.2; 1.63.16;
The MDP_USEDFPU (amd64 and sh3) and MDP_SSTEP (sh3) are lwp flags not
process ones, rename to MDL_xxx.

Remove COMPAT_SA / KERN_SA. Welcome to 6.99.3!
Approved by core@.

branches: 1.61.4; 1.61.8;
Implement PT_STEP.

general_exception: when printing current mode in the panic message,
test "usermode" directly instead of testing for EXP_USER bit.

branches: 1.59.2; 1.59.4;
Retire struct user, remove sys/user.h inclusions. Note sys/user.h header
as obsolete. Remove USER_TO_UAREA/UAREA_TO_USER macros.

Various #include fixes and review by matt@.

one more line for lwp_getpcb() conversion.

use lwp_getpcb() to hide the detail about how struct pcb is populated.

Move counting of faults, traps, intrs, soft[intr]s, syscalls, and nswtch
from uvmexp to per-cpu cpu_data and move them to 64bits. Remove unneeded
includes of <uvm/uvm_extern.h> and/or <uvm/uvm.h>.

fix copy{in,out}{,str}() to return the error returned by uvm_fault().
fixes PR 41813.

branches: 1.54.2; 1.54.4;
Use lwp_getpcb() on mips, powerpc and sh3, clean from struct user usage.

Fix remaining archs (arm, luna68k, powerpc and sh3) that were still
using a proc argument instead of an expected lwp for ADDUPROF macro.

ok by christos.

branches: 1.52.2;
upcallret() will work much better if it's not in the middle of another
routine!

Merge wrstuden-revivesa into HEAD.

branches: 1.50.4;
Pass trap code to kgdb_trap().

Move EXPEVT_BREAK case next to EXPEVT_TRAPA case, they both generate
SIGTRAP and it's easier to read when they are together.

Remove unneeded playing about with kernel_lock.

Add semicolon that was lost some 5 years ago.
Reported missing by proper do-while macro hygiene in systm.h.

branches: 1.46.6; 1.46.8; 1.46.10; 1.46.12;
Use __arraycount.

Revert previous, it's too noisy and misleading (e.g. single stepping
in ddb is not "fatal"). Need to redo it, but not now.

In general_exception() in do_panic case print error message *before*
we drop into ddb.

branches: 1.43.2; 1.43.8;
Merge the ppcoea-renovation branch to HEAD.

This branch was a major cleanup and rototill of many of the various OEA
cpu based PPC ports that focused on sharing as much code as possible
between the various ports to eliminate near-identical copies of files in
every tree. Additionally there is a new PIC system that unifies the
interface to interrupt code for all different OEA ppc arches. The work
for this branch was done by a variety of people, too long to list here.

TODO:
bebox still needs work to complete the transition to -renovation.
ofppc still needs a bunch of work, which I will be looking at.
ev64260 still needs to be renovated
amigappc was not attempted.

NOTES:
pmppc was removed as an arch, and moved to a evbppc target.

Make want_resched a member of cpu_info.

Do RAS check in sh_vector_interrupt, don't abuse ast() for that.

branches: 1.40.2; 1.40.4;
Move child_return() and startlwp() to be in the same file with
cpu_lwp_fork() that is used to call them.

Changes to make ktrace LKM friendly and reduce ifdef KTRACE. Proposed
on tech-kern.

branches: 1.38.4; 1.38.8;
merge yamt-idlelwp branch. asked by core@. some ports still needs work.

from doc/BRANCHES:

idle lwp, and some changes depending on it.

1. separate context switching and thread scheduling.
(cf. gmcgarry_ctxsw)
2. implement idle lwp.
3. clean up related MD/MI interfaces.
4. make scheduler(s) modular.

branches: 1.37.4;
Re-enable interrupts in tlb_exception too.

Convert _lock_cas to RAS. Check for restart in ast() on return from interrupt.

branches: 1.35.4; 1.35.6;
Replace the Mach-derived boolean_t type with the C99 bool type. A
future commit will replace use of TRUE and FALSE with true and false.

branches: 1.34.2;
Merge newlock2 to head.

branches: 1.33.2; 1.33.4;
general_exception() is called with all interrupts masked in SR
(effectively we were running syscalls with interrupts disabled).
splx back to previous interrupt level from tf->tf_ssr.

XXX: tlb_exception() still has that problem.

branches: 1.32.2; 1.32.4;
general_exception: g/c infinite loop after the call to panic.

tlb_exception: Move and indent TLB_ASSERT to reduce visual clutter.
Fix function name in the panic message. Print expevt on panic.
Split panic message so that the dumped numbers are on a separate line.

exp_type[] was constified in exception.c but an extern declaration in
db_interface.c was not updated. Declare it publicly. While here,
constify the array itself too.

Report traps from user break controller as ksi_code = TRAP_TRACE

Minor cosmetics.

- Hold a reference to the process credentials in each struct lwp.
- Update the reference on syscall and user trap if p_cred has changed.
- Collect accounting flags in the LWP, and collate on LWP exit.

Transform to new signature for uvm_fault() by dropping the third arg.
Discussed with drochner.

branches: 1.25.2;
Syscall debug tracing is handled by trace_enter() / trace_exit(). Change
trace_is_enabled() to return TRUE if SYSCALL_DEBUG is defined, and g/c
all of the SYSCALL_DEBUG handling from individual system call dispatch
routines.

Clean up fallout proc_is_traced_p() change:
- proc_is_traced_p() -> trace_is_enabled(), to match trace_enter() and
trace_exit().
- trace_is_enabled() becomes a real function.
- Remove unnecessary include files from various files that used to care
about KTRACE and SYSTRACE, but do no more.

branches: 1.23.4; 1.23.6; 1.23.8;
merge ktrace-lwp.

Implement syscall_intern for sh3.

branches: 1.21.2;
PR/29607: Christian Biere systrace doesn't handle interrupted syscalls properly
Instead of jumping to the default "bad" case, jump to the error handling
switch, so that we can deal with ERESTART/EJUSTRETURN properly.

Constify as -Wcast-qual seyeth.

Move
(c) TNF
line from 4-clause UCB to 3-clause UCB license; in other words,
remove UCB's ad clause from the license TNF grants.
There is no point in TNF demanding that UCB's ad clause be followed
when even UCB doesn't demand it any longer.

Ok'd by board@ and agc@.

add kernel part of concurrency support for SA on MP systems
- move per VP data into struct sadata_vp referenced from l->l_savp
* VP id
* lock on VP data
* LWP on VP
* recently blocked LWP on VP
* queue of LWPs woken which ran on this VP before sleep
* faultaddr
* LWP cache for upcalls
* upcall queue
- add current concurrency and requested concurrency variables
- make process exit run LWP on all VPs
- make signal delivery consider all VPs
- make timer events consider all VPs
- add sa_newsavp to allocate new sadata_vp structure
- add sa_increaseconcurrency to prepare new VP
- make sys_sa_setconcurrency request new VP or wakeup idle VP
- make sa_yield lower current concurrency
- set sa_cpu = VP id in upcalls
- maintain cached LWPs per VP

general_exception() now receives TEA as a third argument. For user
mode EXPEVT_ADDR_ERR_{LD,ST} traps pass it as ksi_addr, also use it to
decide if this is a SIGBUS (unaliged access) or SIGSEGV (kernel VA
access).

Report EXPEVT_TLB_PROT_LD as SEGV_ACCERR, not SEGV_MAPERR.

While here, consistently use standard uint32_t instead of u_int32_t.

Implement siginfo for sh3.

Don't pass the (unused) return value args to the
trace_enter()/systrace_enter() functions.

When signaling SIGTRAP for debugger break adjust pc to point back to
the TRAPA instruction. This makes gdb much happier.

tlb_exception: pacify -Wuninitialized by adding default case.

Don't compare an integer to NULL.

add MD part of SA/pthread pagefault handling on sh3

Move UCB-licensed code from 4-clause to 3-clause licence.

Patches provided by Joel Baker in PR 22364, verified by myself.

__KERNEL_RCSID()

branches: 1.8.2;
Back out the lwp/ktrace changes. They contained a lot of colateral damage,
and need to be examined and discussed more.

Pass lwp pointers throughtout the kernel, as required, so that the lwpid can
be inserted into ktrace records. The general change has been to replace
"struct proc *" with "struct lwp *" in various function prototypes, pass
the lwp through and use l_proc to get the process pointer when needed.

Bump the kernel rev up to 1.6V

In tlb_exception(), don't panic immediately on access at va == 0
from kernel mode if fault hander is set.

Merge the nathanw_sa branch.

Pass the system call table to trace_enter() and ktrsys() so that it is
possible to use alternate system call tables. This is usefull for
displaying correctly the arguments in Mach binaries traces.

If NULL is given, then the regular systam call table for the process is used.

Add a realcode argument to trace_enter and ktrsyscall. realcode is the
original system call number, which can be negative for a Mach trap.
We cannot just replace code by realcode, because ktrsyscall uses it as
an index in the system call table, thus crashing the kernel when the
value is negative.

branches: 1.2.2; 1.2.4; 1.2.6;
MD systrace gluons.

branches: 1.1.2;
rework general exception, and TLB exception handling for new pmap.
all exception staffs are moved to exception.[ch]

PR port-sparc/54718 (sparc install hangs since recent scheduler changes)

- userret() must be called every time we return to user, it's not optional.
- If clearing the AST with interrupts off, you must loop over userret().

mi_userret(): take care of calling preempt(), set spc_curpriority directly,
and remove MD code that does the same.

Overhaul the API used to fetch and store individual memory cells in
userspace. The old fetch(9) and store(9) APIs (fubyte(), fuword(),
subyte(), suword(), etc.) are retired and replaced with new ufetch(9)
and ustore(9) APIs that can return proper error codes, etc. and are
implemented consistently across all platforms. The interrupt-safe
variants are no longer supported (and several of the existing attempts
at fuswintr(), etc. were buggy and not actually interrupt-safe).

Also augmement the ucas(9) API, making it consistently available on
all plaforms, supporting uniprocessor and multiprocessor systems, even
those that do not have CAS or LL/SC primitives.

Welcome to NetBSD 8.99.37.

branches: 1.66.4;
tlb_exception - set ksi_addr to va also when a userland page is not found.
Helps SIGSEGV handlers for PROT_NONE red zones.

Use vmspace::vm_minsaddr instead of hardcoding USRSTACK.
Requested by joerg@.

branches: 1.64.10;
Handle EINVAL in the fault path and send SIGBUS on mmap'd access past EOF.

From martin@

branches: 1.63.2; 1.63.16;
The MDP_USEDFPU (amd64 and sh3) and MDP_SSTEP (sh3) are lwp flags not
process ones, rename to MDL_xxx.

Remove COMPAT_SA / KERN_SA. Welcome to 6.99.3!
Approved by core@.

branches: 1.61.4; 1.61.8;
Implement PT_STEP.

general_exception: when printing current mode in the panic message,
test "usermode" directly instead of testing for EXP_USER bit.

branches: 1.59.2; 1.59.4;
Retire struct user, remove sys/user.h inclusions. Note sys/user.h header
as obsolete. Remove USER_TO_UAREA/UAREA_TO_USER macros.

Various #include fixes and review by matt@.

one more line for lwp_getpcb() conversion.

use lwp_getpcb() to hide the detail about how struct pcb is populated.

Move counting of faults, traps, intrs, soft[intr]s, syscalls, and nswtch
from uvmexp to per-cpu cpu_data and move them to 64bits. Remove unneeded
includes of <uvm/uvm_extern.h> and/or <uvm/uvm.h>.

fix copy{in,out}{,str}() to return the error returned by uvm_fault().
fixes PR 41813.

branches: 1.54.2; 1.54.4;
Use lwp_getpcb() on mips, powerpc and sh3, clean from struct user usage.

Fix remaining archs (arm, luna68k, powerpc and sh3) that were still
using a proc argument instead of an expected lwp for ADDUPROF macro.

ok by christos.

branches: 1.52.2;
upcallret() will work much better if it's not in the middle of another
routine!

Merge wrstuden-revivesa into HEAD.

branches: 1.50.4;
Pass trap code to kgdb_trap().

Move EXPEVT_BREAK case next to EXPEVT_TRAPA case, they both generate
SIGTRAP and it's easier to read when they are together.

Remove unneeded playing about with kernel_lock.

Add semicolon that was lost some 5 years ago.
Reported missing by proper do-while macro hygiene in systm.h.

branches: 1.46.6; 1.46.8; 1.46.10; 1.46.12;
Use __arraycount.

Revert previous, it's too noisy and misleading (e.g. single stepping
in ddb is not "fatal"). Need to redo it, but not now.

In general_exception() in do_panic case print error message *before*
we drop into ddb.

branches: 1.43.2; 1.43.8;
Merge the ppcoea-renovation branch to HEAD.

This branch was a major cleanup and rototill of many of the various OEA
cpu based PPC ports that focused on sharing as much code as possible
between the various ports to eliminate near-identical copies of files in
every tree. Additionally there is a new PIC system that unifies the
interface to interrupt code for all different OEA ppc arches. The work
for this branch was done by a variety of people, too long to list here.

TODO:
bebox still needs work to complete the transition to -renovation.
ofppc still needs a bunch of work, which I will be looking at.
ev64260 still needs to be renovated
amigappc was not attempted.

NOTES:
pmppc was removed as an arch, and moved to a evbppc target.

Make want_resched a member of cpu_info.

Do RAS check in sh_vector_interrupt, don't abuse ast() for that.

branches: 1.40.2; 1.40.4;
Move child_return() and startlwp() to be in the same file with
cpu_lwp_fork() that is used to call them.

Changes to make ktrace LKM friendly and reduce ifdef KTRACE. Proposed
on tech-kern.

branches: 1.38.4; 1.38.8;
merge yamt-idlelwp branch. asked by core@. some ports still needs work.

from doc/BRANCHES:

idle lwp, and some changes depending on it.

1. separate context switching and thread scheduling.
(cf. gmcgarry_ctxsw)
2. implement idle lwp.
3. clean up related MD/MI interfaces.
4. make scheduler(s) modular.

branches: 1.37.4;
Re-enable interrupts in tlb_exception too.

Convert _lock_cas to RAS. Check for restart in ast() on return from interrupt.

branches: 1.35.4; 1.35.6;
Replace the Mach-derived boolean_t type with the C99 bool type. A
future commit will replace use of TRUE and FALSE with true and false.

branches: 1.34.2;
Merge newlock2 to head.

branches: 1.33.2; 1.33.4;
general_exception() is called with all interrupts masked in SR
(effectively we were running syscalls with interrupts disabled).
splx back to previous interrupt level from tf->tf_ssr.

XXX: tlb_exception() still has that problem.

branches: 1.32.2; 1.32.4;
general_exception: g/c infinite loop after the call to panic.

tlb_exception: Move and indent TLB_ASSERT to reduce visual clutter.
Fix function name in the panic message. Print expevt on panic.
Split panic message so that the dumped numbers are on a separate line.

exp_type[] was constified in exception.c but an extern declaration in
db_interface.c was not updated. Declare it publicly. While here,
constify the array itself too.

Report traps from user break controller as ksi_code = TRAP_TRACE

Minor cosmetics.

- Hold a reference to the process credentials in each struct lwp.
- Update the reference on syscall and user trap if p_cred has changed.
- Collect accounting flags in the LWP, and collate on LWP exit.

Transform to new signature for uvm_fault() by dropping the third arg.
Discussed with drochner.

branches: 1.25.2;
Syscall debug tracing is handled by trace_enter() / trace_exit(). Change
trace_is_enabled() to return TRUE if SYSCALL_DEBUG is defined, and g/c
all of the SYSCALL_DEBUG handling from individual system call dispatch
routines.

Clean up fallout proc_is_traced_p() change:
- proc_is_traced_p() -> trace_is_enabled(), to match trace_enter() and
trace_exit().
- trace_is_enabled() becomes a real function.
- Remove unnecessary include files from various files that used to care
about KTRACE and SYSTRACE, but do no more.

branches: 1.23.4; 1.23.6; 1.23.8;
merge ktrace-lwp.

Implement syscall_intern for sh3.

branches: 1.21.2;
PR/29607: Christian Biere systrace doesn't handle interrupted syscalls properly
Instead of jumping to the default "bad" case, jump to the error handling
switch, so that we can deal with ERESTART/EJUSTRETURN properly.

Constify as -Wcast-qual seyeth.

Move
(c) TNF
line from 4-clause UCB to 3-clause UCB license; in other words,
remove UCB's ad clause from the license TNF grants.
There is no point in TNF demanding that UCB's ad clause be followed
when even UCB doesn't demand it any longer.

Ok'd by board@ and agc@.

add kernel part of concurrency support for SA on MP systems
- move per VP data into struct sadata_vp referenced from l->l_savp
* VP id
* lock on VP data
* LWP on VP
* recently blocked LWP on VP
* queue of LWPs woken which ran on this VP before sleep
* faultaddr
* LWP cache for upcalls
* upcall queue
- add current concurrency and requested concurrency variables
- make process exit run LWP on all VPs
- make signal delivery consider all VPs
- make timer events consider all VPs
- add sa_newsavp to allocate new sadata_vp structure
- add sa_increaseconcurrency to prepare new VP
- make sys_sa_setconcurrency request new VP or wakeup idle VP
- make sa_yield lower current concurrency
- set sa_cpu = VP id in upcalls
- maintain cached LWPs per VP

general_exception() now receives TEA as a third argument. For user
mode EXPEVT_ADDR_ERR_{LD,ST} traps pass it as ksi_addr, also use it to
decide if this is a SIGBUS (unaliged access) or SIGSEGV (kernel VA
access).

Report EXPEVT_TLB_PROT_LD as SEGV_ACCERR, not SEGV_MAPERR.

While here, consistently use standard uint32_t instead of u_int32_t.

Implement siginfo for sh3.

Don't pass the (unused) return value args to the
trace_enter()/systrace_enter() functions.

When signaling SIGTRAP for debugger break adjust pc to point back to
the TRAPA instruction. This makes gdb much happier.

tlb_exception: pacify -Wuninitialized by adding default case.

Don't compare an integer to NULL.

add MD part of SA/pthread pagefault handling on sh3

Move UCB-licensed code from 4-clause to 3-clause licence.

Patches provided by Joel Baker in PR 22364, verified by myself.

__KERNEL_RCSID()

branches: 1.8.2;
Back out the lwp/ktrace changes. They contained a lot of colateral damage,
and need to be examined and discussed more.

Pass lwp pointers throughtout the kernel, as required, so that the lwpid can
be inserted into ktrace records. The general change has been to replace
"struct proc *" with "struct lwp *" in various function prototypes, pass
the lwp through and use l_proc to get the process pointer when needed.

Bump the kernel rev up to 1.6V

In tlb_exception(), don't panic immediately on access at va == 0
from kernel mode if fault hander is set.

Merge the nathanw_sa branch.

Pass the system call table to trace_enter() and ktrsys() so that it is
possible to use alternate system call tables. This is usefull for
displaying correctly the arguments in Mach binaries traces.

If NULL is given, then the regular systam call table for the process is used.

Add a realcode argument to trace_enter and ktrsyscall. realcode is the
original system call number, which can be negative for a Mach trap.
We cannot just replace code by realcode, because ktrsyscall uses it as
an index in the system call table, thus crashing the kernel when the
value is negative.

branches: 1.2.2; 1.2.4; 1.2.6;
MD systrace gluons.

branches: 1.1.2;
rework general exception, and TLB exception handling for new pmap.
all exception staffs are moved to exception.[ch]

mi_userret(): take care of calling preempt(), set spc_curpriority directly,
and remove MD code that does the same.

Overhaul the API used to fetch and store individual memory cells in
userspace. The old fetch(9) and store(9) APIs (fubyte(), fuword(),
subyte(), suword(), etc.) are retired and replaced with new ufetch(9)
and ustore(9) APIs that can return proper error codes, etc. and are
implemented consistently across all platforms. The interrupt-safe
variants are no longer supported (and several of the existing attempts
at fuswintr(), etc. were buggy and not actually interrupt-safe).

Also augmement the ucas(9) API, making it consistently available on
all plaforms, supporting uniprocessor and multiprocessor systems, even
those that do not have CAS or LL/SC primitives.

Welcome to NetBSD 8.99.37.

branches: 1.66.4;
tlb_exception - set ksi_addr to va also when a userland page is not found.
Helps SIGSEGV handlers for PROT_NONE red zones.

Use vmspace::vm_minsaddr instead of hardcoding USRSTACK.
Requested by joerg@.

branches: 1.64.10;
Handle EINVAL in the fault path and send SIGBUS on mmap'd access past EOF.

From martin@

branches: 1.63.2; 1.63.16;
The MDP_USEDFPU (amd64 and sh3) and MDP_SSTEP (sh3) are lwp flags not
process ones, rename to MDL_xxx.

Remove COMPAT_SA / KERN_SA. Welcome to 6.99.3!
Approved by core@.

branches: 1.61.4; 1.61.8;
Implement PT_STEP.

general_exception: when printing current mode in the panic message,
test "usermode" directly instead of testing for EXP_USER bit.

branches: 1.59.2; 1.59.4;
Retire struct user, remove sys/user.h inclusions. Note sys/user.h header
as obsolete. Remove USER_TO_UAREA/UAREA_TO_USER macros.

Various #include fixes and review by matt@.

one more line for lwp_getpcb() conversion.

use lwp_getpcb() to hide the detail about how struct pcb is populated.

Move counting of faults, traps, intrs, soft[intr]s, syscalls, and nswtch
from uvmexp to per-cpu cpu_data and move them to 64bits. Remove unneeded
includes of <uvm/uvm_extern.h> and/or <uvm/uvm.h>.

fix copy{in,out}{,str}() to return the error returned by uvm_fault().
fixes PR 41813.

branches: 1.54.2; 1.54.4;
Use lwp_getpcb() on mips, powerpc and sh3, clean from struct user usage.

Fix remaining archs (arm, luna68k, powerpc and sh3) that were still
using a proc argument instead of an expected lwp for ADDUPROF macro.

ok by christos.

branches: 1.52.2;
upcallret() will work much better if it's not in the middle of another
routine!

Merge wrstuden-revivesa into HEAD.

branches: 1.50.4;
Pass trap code to kgdb_trap().

Move EXPEVT_BREAK case next to EXPEVT_TRAPA case, they both generate
SIGTRAP and it's easier to read when they are together.

Remove unneeded playing about with kernel_lock.

Add semicolon that was lost some 5 years ago.
Reported missing by proper do-while macro hygiene in systm.h.

branches: 1.46.6; 1.46.8; 1.46.10; 1.46.12;
Use __arraycount.

Revert previous, it's too noisy and misleading (e.g. single stepping
in ddb is not "fatal"). Need to redo it, but not now.

In general_exception() in do_panic case print error message *before*
we drop into ddb.

branches: 1.43.2; 1.43.8;
Merge the ppcoea-renovation branch to HEAD.

This branch was a major cleanup and rototill of many of the various OEA
cpu based PPC ports that focused on sharing as much code as possible
between the various ports to eliminate near-identical copies of files in
every tree. Additionally there is a new PIC system that unifies the
interface to interrupt code for all different OEA ppc arches. The work
for this branch was done by a variety of people, too long to list here.

TODO:
bebox still needs work to complete the transition to -renovation.
ofppc still needs a bunch of work, which I will be looking at.
ev64260 still needs to be renovated
amigappc was not attempted.

NOTES:
pmppc was removed as an arch, and moved to a evbppc target.

Make want_resched a member of cpu_info.

Do RAS check in sh_vector_interrupt, don't abuse ast() for that.

branches: 1.40.2; 1.40.4;
Move child_return() and startlwp() to be in the same file with
cpu_lwp_fork() that is used to call them.

Changes to make ktrace LKM friendly and reduce ifdef KTRACE. Proposed
on tech-kern.

branches: 1.38.4; 1.38.8;
merge yamt-idlelwp branch. asked by core@. some ports still needs work.

from doc/BRANCHES:

idle lwp, and some changes depending on it.

1. separate context switching and thread scheduling.
(cf. gmcgarry_ctxsw)
2. implement idle lwp.
3. clean up related MD/MI interfaces.
4. make scheduler(s) modular.

branches: 1.37.4;
Re-enable interrupts in tlb_exception too.

Convert _lock_cas to RAS. Check for restart in ast() on return from interrupt.

branches: 1.35.4; 1.35.6;
Replace the Mach-derived boolean_t type with the C99 bool type. A
future commit will replace use of TRUE and FALSE with true and false.

branches: 1.34.2;
Merge newlock2 to head.

branches: 1.33.2; 1.33.4;
general_exception() is called with all interrupts masked in SR
(effectively we were running syscalls with interrupts disabled).
splx back to previous interrupt level from tf->tf_ssr.

XXX: tlb_exception() still has that problem.

branches: 1.32.2; 1.32.4;
general_exception: g/c infinite loop after the call to panic.

tlb_exception: Move and indent TLB_ASSERT to reduce visual clutter.
Fix function name in the panic message. Print expevt on panic.
Split panic message so that the dumped numbers are on a separate line.

exp_type[] was constified in exception.c but an extern declaration in
db_interface.c was not updated. Declare it publicly. While here,
constify the array itself too.

Report traps from user break controller as ksi_code = TRAP_TRACE

Minor cosmetics.

- Hold a reference to the process credentials in each struct lwp.
- Update the reference on syscall and user trap if p_cred has changed.
- Collect accounting flags in the LWP, and collate on LWP exit.

Transform to new signature for uvm_fault() by dropping the third arg.
Discussed with drochner.

branches: 1.25.2;
Syscall debug tracing is handled by trace_enter() / trace_exit(). Change
trace_is_enabled() to return TRUE if SYSCALL_DEBUG is defined, and g/c
all of the SYSCALL_DEBUG handling from individual system call dispatch
routines.

Clean up fallout proc_is_traced_p() change:
- proc_is_traced_p() -> trace_is_enabled(), to match trace_enter() and
trace_exit().
- trace_is_enabled() becomes a real function.
- Remove unnecessary include files from various files that used to care
about KTRACE and SYSTRACE, but do no more.