Revert the duplication of compat set lists; do it another way.

1. Restore the compatdir and compatfile tags in base and debug.

=> compatdir marks directories that should have per-ABI compat
subdirectories, like /usr/lib having /usr/lib/o32 and
/usr/lib/64 on mips64.

=> compatfile marks files that have per-ABI versions in the
nearest compatdir, like /usr/lib/o32/libc.so.12.221.

This is the mechanism we use to avoid duplicating every library
that has a compat version in multiple set lists.

2. Teach sets.subr to split the compatdir and compatfile entries out
into separate sets for base and debug.

The mechanism is to internally use:

- a new tag `omitcompat' when processing base and debug, so we
don't generate the per-ABI compat directories or per-ABI compat
files under them;

- a new tag `takecompat=${ABI}' when processing base32/64 and
debug32/64, so we _do_ generate the per-ABI compat directories
for ${ABI}.

=> On, e.g., mips64, base32 uses `takecompat=o32' and base64
uses `takecompat=64'.

=> On, e.g., aarch64, base32 uses
`takecompat=eabi,takecompat=eabihf', and there is no base64.

3. Record in sets.subr the list of `32' and `64' architectures for
each port.

This is maybe not the right place to put it, but it's also not
clear that we want to keep exactly this division -- maybe it would
be more sensible to just have per-ABI , e.g.:

(aarch64) base-eabi, base-eabihf
(amd64) base-i386
(mips64) base-o32, base-64
(mipsn64) base-o32, base-n32

But I'll leave cleaning that up for another day.

4. Adjust some sets. Mostly this commit shouldn't change what file
go in what sets, but, e.g., on mips64, the following move from
base32 to base64 as part of this change, which I think is
appropriate:

- /lib/64
- /libexec/ld.elf_so-64
- /usr/lib/64
- /usr/libdata/debug/lib/64
- /usr/libdata/debug/usr/lib/64
- /usr/libexec/ld.elf_so-64

TBD: Remove ./lib and ./usr/lib from debug/mi; they're already in
base/mi. Maybe move ./usr/libdata/debug to from base/mi to debug/mi.

This reverts most of the set list changes in:

https://mail-index.netbsd.org/source-changes/2024/04/09/msg150763.html

PR misc/58365

sets/lists: amd64: Add compat files for binutils 2.42

bump libssh, add sshd-session

GCC sanitizers: only build the sanitizers if $MKGCCCMDS != "no".

there's a minor use-case for the configuration of "building sanitizers
for distribution, but not the compiler", but it's pretty uncommon, and
the latest sanitizers don't build at all on m68000 so enhance the
option to not build /usr/bin/gcc (which simply can't modern GCC on a
sun2) to not build the sanitizers either.

(if we were to split these, MKGCCSANITIZER would be good variable.)

update set lists for far too many files, including fixing MKDEBUG for
a couple of builds.

sets: Fix amd64 build with MKTPM=yes.

XXX This probably also needs to be redundantly replicated, yet again,
for every other compat set list in order to fix the MKTPM=yes build
on any other 64-bit port with any compat, even though all the
information is already encoded in the non-xxx32 set lists.

mark some sanitzers as gcc=10 and add gcc=12 version.

Correct a typo in libarchive set list updates for recent libarchive update

And add me to the list of people who believe that the current 99999 different
debugN/ad.arch stuff is a disaster.

bump libarchive.

lists/debug32: Try to fix clang build, only tested for amd64

Mark libgomp_g.a and libobjc_g.a `gcc`.

Take a whack at fixing the compat32 set lists for clang build.

This really needs to be automatically derived from the main set
lists; all this copypasta is a maintenance nightmare and I doubt I
got everything after an hour of tweaking.

More rump markers

Mark ctf libs as depending on MKCTF

fix compat build of filter-aaaa.so.0

"./usr/libdata/debug/usr/lib/@ARCH_SUBDIR@/security" directory is
created by mtree regardless of MKDEBUG option, so move the entry from
debug32 to base32.

Files libgcc_eh_g.a and libgcc_s_g.a are debuglib, not debug.

mark *32 libc++ with libcxx

add libc++ files to *32 sets

sync categories with main debug set - somehow missed in test build...

Add missing directory from the new set of PAM files that get installed

Add new sets: base32, debug32, manhtml

- base32 contains (when MKCOMPAT=yes) shared libraries for 32-bit
compatibility, previously included in base

- debug32 contains (when MKCOMPAT=yes) debug symbols and static libraries
containing debug symbols for 32-bit compatiblity, previously included
in debug

- manhtml contains (when MKHTML=yes) the HTML files previously included
in 'man', which are of limited utility without third-party software.

The motivation for this change is to be able to easily exclude sets
from CD-ROM images that go over the size limit without xz compression
(which many NetBSD platforms struggle to extract at acceptable speeds).

sets/lists: amd64: Add compat files for binutils 2.42

bump libssh, add sshd-session

GCC sanitizers: only build the sanitizers if $MKGCCCMDS != "no".

there's a minor use-case for the configuration of "building sanitizers
for distribution, but not the compiler", but it's pretty uncommon, and
the latest sanitizers don't build at all on m68000 so enhance the
option to not build /usr/bin/gcc (which simply can't modern GCC on a
sun2) to not build the sanitizers either.

(if we were to split these, MKGCCSANITIZER would be good variable.)

update set lists for far too many files, including fixing MKDEBUG for
a couple of builds.

sets: Fix amd64 build with MKTPM=yes.

XXX This probably also needs to be redundantly replicated, yet again,
for every other compat set list in order to fix the MKTPM=yes build
on any other 64-bit port with any compat, even though all the
information is already encoded in the non-xxx32 set lists.

mark some sanitzers as gcc=10 and add gcc=12 version.

Correct a typo in libarchive set list updates for recent libarchive update

And add me to the list of people who believe that the current 99999 different
debugN/ad.arch stuff is a disaster.

bump libarchive.

lists/debug32: Try to fix clang build, only tested for amd64

Mark libgomp_g.a and libobjc_g.a `gcc`.

Take a whack at fixing the compat32 set lists for clang build.

This really needs to be automatically derived from the main set
lists; all this copypasta is a maintenance nightmare and I doubt I
got everything after an hour of tweaking.

More rump markers

Mark ctf libs as depending on MKCTF

fix compat build of filter-aaaa.so.0

"./usr/libdata/debug/usr/lib/@ARCH_SUBDIR@/security" directory is
created by mtree regardless of MKDEBUG option, so move the entry from
debug32 to base32.

Files libgcc_eh_g.a and libgcc_s_g.a are debuglib, not debug.

mark *32 libc++ with libcxx

add libc++ files to *32 sets

sync categories with main debug set - somehow missed in test build...

Add missing directory from the new set of PAM files that get installed

Add new sets: base32, debug32, manhtml

- base32 contains (when MKCOMPAT=yes) shared libraries for 32-bit
compatibility, previously included in base

- debug32 contains (when MKCOMPAT=yes) debug symbols and static libraries
containing debug symbols for 32-bit compatiblity, previously included
in debug

- manhtml contains (when MKHTML=yes) the HTML files previously included
in 'man', which are of limited utility without third-party software.

The motivation for this change is to be able to easily exclude sets
from CD-ROM images that go over the size limit without xz compression
(which many NetBSD platforms struggle to extract at acceptable speeds).

GCC sanitizers: only build the sanitizers if $MKGCCCMDS != "no".

there's a minor use-case for the configuration of "building sanitizers
for distribution, but not the compiler", but it's pretty uncommon, and
the latest sanitizers don't build at all on m68000 so enhance the
option to not build /usr/bin/gcc (which simply can't modern GCC on a
sun2) to not build the sanitizers either.

(if we were to split these, MKGCCSANITIZER would be good variable.)

update set lists for far too many files, including fixing MKDEBUG for
a couple of builds.

sets: Fix amd64 build with MKTPM=yes.

XXX This probably also needs to be redundantly replicated, yet again,
for every other compat set list in order to fix the MKTPM=yes build
on any other 64-bit port with any compat, even though all the
information is already encoded in the non-xxx32 set lists.

mark some sanitzers as gcc=10 and add gcc=12 version.

Correct a typo in libarchive set list updates for recent libarchive update

And add me to the list of people who believe that the current 99999 different
debugN/ad.arch stuff is a disaster.

bump libarchive.

lists/debug32: Try to fix clang build, only tested for amd64

Mark libgomp_g.a and libobjc_g.a `gcc`.

Take a whack at fixing the compat32 set lists for clang build.

This really needs to be automatically derived from the main set
lists; all this copypasta is a maintenance nightmare and I doubt I
got everything after an hour of tweaking.

More rump markers

Mark ctf libs as depending on MKCTF

fix compat build of filter-aaaa.so.0

"./usr/libdata/debug/usr/lib/@ARCH_SUBDIR@/security" directory is
created by mtree regardless of MKDEBUG option, so move the entry from
debug32 to base32.

Files libgcc_eh_g.a and libgcc_s_g.a are debuglib, not debug.

mark *32 libc++ with libcxx

add libc++ files to *32 sets

sync categories with main debug set - somehow missed in test build...

Add missing directory from the new set of PAM files that get installed

Add new sets: base32, debug32, manhtml

- base32 contains (when MKCOMPAT=yes) shared libraries for 32-bit
compatibility, previously included in base

- debug32 contains (when MKCOMPAT=yes) debug symbols and static libraries
containing debug symbols for 32-bit compatiblity, previously included
in debug

- manhtml contains (when MKHTML=yes) the HTML files previously included
in 'man', which are of limited utility without third-party software.

The motivation for this change is to be able to easily exclude sets
from CD-ROM images that go over the size limit without xz compression
(which many NetBSD platforms struggle to extract at acceptable speeds).

sets: Fix amd64 build with MKTPM=yes.

XXX This probably also needs to be redundantly replicated, yet again,
for every other compat set list in order to fix the MKTPM=yes build
on any other 64-bit port with any compat, even though all the
information is already encoded in the non-xxx32 set lists.

mark some sanitzers as gcc=10 and add gcc=12 version.

Correct a typo in libarchive set list updates for recent libarchive update

And add me to the list of people who believe that the current 99999 different
debugN/ad.arch stuff is a disaster.

bump libarchive.

lists/debug32: Try to fix clang build, only tested for amd64

Mark libgomp_g.a and libobjc_g.a `gcc`.

Take a whack at fixing the compat32 set lists for clang build.

This really needs to be automatically derived from the main set
lists; all this copypasta is a maintenance nightmare and I doubt I
got everything after an hour of tweaking.

More rump markers

Mark ctf libs as depending on MKCTF

fix compat build of filter-aaaa.so.0

"./usr/libdata/debug/usr/lib/@ARCH_SUBDIR@/security" directory is
created by mtree regardless of MKDEBUG option, so move the entry from
debug32 to base32.

Files libgcc_eh_g.a and libgcc_s_g.a are debuglib, not debug.

mark *32 libc++ with libcxx

add libc++ files to *32 sets

sync categories with main debug set - somehow missed in test build...

Add missing directory from the new set of PAM files that get installed

Add new sets: base32, debug32, manhtml

- base32 contains (when MKCOMPAT=yes) shared libraries for 32-bit
compatibility, previously included in base

- debug32 contains (when MKCOMPAT=yes) debug symbols and static libraries
containing debug symbols for 32-bit compatiblity, previously included
in debug

- manhtml contains (when MKHTML=yes) the HTML files previously included
in 'man', which are of limited utility without third-party software.

The motivation for this change is to be able to easily exclude sets
from CD-ROM images that go over the size limit without xz compression
(which many NetBSD platforms struggle to extract at acceptable speeds).

sets: Fix amd64 build with MKTPM=yes.

XXX This probably also needs to be redundantly replicated, yet again,
for every other compat set list in order to fix the MKTPM=yes build
on any other 64-bit port with any compat, even though all the
information is already encoded in the non-xxx32 set lists.

mark some sanitzers as gcc=10 and add gcc=12 version.

Correct a typo in libarchive set list updates for recent libarchive update

And add me to the list of people who believe that the current 99999 different
debugN/ad.arch stuff is a disaster.

bump libarchive.

lists/debug32: Try to fix clang build, only tested for amd64

Mark libgomp_g.a and libobjc_g.a `gcc`.

Take a whack at fixing the compat32 set lists for clang build.

This really needs to be automatically derived from the main set
lists; all this copypasta is a maintenance nightmare and I doubt I
got everything after an hour of tweaking.

More rump markers

Mark ctf libs as depending on MKCTF

fix compat build of filter-aaaa.so.0

"./usr/libdata/debug/usr/lib/@ARCH_SUBDIR@/security" directory is
created by mtree regardless of MKDEBUG option, so move the entry from
debug32 to base32.

Files libgcc_eh_g.a and libgcc_s_g.a are debuglib, not debug.

mark *32 libc++ with libcxx

add libc++ files to *32 sets

sync categories with main debug set - somehow missed in test build...

Add missing directory from the new set of PAM files that get installed

Add new sets: base32, debug32, manhtml

- base32 contains (when MKCOMPAT=yes) shared libraries for 32-bit
compatibility, previously included in base

- debug32 contains (when MKCOMPAT=yes) debug symbols and static libraries
containing debug symbols for 32-bit compatiblity, previously included
in debug

- manhtml contains (when MKHTML=yes) the HTML files previously included
in 'man', which are of limited utility without third-party software.

The motivation for this change is to be able to easily exclude sets
from CD-ROM images that go over the size limit without xz compression
(which many NetBSD platforms struggle to extract at acceptable speeds).

Correct a typo in libarchive set list updates for recent libarchive update

And add me to the list of people who believe that the current 99999 different
debugN/ad.arch stuff is a disaster.

bump libarchive.

lists/debug32: Try to fix clang build, only tested for amd64

Mark libgomp_g.a and libobjc_g.a `gcc`.

Take a whack at fixing the compat32 set lists for clang build.

This really needs to be automatically derived from the main set
lists; all this copypasta is a maintenance nightmare and I doubt I
got everything after an hour of tweaking.

More rump markers

Mark ctf libs as depending on MKCTF

fix compat build of filter-aaaa.so.0

"./usr/libdata/debug/usr/lib/@ARCH_SUBDIR@/security" directory is
created by mtree regardless of MKDEBUG option, so move the entry from
debug32 to base32.

Files libgcc_eh_g.a and libgcc_s_g.a are debuglib, not debug.

mark *32 libc++ with libcxx

add libc++ files to *32 sets

sync categories with main debug set - somehow missed in test build...

Add missing directory from the new set of PAM files that get installed

Add new sets: base32, debug32, manhtml

- base32 contains (when MKCOMPAT=yes) shared libraries for 32-bit
compatibility, previously included in base

- debug32 contains (when MKCOMPAT=yes) debug symbols and static libraries
containing debug symbols for 32-bit compatiblity, previously included
in debug

- manhtml contains (when MKHTML=yes) the HTML files previously included
in 'man', which are of limited utility without third-party software.

The motivation for this change is to be able to easily exclude sets
from CD-ROM images that go over the size limit without xz compression
(which many NetBSD platforms struggle to extract at acceptable speeds).

bump libarchive.

lists/debug32: Try to fix clang build, only tested for amd64

Mark libgomp_g.a and libobjc_g.a `gcc`.

Take a whack at fixing the compat32 set lists for clang build.

This really needs to be automatically derived from the main set
lists; all this copypasta is a maintenance nightmare and I doubt I
got everything after an hour of tweaking.

More rump markers

Mark ctf libs as depending on MKCTF

fix compat build of filter-aaaa.so.0

"./usr/libdata/debug/usr/lib/@ARCH_SUBDIR@/security" directory is
created by mtree regardless of MKDEBUG option, so move the entry from
debug32 to base32.

Files libgcc_eh_g.a and libgcc_s_g.a are debuglib, not debug.

mark *32 libc++ with libcxx

add libc++ files to *32 sets

sync categories with main debug set - somehow missed in test build...

Add missing directory from the new set of PAM files that get installed

Add new sets: base32, debug32, manhtml

- base32 contains (when MKCOMPAT=yes) shared libraries for 32-bit
compatibility, previously included in base

- debug32 contains (when MKCOMPAT=yes) debug symbols and static libraries
containing debug symbols for 32-bit compatiblity, previously included
in debug

- manhtml contains (when MKHTML=yes) the HTML files previously included
in 'man', which are of limited utility without third-party software.

The motivation for this change is to be able to easily exclude sets
from CD-ROM images that go over the size limit without xz compression
(which many NetBSD platforms struggle to extract at acceptable speeds).

Take a whack at fixing the compat32 set lists for clang build.

This really needs to be automatically derived from the main set
lists; all this copypasta is a maintenance nightmare and I doubt I
got everything after an hour of tweaking.

More rump markers

Mark ctf libs as depending on MKCTF

fix compat build of filter-aaaa.so.0

"./usr/libdata/debug/usr/lib/@ARCH_SUBDIR@/security" directory is
created by mtree regardless of MKDEBUG option, so move the entry from
debug32 to base32.

Files libgcc_eh_g.a and libgcc_s_g.a are debuglib, not debug.

mark *32 libc++ with libcxx

add libc++ files to *32 sets

sync categories with main debug set - somehow missed in test build...

Add missing directory from the new set of PAM files that get installed

Add new sets: base32, debug32, manhtml

- base32 contains (when MKCOMPAT=yes) shared libraries for 32-bit
compatibility, previously included in base

- debug32 contains (when MKCOMPAT=yes) debug symbols and static libraries
containing debug symbols for 32-bit compatiblity, previously included
in debug

- manhtml contains (when MKHTML=yes) the HTML files previously included
in 'man', which are of limited utility without third-party software.

The motivation for this change is to be able to easily exclude sets
from CD-ROM images that go over the size limit without xz compression
(which many NetBSD platforms struggle to extract at acceptable speeds).

More rump markers

Mark ctf libs as depending on MKCTF

fix compat build of filter-aaaa.so.0

"./usr/libdata/debug/usr/lib/@ARCH_SUBDIR@/security" directory is
created by mtree regardless of MKDEBUG option, so move the entry from
debug32 to base32.

Files libgcc_eh_g.a and libgcc_s_g.a are debuglib, not debug.

mark *32 libc++ with libcxx

add libc++ files to *32 sets

sync categories with main debug set - somehow missed in test build...

Add missing directory from the new set of PAM files that get installed

Add new sets: base32, debug32, manhtml

- base32 contains (when MKCOMPAT=yes) shared libraries for 32-bit
compatibility, previously included in base

- debug32 contains (when MKCOMPAT=yes) debug symbols and static libraries
containing debug symbols for 32-bit compatiblity, previously included
in debug

- manhtml contains (when MKHTML=yes) the HTML files previously included
in 'man', which are of limited utility without third-party software.

The motivation for this change is to be able to easily exclude sets
from CD-ROM images that go over the size limit without xz compression
(which many NetBSD platforms struggle to extract at acceptable speeds).

Mark ctf libs as depending on MKCTF

fix compat build of filter-aaaa.so.0

"./usr/libdata/debug/usr/lib/@ARCH_SUBDIR@/security" directory is
created by mtree regardless of MKDEBUG option, so move the entry from
debug32 to base32.

Files libgcc_eh_g.a and libgcc_s_g.a are debuglib, not debug.

mark *32 libc++ with libcxx

add libc++ files to *32 sets

sync categories with main debug set - somehow missed in test build...

Add missing directory from the new set of PAM files that get installed

Add new sets: base32, debug32, manhtml

- base32 contains (when MKCOMPAT=yes) shared libraries for 32-bit
compatibility, previously included in base

- debug32 contains (when MKCOMPAT=yes) debug symbols and static libraries
containing debug symbols for 32-bit compatiblity, previously included
in debug

- manhtml contains (when MKHTML=yes) the HTML files previously included
in 'man', which are of limited utility without third-party software.

The motivation for this change is to be able to easily exclude sets
from CD-ROM images that go over the size limit without xz compression
(which many NetBSD platforms struggle to extract at acceptable speeds).

fix compat build of filter-aaaa.so.0

"./usr/libdata/debug/usr/lib/@ARCH_SUBDIR@/security" directory is
created by mtree regardless of MKDEBUG option, so move the entry from
debug32 to base32.

Files libgcc_eh_g.a and libgcc_s_g.a are debuglib, not debug.

mark *32 libc++ with libcxx

add libc++ files to *32 sets

sync categories with main debug set - somehow missed in test build...

Add missing directory from the new set of PAM files that get installed

Add new sets: base32, debug32, manhtml

- base32 contains (when MKCOMPAT=yes) shared libraries for 32-bit
compatibility, previously included in base

- debug32 contains (when MKCOMPAT=yes) debug symbols and static libraries
containing debug symbols for 32-bit compatiblity, previously included
in debug

- manhtml contains (when MKHTML=yes) the HTML files previously included
in 'man', which are of limited utility without third-party software.

The motivation for this change is to be able to easily exclude sets
from CD-ROM images that go over the size limit without xz compression
(which many NetBSD platforms struggle to extract at acceptable speeds).

"./usr/libdata/debug/usr/lib/@ARCH_SUBDIR@/security" directory is
created by mtree regardless of MKDEBUG option, so move the entry from
debug32 to base32.

Files libgcc_eh_g.a and libgcc_s_g.a are debuglib, not debug.

mark *32 libc++ with libcxx

add libc++ files to *32 sets

sync categories with main debug set - somehow missed in test build...

Add missing directory from the new set of PAM files that get installed

Add new sets: base32, debug32, manhtml

- base32 contains (when MKCOMPAT=yes) shared libraries for 32-bit
compatibility, previously included in base

- debug32 contains (when MKCOMPAT=yes) debug symbols and static libraries
containing debug symbols for 32-bit compatiblity, previously included
in debug

- manhtml contains (when MKHTML=yes) the HTML files previously included
in 'man', which are of limited utility without third-party software.

The motivation for this change is to be able to easily exclude sets
from CD-ROM images that go over the size limit without xz compression
(which many NetBSD platforms struggle to extract at acceptable speeds).

Files libgcc_eh_g.a and libgcc_s_g.a are debuglib, not debug.

mark *32 libc++ with libcxx

add libc++ files to *32 sets

sync categories with main debug set - somehow missed in test build...

Add missing directory from the new set of PAM files that get installed

Add new sets: base32, debug32, manhtml

- base32 contains (when MKCOMPAT=yes) shared libraries for 32-bit
compatibility, previously included in base

- debug32 contains (when MKCOMPAT=yes) debug symbols and static libraries
containing debug symbols for 32-bit compatiblity, previously included
in debug

- manhtml contains (when MKHTML=yes) the HTML files previously included
in 'man', which are of limited utility without third-party software.

The motivation for this change is to be able to easily exclude sets
from CD-ROM images that go over the size limit without xz compression
(which many NetBSD platforms struggle to extract at acceptable speeds).

Add missing directory from the new set of PAM files that get installed

Add new sets: base32, debug32, manhtml

- base32 contains (when MKCOMPAT=yes) shared libraries for 32-bit
compatibility, previously included in base

- debug32 contains (when MKCOMPAT=yes) debug symbols and static libraries
containing debug symbols for 32-bit compatiblity, previously included
in debug

- manhtml contains (when MKHTML=yes) the HTML files previously included
in 'man', which are of limited utility without third-party software.

The motivation for this change is to be able to easily exclude sets
from CD-ROM images that go over the size limit without xz compression
(which many NetBSD platforms struggle to extract at acceptable speeds).