tools: revert use of <bsd.hostinit.mk>

tools/Makefile.host revision 1.35 changed from
setting various NOxxx variables and .include <bsd.own.mk>
to
.include <bsd.hostinit.mk>
which sets the same NOxxx variables, .include <bsd.init.mk>
which optionally .include ../Makefile.inc before .include <bsd.own.mk>.

This chnage caused build failures with HAVE_LLVM=yes, so revert rev 1.35.
(Maybe to do with the .include ../Makefile.inc. The tools/llvm* build is
tricky, and it's easier to revert this change than debug.)

tools: use <bsd.hostinit.mk> where appropriate

bsd.hostinit.mk sets a bunch of NOxxx variables before
including bsd.init.mk (which includes bsd.own.mk),
so simplify instead of replicating the NOxxx setup
for host tools.

revert previous, breaks llvm build and not easy to fix.

Create a new bsd.hostinit.mk file and put the build definitions for all host
programs there; make all Makefiles that use bsd.hostprog.mk include it.
Namely turn off MKREPRO and don't make lint, man pages, info files etc.
Remove the Makefile.inc files that contained these same settings, and
remove the settings from Makefile.host

PR/53238: Robert Elz: Disable MKREPRO in tools; the host compiler might
not support the necessary options. This is done thusly:

1. Set MKREPRO=no in Makefile.host. This handles all the Makefiles that
use it and don't include bsd.own.mk.
2. Create Makefile.inc and set MKREPRO=no in it. Change the Makefiles that
include bsd.own.mk, to include bsd.init.mk which includes Makefile.inc
first. This will also allow us to control other tools options from a
single location if we need to.

XXX: pullup-8

branches: 1.31.20; 1.31.26;
Invoke tools/binstall/mkmanifest for Cygwin via ${HOST_SH}.
Fixes builds using source sets that drop executable bits.

- Provide HOSTEXEEXT if NOCOMPATLIB
- merge a variable for readability and add an exe suffix where needed.

Make most things under src/tools use the TOOLDIR version of compat/defs.mk,
instead of the version in the .OBJDIR of tools/compat.

branches: 1.28.4; 1.28.10;
For USETOOLS=yes, use the --sysroot support of the compiler to cut down
the number of hard-coded pathes and magic invocations.

If MKREPRO, transform ${NETBSDSRCDIR} to /usr/src and ${DESTDIR} to /
for the purpose of the C preprocessor. This avoids leaking the source
path into the final binaries.

Revert previous, which caused tools build to fail.

Use ${NETBSDSRCDIR} for deep tools/* directories.

Define NOINFO, so that we don't try to build info files for host tools.

Correct .PHONY rules that force tools to be installed to use
'.if ${MKUPDATE} == "no"' instead of '.if !defined(UPDATE)'.

Rework how MAKEVERBOSE operates:

* Don't bother prefixing commands with a line of ${_MKCMD}\
and instead rely upon "make -s". This is less intrusive on
all the Makefiles than the former. Idea from David Laight.

* Rename the variables use to print messages. The scheme now is:
_MKMSG_FOO Run _MKMSG 'foo'
_MKTARGET_FOO Run _MKMSG_FOO ${.TARGET}
From discussion with Alistair Crooks.

rework to use the newer _MKMSGCREATE (et al) macros

MAKEVERBOSE support

Move -no-cpp-precomp logic to defs.mk.

Pass -no-cpp-precomp to the C preprocessor on Darwin; our use of
libnbcompat is incompatible with pre-compiled headers (which the
compiler correctly detects, but warns about profusely).

Make almost all tools compile and run properly on non-NetBSD hosts. (In
particular, most tools now run correctly on Solaris 7.)

Missed in last commit: make some tools build properly on non-NetBSD hosts.

no need to set NOMAN twice

Add NOMAN/NOLINT.

MKfoo=no -> NOfoo

Add the framework for autoconf-based src/tools/compat structure. This will
(after it is more fleshed out) allow the host tools to work more cleanly
on non-NetBSD hosts.

replace instances of INSTALL_FILE with HOST_INSTALL_FILE

Major overhaul of src/tools and host toolchain. Summary of changes:

* Rewrite src/tools Make logic to work like the rest of the tree wrt
"dependall" and "install". The old "make build" hack is gone.

* Remove the MKTOOLS logic. This was linked to the "make build" hack,
and was only needed because TOOLDIR originally had no writable default.

* Redo the GNU configure/make logic to make it fit reasonably in a
BSD make wrapper. Use new ${.ALLTARGETS} variable to scan for
targets in $(srcdir), and mark them with .MADE: to prevent rebuilding.

* Only build cross tools in src/tools; remove some messy logic in
src/usr.* and src/gnu/usr.* that would do target filename rewriting
(improves consistency and readability).

* Add the ability to build cross gdb at tool build time by setting
MKCROSSGDB (default no) to "yes" in mk.conf.

* Add src/tools/groff and set up paths to work with this cross groff.

Make use of OBJHOSTMACHINE here, since <bsd.obj.mk> is preloaded.

Pull the rmd160 stuff out as mtree now has options to selectively compile
pieces out we won't need during a build.

XXX...Complete hack for now.

Add a stub for RMD160File which prints out a warning and returns NULL.

This allows mtree to be built when hosting from a 1.5.x box.
The real solution is to convert the src/tools bits into clean portable tools
and not have them so NetBSD-current centric.

Back out previous -- it has other annoying side-effects I missed.

Add the program's CPPFLAGS to HOST_CPPFLAGS using make(1)'s normal
lazy evaluation semantics, not the "assign it now" semantics. This
allows variables used in the program's CPPFLAGS to get the correct
values of e.g. MACHINE, MACHINE_ARCH, MACHINE_CPU, etc.

Problem was notices when propagating MACHINE and MACHINE_ARCH via
MAKEFLAGS (i.e. from the command line, rather than the environment).

For this to work, make sure you <bsd.hostprog.mk> is at least rev 1.15.

Provide a PRINTOBJDIR.

If <srcdir>/../Makefile.inc exists, pull it in as well before setting
CPPFLAGS, etc.

Add install.files rule. Tools with support files can use HOSTFILES and
HOST_FILESDIR to install support files (just like bsd.files.mk normally
would be doing.

Bootstrap toolchain framework, first pass.

revert previous, breaks llvm build and not easy to fix.

Create a new bsd.hostinit.mk file and put the build definitions for all host
programs there; make all Makefiles that use bsd.hostprog.mk include it.
Namely turn off MKREPRO and don't make lint, man pages, info files etc.
Remove the Makefile.inc files that contained these same settings, and
remove the settings from Makefile.host

PR/53238: Robert Elz: Disable MKREPRO in tools; the host compiler might
not support the necessary options. This is done thusly:

1. Set MKREPRO=no in Makefile.host. This handles all the Makefiles that
use it and don't include bsd.own.mk.
2. Create Makefile.inc and set MKREPRO=no in it. Change the Makefiles that
include bsd.own.mk, to include bsd.init.mk which includes Makefile.inc
first. This will also allow us to control other tools options from a
single location if we need to.

XXX: pullup-8

branches: 1.31.20; 1.31.26;
Invoke tools/binstall/mkmanifest for Cygwin via ${HOST_SH}.
Fixes builds using source sets that drop executable bits.

- Provide HOSTEXEEXT if NOCOMPATLIB
- merge a variable for readability and add an exe suffix where needed.

Make most things under src/tools use the TOOLDIR version of compat/defs.mk,
instead of the version in the .OBJDIR of tools/compat.

branches: 1.28.4; 1.28.10;
For USETOOLS=yes, use the --sysroot support of the compiler to cut down
the number of hard-coded pathes and magic invocations.

If MKREPRO, transform ${NETBSDSRCDIR} to /usr/src and ${DESTDIR} to /
for the purpose of the C preprocessor. This avoids leaking the source
path into the final binaries.

Revert previous, which caused tools build to fail.

Use ${NETBSDSRCDIR} for deep tools/* directories.

Define NOINFO, so that we don't try to build info files for host tools.

Correct .PHONY rules that force tools to be installed to use
'.if ${MKUPDATE} == "no"' instead of '.if !defined(UPDATE)'.

Rework how MAKEVERBOSE operates:

* Don't bother prefixing commands with a line of ${_MKCMD}\
and instead rely upon "make -s". This is less intrusive on
all the Makefiles than the former. Idea from David Laight.

* Rename the variables use to print messages. The scheme now is:
_MKMSG_FOO Run _MKMSG 'foo'
_MKTARGET_FOO Run _MKMSG_FOO ${.TARGET}
From discussion with Alistair Crooks.

rework to use the newer _MKMSGCREATE (et al) macros

MAKEVERBOSE support

Move -no-cpp-precomp logic to defs.mk.

Pass -no-cpp-precomp to the C preprocessor on Darwin; our use of
libnbcompat is incompatible with pre-compiled headers (which the
compiler correctly detects, but warns about profusely).

Make almost all tools compile and run properly on non-NetBSD hosts. (In
particular, most tools now run correctly on Solaris 7.)

Missed in last commit: make some tools build properly on non-NetBSD hosts.

no need to set NOMAN twice

Add NOMAN/NOLINT.

MKfoo=no -> NOfoo

Add the framework for autoconf-based src/tools/compat structure. This will
(after it is more fleshed out) allow the host tools to work more cleanly
on non-NetBSD hosts.

replace instances of INSTALL_FILE with HOST_INSTALL_FILE

Major overhaul of src/tools and host toolchain. Summary of changes:

* Rewrite src/tools Make logic to work like the rest of the tree wrt
"dependall" and "install". The old "make build" hack is gone.

* Remove the MKTOOLS logic. This was linked to the "make build" hack,
and was only needed because TOOLDIR originally had no writable default.

* Redo the GNU configure/make logic to make it fit reasonably in a
BSD make wrapper. Use new ${.ALLTARGETS} variable to scan for
targets in $(srcdir), and mark them with .MADE: to prevent rebuilding.

* Only build cross tools in src/tools; remove some messy logic in
src/usr.* and src/gnu/usr.* that would do target filename rewriting
(improves consistency and readability).

* Add the ability to build cross gdb at tool build time by setting
MKCROSSGDB (default no) to "yes" in mk.conf.

* Add src/tools/groff and set up paths to work with this cross groff.

Make use of OBJHOSTMACHINE here, since <bsd.obj.mk> is preloaded.

Pull the rmd160 stuff out as mtree now has options to selectively compile
pieces out we won't need during a build.

XXX...Complete hack for now.

Add a stub for RMD160File which prints out a warning and returns NULL.

This allows mtree to be built when hosting from a 1.5.x box.
The real solution is to convert the src/tools bits into clean portable tools
and not have them so NetBSD-current centric.

Back out previous -- it has other annoying side-effects I missed.

Add the program's CPPFLAGS to HOST_CPPFLAGS using make(1)'s normal
lazy evaluation semantics, not the "assign it now" semantics. This
allows variables used in the program's CPPFLAGS to get the correct
values of e.g. MACHINE, MACHINE_ARCH, MACHINE_CPU, etc.

Problem was notices when propagating MACHINE and MACHINE_ARCH via
MAKEFLAGS (i.e. from the command line, rather than the environment).

For this to work, make sure you <bsd.hostprog.mk> is at least rev 1.15.

Provide a PRINTOBJDIR.

If <srcdir>/../Makefile.inc exists, pull it in as well before setting
CPPFLAGS, etc.

Add install.files rule. Tools with support files can use HOSTFILES and
HOST_FILESDIR to install support files (just like bsd.files.mk normally
would be doing.

Bootstrap toolchain framework, first pass.