Error out if a path has a trailing slash, which makes awk enter an
infinite loop while creating set lists.

branches: 1.5.6;
Error out if a path has consecutive slashes which is unsupported and
made awk enter an infinite loop while creating set lists.

branches: 1.4.20;
Convert TNF licenses to new 2 clause variant

branches: 1.3.20; 1.3.22;
Instead of printing "./foo/bar optional" for implicitly required
directories, print "./foo/bar optional type=dir".

Reviewed by agc

getdirs.awk:
- improve parsing; explicitly skip lines we don't want and use the rest.
- keep track of which items were explicitly listed, and only output directories
at the END which weren't listed, each with a suffix of "optional".
- convert to my awk KNF

join.awk:
- when joining, output all of the matching entry from the first file
and the 2nd & subsequent lines of the entry from the second file.
- convert to my awk KNF

these changes mean that maketars use of pax will result in tar files
with the traditional behaviour of only containing the necessary
directories, rather than all the parent directories required to get to
a particular item. this latter behaviour was necessary for METALOG
(i.e UNPRIVED) pax .tgz set file generation, until the changes above
fixed it.

Fixes to allow unprivileged building of the binary tar files to
contain the correct permissions.

Makefile:
- set SETSENV to the list of variables we wish to pass to each shell
script and use that, rather than duplicating the effort below
- call maketars with "-M ${METALOG}" if UNPRIVED is set.

getdirs.awk:
- takes a list of filenames and outputs the list along with all the
directories used by those filenames

maketars:
- support "-M metalog"
- merge etc/mtree/NetBSD.dist with the "-M metalog" for use in the tgz build
- for a given set, find the union between the set list and the metalog
generated above and use that as the list of files to ${PAX} up as the
tgz file.

sync with head.

Sync with HEAD.

Sync with HEAD.

sync with head.

for a reference, the tree before this commit was tagged
as yamt-pagecache-tag8.

this commit was splitted into small chunks to avoid
a limitation of cvs. ("Protocol error: too many arguments")

sync with head

resync from head