History log of /openbsd-current/regress/usr.bin/openssl/appstest.sh
Revision (<<< Hide revision tags) (Show revision tags >>>) Date Author Comments
# 1.63 03-Mar-2024 tb

Reinstate a test that was accidentally removed in previous


# 1.62 02-Mar-2024 tb

Unhook some gost tests


# 1.61 26-Jan-2024 job

Add 'openssl x509 -new' functionality to the libcrypto CLI utility

The ability to generate a new certificate is useful for testing and
experimentation with rechaining PKIs.

While there, alias '-key' to '-signkey' for compatibility.

with and OK tb@


# 1.60 12-Jan-2024 tb

appstest: Zap a trailing tab added in previous


# 1.59 12-Jan-2024 job

Add -force_pubkey -multivalue-rdn -set_issuer -set_subject -utf8 to x509 app

The -set_issuer, -set_subject, and -force_pubkey features can be used to
'rechain' PKIs, for more information see https://labs.apnic.net/nro-ta/
and https://blog.apnic.net/2023/12/14/models-of-trust-for-the-rpki/

OK tb@


Revision tags: OPENBSD_7_4_BASE
# 1.58 24-Jul-2023 tb

remove errstr -stats test

reminded by anton


# 1.57 03-Jul-2023 beck

Stop testing tls 1.0 and 1.1

They have gone behind the barn.


# 1.56 26-Apr-2023 tb

Garbage collect test using the nseq command

reminded by anton


Revision tags: OPENBSD_7_2_BASE OPENBSD_7_3_BASE
# 1.55 14-Jul-2022 tb

Only run the client connection test with supported ciphers. Avoids test
breakage also noted by anton.


Revision tags: OPENBSD_7_1_BASE
# 1.54 05-Feb-2022 tb

Adapt appstest.sh for the new TLS_ names.


# 1.53 25-Oct-2021 tb

Drop two uses of the terrible asn1 kludge spotted by anton


Revision tags: OPENBSD_7_0_BASE
# 1.52 20-Sep-2021 inoguchi

Fix appstest.sh for testing with OpenSSL 3.0

- Fix 'Server Temp Key' check to work with both words "P-384" and "secp384r1".
- Test TLSv1 and TLSv1.1 only if OpenSSL version is 1.x.


# 1.51 21-Jun-2021 inoguchi

Add GnuTLS interoperability test in appstest.sh


# 1.50 12-May-2021 inoguchi

Modify cms test in appstest.sh to work with ec cert/key


# 1.49 27-Apr-2021 inoguchi

Add DTLS test in appstest.sh


# 1.48 24-Apr-2021 inoguchi

Remove "-4" option treatment and use it always on s_server test in appstest.sh


Revision tags: OPENBSD_6_9_BASE
# 1.47 26-Feb-2021 tb

zap spades of trailing whitespace


Revision tags: OPENBSD_6_8_BASE
# 1.46 01-Aug-2020 inoguchi

Replace hostname underscore with hyphen in appstest.sh


# 1.45 29-May-2020 inoguchi

Add checks for SH downgrade sentinel and HRR hash in appstest.sh


# 1.44 19-May-2020 inoguchi

Add -status and -servername test for s_server and s_client in appstest.sh


# 1.43 19-May-2020 inoguchi

Add -groups test for s_server and s_client in appstest.sh


# 1.42 18-May-2020 inoguchi

Add client certificate test in appstest.sh


# 1.41 18-May-2020 inoguchi

Rename variables for key, csr, pass, cert


# 1.40 17-May-2020 inoguchi

Add GOST certificate test in appstest.sh

Enabled by -g option, and default to disabled (RSA certificate is used)


# 1.39 17-May-2020 inoguchi

Suppress display output and reduce s_time to 1 sec in appstest.sh


# 1.38 17-May-2020 inoguchi

Fix server client test with TLSv1.3 in appstest.sh


# 1.37 15-May-2020 inoguchi

Factor out session reuse test and verification test


# 1.36 15-May-2020 inoguchi

Factor out the test for all available ciphers and add TLSv1.3 case


# 1.35 15-May-2020 inoguchi

Add ECDSA certificate test in appstest.sh

Enabled by -e option, and default to disabled (RSA certificate is used)


# 1.34 14-May-2020 inoguchi

Skip protocol version message check in appstest.sh

- OpenSSL1.1.1 with TLSv1.3 does not call SSL_SESSION_print() until NewSessionTicket arrival
- Shorten function name


# 1.33 14-May-2020 inoguchi

Factor out the protocol version test in appstest.sh

OTHER_OPENSSL default to eopenssl11


Revision tags: OPENBSD_6_7_BASE
# 1.32 26-Jan-2020 inoguchi

Restrict to use up to TLSv1.2 for test_server_client in appstest.sh

Currently, only s_client has TLSv1.3 and s_server does not.


# 1.31 25-Nov-2019 inoguchi

Add option for cms test in appstest.sh


# 1.30 24-Nov-2019 inoguchi

Add test for cms operations in appstest.sh


# 1.29 20-Nov-2019 inoguchi

Add test for cms -keyopt in appstest.sh


# 1.28 09-Nov-2019 inoguchi

Add test for req -addext in appstest.sh


# 1.27 05-Nov-2019 inoguchi

Remove trailing space in appstest.sh


# 1.26 05-Nov-2019 inoguchi

Add test for cms in appstest.sh


# 1.25 03-Nov-2019 inoguchi

Add RSA-PSS test for genpkey in appstest.sh


# 1.24 31-Oct-2019 inoguchi

Add RSA OAEP test for pkeyutl in appstest.sh


Revision tags: OPENBSD_6_6_BASE
# 1.23 17-Jul-2019 inoguchi

Update appstest.sh

- Add -modulus for dsa sub command
- Remove -nextprotoneg


# 1.22 27-Jun-2019 inoguchi

Add more option tests to req, ts, x509 and verify in appstest.sh


# 1.21 24-Jun-2019 inoguchi

Add more options test to ocsp in appstest.sh


# 1.20 23-Jun-2019 inoguchi

Add more option test to dgst in appstest.sh


# 1.19 22-Jun-2019 inoguchi

Add more option tests to ca in appstest.sh


# 1.18 13-Jun-2019 inoguchi

Add more options to pkcs12 and smime in appstest.sh


# 1.17 10-Jun-2019 inoguchi

Add pkcs12 options and smime tests for appstest.sh

- Add some options to pkcs12 test.
- Add smime tests for encrypt, decrypt and pk7out.


Revision tags: OPENBSD_6_5_BASE
# 1.16 16-Feb-2019 inoguchi

Add tests for pkeyutl


Revision tags: OPENBSD_6_4_BASE
# 1.15 15-Sep-2018 inoguchi

Modify regress appstest.sh for interoperability testing with OpenSSL 1.1.x

- add sleep before s_client instead of removing -pause option
- change check words for s_client output messages
- replace CAfile to CApath for s_time
- remove -prexit from s_client
- confirm openssl command path is executable


# 1.14 14-Sep-2018 inoguchi

Add interoperability test mode for regress appstest.sh

- test s_server and s_client between different version by option -i
- indicate other version by defining OTHER_OPENSSL environment variable
- fix "SSL/TLS" to "TLS/SSL", since TLS is correct as technical term
- s/SKIPPNG/SKIPPING/


# 1.13 08-Sep-2018 inoguchi

Fix indent and adjust line fit to 80 columns.


# 1.12 08-Sep-2018 inoguchi

Split test blocks into a function. Test contents are not changed.


# 1.11 08-Sep-2018 inoguchi

Test more ciphers and randomize the order in regress appstest.sh

- change test target ciphers
- randomize the test ciphers order
- display test cipher count


# 1.10 07-Sep-2018 inoguchi

tests all available TLSv1.2 ciphers


# 1.9 27-Aug-2018 inoguchi

Add protocol and cipher patterns in regress appstest.sh


# 1.8 26-Aug-2018 inoguchi

Stop s_server if error occurs in regress appstest.sh


# 1.7 23-Aug-2018 inoguchi

Add license header.


# 1.6 23-Aug-2018 inoguchi

Check reusing SSL/TLS session ticket by regression test

- Added checking for session ticket reusing with using openssl(1) s_server and
s_client command in appstest.sh
- Confirm certificate verification status.
- Save s_server message to log file.

ok tb@ and jsing@


# 1.5 10-Apr-2018 tb

tweak usage()


Revision tags: OPENBSD_6_3_BASE
# 1.4 19-Mar-2018 beck

Add a -q (for quick) mode to apptest.sh, and use it by default.
this means that running the regression test doesn't take forever
because we run a huge dhparam test and openssl speed tests.

ok inoguchi@


# 1.3 06-Feb-2018 tb

Respect the OPENSSL make variable everywhere so that

make OPENSSL=/usr/src/usr.bin/openssl/obj/openssl

actually does the expected thing instead of running a mixture of both the
openssl below /usr/obj and the one below /usr/bin. Found the hard way via
backtraces that made no sense whatsoever.

ok jsing


Revision tags: OPENBSD_6_1_BASE OPENBSD_6_2_BASE
# 1.2 27-Jan-2017 tom

More s/OSCP/OCSP/ typos

ok jmc@


# 1.1 06-Nov-2016 inoguchi

Add regress test script for openssl command.
ok beck@


# 1.61 26-Jan-2024 job

Add 'openssl x509 -new' functionality to the libcrypto CLI utility

The ability to generate a new certificate is useful for testing and
experimentation with rechaining PKIs.

While there, alias '-key' to '-signkey' for compatibility.

with and OK tb@


# 1.60 12-Jan-2024 tb

appstest: Zap a trailing tab added in previous


# 1.59 12-Jan-2024 job

Add -force_pubkey -multivalue-rdn -set_issuer -set_subject -utf8 to x509 app

The -set_issuer, -set_subject, and -force_pubkey features can be used to
'rechain' PKIs, for more information see https://labs.apnic.net/nro-ta/
and https://blog.apnic.net/2023/12/14/models-of-trust-for-the-rpki/

OK tb@


Revision tags: OPENBSD_7_4_BASE
# 1.58 24-Jul-2023 tb

remove errstr -stats test

reminded by anton


# 1.57 03-Jul-2023 beck

Stop testing tls 1.0 and 1.1

They have gone behind the barn.


# 1.56 26-Apr-2023 tb

Garbage collect test using the nseq command

reminded by anton


Revision tags: OPENBSD_7_2_BASE OPENBSD_7_3_BASE
# 1.55 14-Jul-2022 tb

Only run the client connection test with supported ciphers. Avoids test
breakage also noted by anton.


Revision tags: OPENBSD_7_1_BASE
# 1.54 05-Feb-2022 tb

Adapt appstest.sh for the new TLS_ names.


# 1.53 25-Oct-2021 tb

Drop two uses of the terrible asn1 kludge spotted by anton


Revision tags: OPENBSD_7_0_BASE
# 1.52 20-Sep-2021 inoguchi

Fix appstest.sh for testing with OpenSSL 3.0

- Fix 'Server Temp Key' check to work with both words "P-384" and "secp384r1".
- Test TLSv1 and TLSv1.1 only if OpenSSL version is 1.x.


# 1.51 21-Jun-2021 inoguchi

Add GnuTLS interoperability test in appstest.sh


# 1.50 12-May-2021 inoguchi

Modify cms test in appstest.sh to work with ec cert/key


# 1.49 27-Apr-2021 inoguchi

Add DTLS test in appstest.sh


# 1.48 24-Apr-2021 inoguchi

Remove "-4" option treatment and use it always on s_server test in appstest.sh


Revision tags: OPENBSD_6_9_BASE
# 1.47 26-Feb-2021 tb

zap spades of trailing whitespace


Revision tags: OPENBSD_6_8_BASE
# 1.46 01-Aug-2020 inoguchi

Replace hostname underscore with hyphen in appstest.sh


# 1.45 29-May-2020 inoguchi

Add checks for SH downgrade sentinel and HRR hash in appstest.sh


# 1.44 19-May-2020 inoguchi

Add -status and -servername test for s_server and s_client in appstest.sh


# 1.43 19-May-2020 inoguchi

Add -groups test for s_server and s_client in appstest.sh


# 1.42 18-May-2020 inoguchi

Add client certificate test in appstest.sh


# 1.41 18-May-2020 inoguchi

Rename variables for key, csr, pass, cert


# 1.40 17-May-2020 inoguchi

Add GOST certificate test in appstest.sh

Enabled by -g option, and default to disabled (RSA certificate is used)


# 1.39 17-May-2020 inoguchi

Suppress display output and reduce s_time to 1 sec in appstest.sh


# 1.38 17-May-2020 inoguchi

Fix server client test with TLSv1.3 in appstest.sh


# 1.37 15-May-2020 inoguchi

Factor out session reuse test and verification test


# 1.36 15-May-2020 inoguchi

Factor out the test for all available ciphers and add TLSv1.3 case


# 1.35 15-May-2020 inoguchi

Add ECDSA certificate test in appstest.sh

Enabled by -e option, and default to disabled (RSA certificate is used)


# 1.34 14-May-2020 inoguchi

Skip protocol version message check in appstest.sh

- OpenSSL1.1.1 with TLSv1.3 does not call SSL_SESSION_print() until NewSessionTicket arrival
- Shorten function name


# 1.33 14-May-2020 inoguchi

Factor out the protocol version test in appstest.sh

OTHER_OPENSSL default to eopenssl11


Revision tags: OPENBSD_6_7_BASE
# 1.32 26-Jan-2020 inoguchi

Restrict to use up to TLSv1.2 for test_server_client in appstest.sh

Currently, only s_client has TLSv1.3 and s_server does not.


# 1.31 25-Nov-2019 inoguchi

Add option for cms test in appstest.sh


# 1.30 24-Nov-2019 inoguchi

Add test for cms operations in appstest.sh


# 1.29 20-Nov-2019 inoguchi

Add test for cms -keyopt in appstest.sh


# 1.28 09-Nov-2019 inoguchi

Add test for req -addext in appstest.sh


# 1.27 05-Nov-2019 inoguchi

Remove trailing space in appstest.sh


# 1.26 05-Nov-2019 inoguchi

Add test for cms in appstest.sh


# 1.25 03-Nov-2019 inoguchi

Add RSA-PSS test for genpkey in appstest.sh


# 1.24 31-Oct-2019 inoguchi

Add RSA OAEP test for pkeyutl in appstest.sh


Revision tags: OPENBSD_6_6_BASE
# 1.23 17-Jul-2019 inoguchi

Update appstest.sh

- Add -modulus for dsa sub command
- Remove -nextprotoneg


# 1.22 27-Jun-2019 inoguchi

Add more option tests to req, ts, x509 and verify in appstest.sh


# 1.21 24-Jun-2019 inoguchi

Add more options test to ocsp in appstest.sh


# 1.20 23-Jun-2019 inoguchi

Add more option test to dgst in appstest.sh


# 1.19 22-Jun-2019 inoguchi

Add more option tests to ca in appstest.sh


# 1.18 13-Jun-2019 inoguchi

Add more options to pkcs12 and smime in appstest.sh


# 1.17 10-Jun-2019 inoguchi

Add pkcs12 options and smime tests for appstest.sh

- Add some options to pkcs12 test.
- Add smime tests for encrypt, decrypt and pk7out.


Revision tags: OPENBSD_6_5_BASE
# 1.16 16-Feb-2019 inoguchi

Add tests for pkeyutl


Revision tags: OPENBSD_6_4_BASE
# 1.15 15-Sep-2018 inoguchi

Modify regress appstest.sh for interoperability testing with OpenSSL 1.1.x

- add sleep before s_client instead of removing -pause option
- change check words for s_client output messages
- replace CAfile to CApath for s_time
- remove -prexit from s_client
- confirm openssl command path is executable


# 1.14 14-Sep-2018 inoguchi

Add interoperability test mode for regress appstest.sh

- test s_server and s_client between different version by option -i
- indicate other version by defining OTHER_OPENSSL environment variable
- fix "SSL/TLS" to "TLS/SSL", since TLS is correct as technical term
- s/SKIPPNG/SKIPPING/


# 1.13 08-Sep-2018 inoguchi

Fix indent and adjust line fit to 80 columns.


# 1.12 08-Sep-2018 inoguchi

Split test blocks into a function. Test contents are not changed.


# 1.11 08-Sep-2018 inoguchi

Test more ciphers and randomize the order in regress appstest.sh

- change test target ciphers
- randomize the test ciphers order
- display test cipher count


# 1.10 07-Sep-2018 inoguchi

tests all available TLSv1.2 ciphers


# 1.9 27-Aug-2018 inoguchi

Add protocol and cipher patterns in regress appstest.sh


# 1.8 26-Aug-2018 inoguchi

Stop s_server if error occurs in regress appstest.sh


# 1.7 23-Aug-2018 inoguchi

Add license header.


# 1.6 23-Aug-2018 inoguchi

Check reusing SSL/TLS session ticket by regression test

- Added checking for session ticket reusing with using openssl(1) s_server and
s_client command in appstest.sh
- Confirm certificate verification status.
- Save s_server message to log file.

ok tb@ and jsing@


# 1.5 10-Apr-2018 tb

tweak usage()


Revision tags: OPENBSD_6_3_BASE
# 1.4 19-Mar-2018 beck

Add a -q (for quick) mode to apptest.sh, and use it by default.
this means that running the regression test doesn't take forever
because we run a huge dhparam test and openssl speed tests.

ok inoguchi@


# 1.3 06-Feb-2018 tb

Respect the OPENSSL make variable everywhere so that

make OPENSSL=/usr/src/usr.bin/openssl/obj/openssl

actually does the expected thing instead of running a mixture of both the
openssl below /usr/obj and the one below /usr/bin. Found the hard way via
backtraces that made no sense whatsoever.

ok jsing


Revision tags: OPENBSD_6_1_BASE OPENBSD_6_2_BASE
# 1.2 27-Jan-2017 tom

More s/OSCP/OCSP/ typos

ok jmc@


# 1.1 06-Nov-2016 inoguchi

Add regress test script for openssl command.
ok beck@


# 1.60 12-Jan-2024 tb

appstest: Zap a trailing tab added in previous


# 1.59 12-Jan-2024 job

Add -force_pubkey -multivalue-rdn -set_issuer -set_subject -utf8 to x509 app

The -set_issuer, -set_subject, and -force_pubkey features can be used to
'rechain' PKIs, for more information see https://labs.apnic.net/nro-ta/
and https://blog.apnic.net/2023/12/14/models-of-trust-for-the-rpki/

OK tb@


Revision tags: OPENBSD_7_4_BASE
# 1.58 24-Jul-2023 tb

remove errstr -stats test

reminded by anton


# 1.57 03-Jul-2023 beck

Stop testing tls 1.0 and 1.1

They have gone behind the barn.


# 1.56 26-Apr-2023 tb

Garbage collect test using the nseq command

reminded by anton


Revision tags: OPENBSD_7_2_BASE OPENBSD_7_3_BASE
# 1.55 14-Jul-2022 tb

Only run the client connection test with supported ciphers. Avoids test
breakage also noted by anton.


Revision tags: OPENBSD_7_1_BASE
# 1.54 05-Feb-2022 tb

Adapt appstest.sh for the new TLS_ names.


# 1.53 25-Oct-2021 tb

Drop two uses of the terrible asn1 kludge spotted by anton


Revision tags: OPENBSD_7_0_BASE
# 1.52 20-Sep-2021 inoguchi

Fix appstest.sh for testing with OpenSSL 3.0

- Fix 'Server Temp Key' check to work with both words "P-384" and "secp384r1".
- Test TLSv1 and TLSv1.1 only if OpenSSL version is 1.x.


# 1.51 21-Jun-2021 inoguchi

Add GnuTLS interoperability test in appstest.sh


# 1.50 12-May-2021 inoguchi

Modify cms test in appstest.sh to work with ec cert/key


# 1.49 27-Apr-2021 inoguchi

Add DTLS test in appstest.sh


# 1.48 24-Apr-2021 inoguchi

Remove "-4" option treatment and use it always on s_server test in appstest.sh


Revision tags: OPENBSD_6_9_BASE
# 1.47 26-Feb-2021 tb

zap spades of trailing whitespace


Revision tags: OPENBSD_6_8_BASE
# 1.46 01-Aug-2020 inoguchi

Replace hostname underscore with hyphen in appstest.sh


# 1.45 29-May-2020 inoguchi

Add checks for SH downgrade sentinel and HRR hash in appstest.sh


# 1.44 19-May-2020 inoguchi

Add -status and -servername test for s_server and s_client in appstest.sh


# 1.43 19-May-2020 inoguchi

Add -groups test for s_server and s_client in appstest.sh


# 1.42 18-May-2020 inoguchi

Add client certificate test in appstest.sh


# 1.41 18-May-2020 inoguchi

Rename variables for key, csr, pass, cert


# 1.40 17-May-2020 inoguchi

Add GOST certificate test in appstest.sh

Enabled by -g option, and default to disabled (RSA certificate is used)


# 1.39 17-May-2020 inoguchi

Suppress display output and reduce s_time to 1 sec in appstest.sh


# 1.38 17-May-2020 inoguchi

Fix server client test with TLSv1.3 in appstest.sh


# 1.37 15-May-2020 inoguchi

Factor out session reuse test and verification test


# 1.36 15-May-2020 inoguchi

Factor out the test for all available ciphers and add TLSv1.3 case


# 1.35 15-May-2020 inoguchi

Add ECDSA certificate test in appstest.sh

Enabled by -e option, and default to disabled (RSA certificate is used)


# 1.34 14-May-2020 inoguchi

Skip protocol version message check in appstest.sh

- OpenSSL1.1.1 with TLSv1.3 does not call SSL_SESSION_print() until NewSessionTicket arrival
- Shorten function name


# 1.33 14-May-2020 inoguchi

Factor out the protocol version test in appstest.sh

OTHER_OPENSSL default to eopenssl11


Revision tags: OPENBSD_6_7_BASE
# 1.32 26-Jan-2020 inoguchi

Restrict to use up to TLSv1.2 for test_server_client in appstest.sh

Currently, only s_client has TLSv1.3 and s_server does not.


# 1.31 25-Nov-2019 inoguchi

Add option for cms test in appstest.sh


# 1.30 24-Nov-2019 inoguchi

Add test for cms operations in appstest.sh


# 1.29 20-Nov-2019 inoguchi

Add test for cms -keyopt in appstest.sh


# 1.28 09-Nov-2019 inoguchi

Add test for req -addext in appstest.sh


# 1.27 05-Nov-2019 inoguchi

Remove trailing space in appstest.sh


# 1.26 05-Nov-2019 inoguchi

Add test for cms in appstest.sh


# 1.25 03-Nov-2019 inoguchi

Add RSA-PSS test for genpkey in appstest.sh


# 1.24 31-Oct-2019 inoguchi

Add RSA OAEP test for pkeyutl in appstest.sh


Revision tags: OPENBSD_6_6_BASE
# 1.23 17-Jul-2019 inoguchi

Update appstest.sh

- Add -modulus for dsa sub command
- Remove -nextprotoneg


# 1.22 27-Jun-2019 inoguchi

Add more option tests to req, ts, x509 and verify in appstest.sh


# 1.21 24-Jun-2019 inoguchi

Add more options test to ocsp in appstest.sh


# 1.20 23-Jun-2019 inoguchi

Add more option test to dgst in appstest.sh


# 1.19 22-Jun-2019 inoguchi

Add more option tests to ca in appstest.sh


# 1.18 13-Jun-2019 inoguchi

Add more options to pkcs12 and smime in appstest.sh


# 1.17 10-Jun-2019 inoguchi

Add pkcs12 options and smime tests for appstest.sh

- Add some options to pkcs12 test.
- Add smime tests for encrypt, decrypt and pk7out.


Revision tags: OPENBSD_6_5_BASE
# 1.16 16-Feb-2019 inoguchi

Add tests for pkeyutl


Revision tags: OPENBSD_6_4_BASE
# 1.15 15-Sep-2018 inoguchi

Modify regress appstest.sh for interoperability testing with OpenSSL 1.1.x

- add sleep before s_client instead of removing -pause option
- change check words for s_client output messages
- replace CAfile to CApath for s_time
- remove -prexit from s_client
- confirm openssl command path is executable


# 1.14 14-Sep-2018 inoguchi

Add interoperability test mode for regress appstest.sh

- test s_server and s_client between different version by option -i
- indicate other version by defining OTHER_OPENSSL environment variable
- fix "SSL/TLS" to "TLS/SSL", since TLS is correct as technical term
- s/SKIPPNG/SKIPPING/


# 1.13 08-Sep-2018 inoguchi

Fix indent and adjust line fit to 80 columns.


# 1.12 08-Sep-2018 inoguchi

Split test blocks into a function. Test contents are not changed.


# 1.11 08-Sep-2018 inoguchi

Test more ciphers and randomize the order in regress appstest.sh

- change test target ciphers
- randomize the test ciphers order
- display test cipher count


# 1.10 07-Sep-2018 inoguchi

tests all available TLSv1.2 ciphers


# 1.9 27-Aug-2018 inoguchi

Add protocol and cipher patterns in regress appstest.sh


# 1.8 26-Aug-2018 inoguchi

Stop s_server if error occurs in regress appstest.sh


# 1.7 23-Aug-2018 inoguchi

Add license header.


# 1.6 23-Aug-2018 inoguchi

Check reusing SSL/TLS session ticket by regression test

- Added checking for session ticket reusing with using openssl(1) s_server and
s_client command in appstest.sh
- Confirm certificate verification status.
- Save s_server message to log file.

ok tb@ and jsing@


# 1.5 10-Apr-2018 tb

tweak usage()


Revision tags: OPENBSD_6_3_BASE
# 1.4 19-Mar-2018 beck

Add a -q (for quick) mode to apptest.sh, and use it by default.
this means that running the regression test doesn't take forever
because we run a huge dhparam test and openssl speed tests.

ok inoguchi@


# 1.3 06-Feb-2018 tb

Respect the OPENSSL make variable everywhere so that

make OPENSSL=/usr/src/usr.bin/openssl/obj/openssl

actually does the expected thing instead of running a mixture of both the
openssl below /usr/obj and the one below /usr/bin. Found the hard way via
backtraces that made no sense whatsoever.

ok jsing


Revision tags: OPENBSD_6_1_BASE OPENBSD_6_2_BASE
# 1.2 27-Jan-2017 tom

More s/OSCP/OCSP/ typos

ok jmc@


# 1.1 06-Nov-2016 inoguchi

Add regress test script for openssl command.
ok beck@


# 1.58 24-Jul-2023 tb

remove errstr -stats test

reminded by anton


# 1.57 03-Jul-2023 beck

Stop testing tls 1.0 and 1.1

They have gone behind the barn.


# 1.56 26-Apr-2023 tb

Garbage collect test using the nseq command

reminded by anton


Revision tags: OPENBSD_7_2_BASE OPENBSD_7_3_BASE
# 1.55 14-Jul-2022 tb

Only run the client connection test with supported ciphers. Avoids test
breakage also noted by anton.


Revision tags: OPENBSD_7_1_BASE
# 1.54 05-Feb-2022 tb

Adapt appstest.sh for the new TLS_ names.


# 1.53 25-Oct-2021 tb

Drop two uses of the terrible asn1 kludge spotted by anton


Revision tags: OPENBSD_7_0_BASE
# 1.52 20-Sep-2021 inoguchi

Fix appstest.sh for testing with OpenSSL 3.0

- Fix 'Server Temp Key' check to work with both words "P-384" and "secp384r1".
- Test TLSv1 and TLSv1.1 only if OpenSSL version is 1.x.


# 1.51 21-Jun-2021 inoguchi

Add GnuTLS interoperability test in appstest.sh


# 1.50 12-May-2021 inoguchi

Modify cms test in appstest.sh to work with ec cert/key


# 1.49 27-Apr-2021 inoguchi

Add DTLS test in appstest.sh


# 1.48 24-Apr-2021 inoguchi

Remove "-4" option treatment and use it always on s_server test in appstest.sh


Revision tags: OPENBSD_6_9_BASE
# 1.47 26-Feb-2021 tb

zap spades of trailing whitespace


Revision tags: OPENBSD_6_8_BASE
# 1.46 01-Aug-2020 inoguchi

Replace hostname underscore with hyphen in appstest.sh


# 1.45 29-May-2020 inoguchi

Add checks for SH downgrade sentinel and HRR hash in appstest.sh


# 1.44 19-May-2020 inoguchi

Add -status and -servername test for s_server and s_client in appstest.sh


# 1.43 19-May-2020 inoguchi

Add -groups test for s_server and s_client in appstest.sh


# 1.42 18-May-2020 inoguchi

Add client certificate test in appstest.sh


# 1.41 18-May-2020 inoguchi

Rename variables for key, csr, pass, cert


# 1.40 17-May-2020 inoguchi

Add GOST certificate test in appstest.sh

Enabled by -g option, and default to disabled (RSA certificate is used)


# 1.39 17-May-2020 inoguchi

Suppress display output and reduce s_time to 1 sec in appstest.sh


# 1.38 17-May-2020 inoguchi

Fix server client test with TLSv1.3 in appstest.sh


# 1.37 15-May-2020 inoguchi

Factor out session reuse test and verification test


# 1.36 15-May-2020 inoguchi

Factor out the test for all available ciphers and add TLSv1.3 case


# 1.35 15-May-2020 inoguchi

Add ECDSA certificate test in appstest.sh

Enabled by -e option, and default to disabled (RSA certificate is used)


# 1.34 14-May-2020 inoguchi

Skip protocol version message check in appstest.sh

- OpenSSL1.1.1 with TLSv1.3 does not call SSL_SESSION_print() until NewSessionTicket arrival
- Shorten function name


# 1.33 14-May-2020 inoguchi

Factor out the protocol version test in appstest.sh

OTHER_OPENSSL default to eopenssl11


Revision tags: OPENBSD_6_7_BASE
# 1.32 26-Jan-2020 inoguchi

Restrict to use up to TLSv1.2 for test_server_client in appstest.sh

Currently, only s_client has TLSv1.3 and s_server does not.


# 1.31 25-Nov-2019 inoguchi

Add option for cms test in appstest.sh


# 1.30 24-Nov-2019 inoguchi

Add test for cms operations in appstest.sh


# 1.29 20-Nov-2019 inoguchi

Add test for cms -keyopt in appstest.sh


# 1.28 09-Nov-2019 inoguchi

Add test for req -addext in appstest.sh


# 1.27 05-Nov-2019 inoguchi

Remove trailing space in appstest.sh


# 1.26 05-Nov-2019 inoguchi

Add test for cms in appstest.sh


# 1.25 03-Nov-2019 inoguchi

Add RSA-PSS test for genpkey in appstest.sh


# 1.24 31-Oct-2019 inoguchi

Add RSA OAEP test for pkeyutl in appstest.sh


Revision tags: OPENBSD_6_6_BASE
# 1.23 17-Jul-2019 inoguchi

Update appstest.sh

- Add -modulus for dsa sub command
- Remove -nextprotoneg


# 1.22 27-Jun-2019 inoguchi

Add more option tests to req, ts, x509 and verify in appstest.sh


# 1.21 24-Jun-2019 inoguchi

Add more options test to ocsp in appstest.sh


# 1.20 23-Jun-2019 inoguchi

Add more option test to dgst in appstest.sh


# 1.19 22-Jun-2019 inoguchi

Add more option tests to ca in appstest.sh


# 1.18 13-Jun-2019 inoguchi

Add more options to pkcs12 and smime in appstest.sh


# 1.17 10-Jun-2019 inoguchi

Add pkcs12 options and smime tests for appstest.sh

- Add some options to pkcs12 test.
- Add smime tests for encrypt, decrypt and pk7out.


Revision tags: OPENBSD_6_5_BASE
# 1.16 16-Feb-2019 inoguchi

Add tests for pkeyutl


Revision tags: OPENBSD_6_4_BASE
# 1.15 15-Sep-2018 inoguchi

Modify regress appstest.sh for interoperability testing with OpenSSL 1.1.x

- add sleep before s_client instead of removing -pause option
- change check words for s_client output messages
- replace CAfile to CApath for s_time
- remove -prexit from s_client
- confirm openssl command path is executable


# 1.14 14-Sep-2018 inoguchi

Add interoperability test mode for regress appstest.sh

- test s_server and s_client between different version by option -i
- indicate other version by defining OTHER_OPENSSL environment variable
- fix "SSL/TLS" to "TLS/SSL", since TLS is correct as technical term
- s/SKIPPNG/SKIPPING/


# 1.13 08-Sep-2018 inoguchi

Fix indent and adjust line fit to 80 columns.


# 1.12 08-Sep-2018 inoguchi

Split test blocks into a function. Test contents are not changed.


# 1.11 08-Sep-2018 inoguchi

Test more ciphers and randomize the order in regress appstest.sh

- change test target ciphers
- randomize the test ciphers order
- display test cipher count


# 1.10 07-Sep-2018 inoguchi

tests all available TLSv1.2 ciphers


# 1.9 27-Aug-2018 inoguchi

Add protocol and cipher patterns in regress appstest.sh


# 1.8 26-Aug-2018 inoguchi

Stop s_server if error occurs in regress appstest.sh


# 1.7 23-Aug-2018 inoguchi

Add license header.


# 1.6 23-Aug-2018 inoguchi

Check reusing SSL/TLS session ticket by regression test

- Added checking for session ticket reusing with using openssl(1) s_server and
s_client command in appstest.sh
- Confirm certificate verification status.
- Save s_server message to log file.

ok tb@ and jsing@


# 1.5 10-Apr-2018 tb

tweak usage()


Revision tags: OPENBSD_6_3_BASE
# 1.4 19-Mar-2018 beck

Add a -q (for quick) mode to apptest.sh, and use it by default.
this means that running the regression test doesn't take forever
because we run a huge dhparam test and openssl speed tests.

ok inoguchi@


# 1.3 06-Feb-2018 tb

Respect the OPENSSL make variable everywhere so that

make OPENSSL=/usr/src/usr.bin/openssl/obj/openssl

actually does the expected thing instead of running a mixture of both the
openssl below /usr/obj and the one below /usr/bin. Found the hard way via
backtraces that made no sense whatsoever.

ok jsing


Revision tags: OPENBSD_6_1_BASE OPENBSD_6_2_BASE
# 1.2 27-Jan-2017 tom

More s/OSCP/OCSP/ typos

ok jmc@


# 1.1 06-Nov-2016 inoguchi

Add regress test script for openssl command.
ok beck@


# 1.57 03-Jul-2023 beck

Stop testing tls 1.0 and 1.1

They have gone behind the barn.


# 1.56 26-Apr-2023 tb

Garbage collect test using the nseq command

reminded by anton


Revision tags: OPENBSD_7_2_BASE OPENBSD_7_3_BASE
# 1.55 14-Jul-2022 tb

Only run the client connection test with supported ciphers. Avoids test
breakage also noted by anton.


Revision tags: OPENBSD_7_1_BASE
# 1.54 05-Feb-2022 tb

Adapt appstest.sh for the new TLS_ names.


# 1.53 25-Oct-2021 tb

Drop two uses of the terrible asn1 kludge spotted by anton


Revision tags: OPENBSD_7_0_BASE
# 1.52 20-Sep-2021 inoguchi

Fix appstest.sh for testing with OpenSSL 3.0

- Fix 'Server Temp Key' check to work with both words "P-384" and "secp384r1".
- Test TLSv1 and TLSv1.1 only if OpenSSL version is 1.x.


# 1.51 21-Jun-2021 inoguchi

Add GnuTLS interoperability test in appstest.sh


# 1.50 12-May-2021 inoguchi

Modify cms test in appstest.sh to work with ec cert/key


# 1.49 27-Apr-2021 inoguchi

Add DTLS test in appstest.sh


# 1.48 24-Apr-2021 inoguchi

Remove "-4" option treatment and use it always on s_server test in appstest.sh


Revision tags: OPENBSD_6_9_BASE
# 1.47 26-Feb-2021 tb

zap spades of trailing whitespace


Revision tags: OPENBSD_6_8_BASE
# 1.46 01-Aug-2020 inoguchi

Replace hostname underscore with hyphen in appstest.sh


# 1.45 29-May-2020 inoguchi

Add checks for SH downgrade sentinel and HRR hash in appstest.sh


# 1.44 19-May-2020 inoguchi

Add -status and -servername test for s_server and s_client in appstest.sh


# 1.43 19-May-2020 inoguchi

Add -groups test for s_server and s_client in appstest.sh


# 1.42 18-May-2020 inoguchi

Add client certificate test in appstest.sh


# 1.41 18-May-2020 inoguchi

Rename variables for key, csr, pass, cert


# 1.40 17-May-2020 inoguchi

Add GOST certificate test in appstest.sh

Enabled by -g option, and default to disabled (RSA certificate is used)


# 1.39 17-May-2020 inoguchi

Suppress display output and reduce s_time to 1 sec in appstest.sh


# 1.38 17-May-2020 inoguchi

Fix server client test with TLSv1.3 in appstest.sh


# 1.37 15-May-2020 inoguchi

Factor out session reuse test and verification test


# 1.36 15-May-2020 inoguchi

Factor out the test for all available ciphers and add TLSv1.3 case


# 1.35 15-May-2020 inoguchi

Add ECDSA certificate test in appstest.sh

Enabled by -e option, and default to disabled (RSA certificate is used)


# 1.34 14-May-2020 inoguchi

Skip protocol version message check in appstest.sh

- OpenSSL1.1.1 with TLSv1.3 does not call SSL_SESSION_print() until NewSessionTicket arrival
- Shorten function name


# 1.33 14-May-2020 inoguchi

Factor out the protocol version test in appstest.sh

OTHER_OPENSSL default to eopenssl11


Revision tags: OPENBSD_6_7_BASE
# 1.32 26-Jan-2020 inoguchi

Restrict to use up to TLSv1.2 for test_server_client in appstest.sh

Currently, only s_client has TLSv1.3 and s_server does not.


# 1.31 25-Nov-2019 inoguchi

Add option for cms test in appstest.sh


# 1.30 24-Nov-2019 inoguchi

Add test for cms operations in appstest.sh


# 1.29 20-Nov-2019 inoguchi

Add test for cms -keyopt in appstest.sh


# 1.28 09-Nov-2019 inoguchi

Add test for req -addext in appstest.sh


# 1.27 05-Nov-2019 inoguchi

Remove trailing space in appstest.sh


# 1.26 05-Nov-2019 inoguchi

Add test for cms in appstest.sh


# 1.25 03-Nov-2019 inoguchi

Add RSA-PSS test for genpkey in appstest.sh


# 1.24 31-Oct-2019 inoguchi

Add RSA OAEP test for pkeyutl in appstest.sh


Revision tags: OPENBSD_6_6_BASE
# 1.23 17-Jul-2019 inoguchi

Update appstest.sh

- Add -modulus for dsa sub command
- Remove -nextprotoneg


# 1.22 27-Jun-2019 inoguchi

Add more option tests to req, ts, x509 and verify in appstest.sh


# 1.21 24-Jun-2019 inoguchi

Add more options test to ocsp in appstest.sh


# 1.20 23-Jun-2019 inoguchi

Add more option test to dgst in appstest.sh


# 1.19 22-Jun-2019 inoguchi

Add more option tests to ca in appstest.sh


# 1.18 13-Jun-2019 inoguchi

Add more options to pkcs12 and smime in appstest.sh


# 1.17 10-Jun-2019 inoguchi

Add pkcs12 options and smime tests for appstest.sh

- Add some options to pkcs12 test.
- Add smime tests for encrypt, decrypt and pk7out.


Revision tags: OPENBSD_6_5_BASE
# 1.16 16-Feb-2019 inoguchi

Add tests for pkeyutl


Revision tags: OPENBSD_6_4_BASE
# 1.15 15-Sep-2018 inoguchi

Modify regress appstest.sh for interoperability testing with OpenSSL 1.1.x

- add sleep before s_client instead of removing -pause option
- change check words for s_client output messages
- replace CAfile to CApath for s_time
- remove -prexit from s_client
- confirm openssl command path is executable


# 1.14 14-Sep-2018 inoguchi

Add interoperability test mode for regress appstest.sh

- test s_server and s_client between different version by option -i
- indicate other version by defining OTHER_OPENSSL environment variable
- fix "SSL/TLS" to "TLS/SSL", since TLS is correct as technical term
- s/SKIPPNG/SKIPPING/


# 1.13 08-Sep-2018 inoguchi

Fix indent and adjust line fit to 80 columns.


# 1.12 08-Sep-2018 inoguchi

Split test blocks into a function. Test contents are not changed.


# 1.11 08-Sep-2018 inoguchi

Test more ciphers and randomize the order in regress appstest.sh

- change test target ciphers
- randomize the test ciphers order
- display test cipher count


# 1.10 07-Sep-2018 inoguchi

tests all available TLSv1.2 ciphers


# 1.9 27-Aug-2018 inoguchi

Add protocol and cipher patterns in regress appstest.sh


# 1.8 26-Aug-2018 inoguchi

Stop s_server if error occurs in regress appstest.sh


# 1.7 23-Aug-2018 inoguchi

Add license header.


# 1.6 23-Aug-2018 inoguchi

Check reusing SSL/TLS session ticket by regression test

- Added checking for session ticket reusing with using openssl(1) s_server and
s_client command in appstest.sh
- Confirm certificate verification status.
- Save s_server message to log file.

ok tb@ and jsing@


# 1.5 10-Apr-2018 tb

tweak usage()


Revision tags: OPENBSD_6_3_BASE
# 1.4 19-Mar-2018 beck

Add a -q (for quick) mode to apptest.sh, and use it by default.
this means that running the regression test doesn't take forever
because we run a huge dhparam test and openssl speed tests.

ok inoguchi@


# 1.3 06-Feb-2018 tb

Respect the OPENSSL make variable everywhere so that

make OPENSSL=/usr/src/usr.bin/openssl/obj/openssl

actually does the expected thing instead of running a mixture of both the
openssl below /usr/obj and the one below /usr/bin. Found the hard way via
backtraces that made no sense whatsoever.

ok jsing


Revision tags: OPENBSD_6_1_BASE OPENBSD_6_2_BASE
# 1.2 27-Jan-2017 tom

More s/OSCP/OCSP/ typos

ok jmc@


# 1.1 06-Nov-2016 inoguchi

Add regress test script for openssl command.
ok beck@


# 1.56 26-Apr-2023 tb

Garbage collect test using the nseq command

reminded by anton


Revision tags: OPENBSD_7_2_BASE OPENBSD_7_3_BASE
# 1.55 14-Jul-2022 tb

Only run the client connection test with supported ciphers. Avoids test
breakage also noted by anton.


Revision tags: OPENBSD_7_1_BASE
# 1.54 05-Feb-2022 tb

Adapt appstest.sh for the new TLS_ names.


# 1.53 25-Oct-2021 tb

Drop two uses of the terrible asn1 kludge spotted by anton


Revision tags: OPENBSD_7_0_BASE
# 1.52 20-Sep-2021 inoguchi

Fix appstest.sh for testing with OpenSSL 3.0

- Fix 'Server Temp Key' check to work with both words "P-384" and "secp384r1".
- Test TLSv1 and TLSv1.1 only if OpenSSL version is 1.x.


# 1.51 21-Jun-2021 inoguchi

Add GnuTLS interoperability test in appstest.sh


# 1.50 12-May-2021 inoguchi

Modify cms test in appstest.sh to work with ec cert/key


# 1.49 27-Apr-2021 inoguchi

Add DTLS test in appstest.sh


# 1.48 24-Apr-2021 inoguchi

Remove "-4" option treatment and use it always on s_server test in appstest.sh


Revision tags: OPENBSD_6_9_BASE
# 1.47 26-Feb-2021 tb

zap spades of trailing whitespace


Revision tags: OPENBSD_6_8_BASE
# 1.46 01-Aug-2020 inoguchi

Replace hostname underscore with hyphen in appstest.sh


# 1.45 29-May-2020 inoguchi

Add checks for SH downgrade sentinel and HRR hash in appstest.sh


# 1.44 19-May-2020 inoguchi

Add -status and -servername test for s_server and s_client in appstest.sh


# 1.43 19-May-2020 inoguchi

Add -groups test for s_server and s_client in appstest.sh


# 1.42 18-May-2020 inoguchi

Add client certificate test in appstest.sh


# 1.41 18-May-2020 inoguchi

Rename variables for key, csr, pass, cert


# 1.40 17-May-2020 inoguchi

Add GOST certificate test in appstest.sh

Enabled by -g option, and default to disabled (RSA certificate is used)


# 1.39 17-May-2020 inoguchi

Suppress display output and reduce s_time to 1 sec in appstest.sh


# 1.38 17-May-2020 inoguchi

Fix server client test with TLSv1.3 in appstest.sh


# 1.37 15-May-2020 inoguchi

Factor out session reuse test and verification test


# 1.36 15-May-2020 inoguchi

Factor out the test for all available ciphers and add TLSv1.3 case


# 1.35 15-May-2020 inoguchi

Add ECDSA certificate test in appstest.sh

Enabled by -e option, and default to disabled (RSA certificate is used)


# 1.34 14-May-2020 inoguchi

Skip protocol version message check in appstest.sh

- OpenSSL1.1.1 with TLSv1.3 does not call SSL_SESSION_print() until NewSessionTicket arrival
- Shorten function name


# 1.33 14-May-2020 inoguchi

Factor out the protocol version test in appstest.sh

OTHER_OPENSSL default to eopenssl11


Revision tags: OPENBSD_6_7_BASE
# 1.32 26-Jan-2020 inoguchi

Restrict to use up to TLSv1.2 for test_server_client in appstest.sh

Currently, only s_client has TLSv1.3 and s_server does not.


# 1.31 25-Nov-2019 inoguchi

Add option for cms test in appstest.sh


# 1.30 24-Nov-2019 inoguchi

Add test for cms operations in appstest.sh


# 1.29 20-Nov-2019 inoguchi

Add test for cms -keyopt in appstest.sh


# 1.28 09-Nov-2019 inoguchi

Add test for req -addext in appstest.sh


# 1.27 05-Nov-2019 inoguchi

Remove trailing space in appstest.sh


# 1.26 05-Nov-2019 inoguchi

Add test for cms in appstest.sh


# 1.25 03-Nov-2019 inoguchi

Add RSA-PSS test for genpkey in appstest.sh


# 1.24 31-Oct-2019 inoguchi

Add RSA OAEP test for pkeyutl in appstest.sh


Revision tags: OPENBSD_6_6_BASE
# 1.23 17-Jul-2019 inoguchi

Update appstest.sh

- Add -modulus for dsa sub command
- Remove -nextprotoneg


# 1.22 27-Jun-2019 inoguchi

Add more option tests to req, ts, x509 and verify in appstest.sh


# 1.21 24-Jun-2019 inoguchi

Add more options test to ocsp in appstest.sh


# 1.20 23-Jun-2019 inoguchi

Add more option test to dgst in appstest.sh


# 1.19 22-Jun-2019 inoguchi

Add more option tests to ca in appstest.sh


# 1.18 13-Jun-2019 inoguchi

Add more options to pkcs12 and smime in appstest.sh


# 1.17 10-Jun-2019 inoguchi

Add pkcs12 options and smime tests for appstest.sh

- Add some options to pkcs12 test.
- Add smime tests for encrypt, decrypt and pk7out.


Revision tags: OPENBSD_6_5_BASE
# 1.16 16-Feb-2019 inoguchi

Add tests for pkeyutl


Revision tags: OPENBSD_6_4_BASE
# 1.15 15-Sep-2018 inoguchi

Modify regress appstest.sh for interoperability testing with OpenSSL 1.1.x

- add sleep before s_client instead of removing -pause option
- change check words for s_client output messages
- replace CAfile to CApath for s_time
- remove -prexit from s_client
- confirm openssl command path is executable


# 1.14 14-Sep-2018 inoguchi

Add interoperability test mode for regress appstest.sh

- test s_server and s_client between different version by option -i
- indicate other version by defining OTHER_OPENSSL environment variable
- fix "SSL/TLS" to "TLS/SSL", since TLS is correct as technical term
- s/SKIPPNG/SKIPPING/


# 1.13 08-Sep-2018 inoguchi

Fix indent and adjust line fit to 80 columns.


# 1.12 08-Sep-2018 inoguchi

Split test blocks into a function. Test contents are not changed.


# 1.11 08-Sep-2018 inoguchi

Test more ciphers and randomize the order in regress appstest.sh

- change test target ciphers
- randomize the test ciphers order
- display test cipher count


# 1.10 07-Sep-2018 inoguchi

tests all available TLSv1.2 ciphers


# 1.9 27-Aug-2018 inoguchi

Add protocol and cipher patterns in regress appstest.sh


# 1.8 26-Aug-2018 inoguchi

Stop s_server if error occurs in regress appstest.sh


# 1.7 23-Aug-2018 inoguchi

Add license header.


# 1.6 23-Aug-2018 inoguchi

Check reusing SSL/TLS session ticket by regression test

- Added checking for session ticket reusing with using openssl(1) s_server and
s_client command in appstest.sh
- Confirm certificate verification status.
- Save s_server message to log file.

ok tb@ and jsing@


# 1.5 10-Apr-2018 tb

tweak usage()


Revision tags: OPENBSD_6_3_BASE
# 1.4 19-Mar-2018 beck

Add a -q (for quick) mode to apptest.sh, and use it by default.
this means that running the regression test doesn't take forever
because we run a huge dhparam test and openssl speed tests.

ok inoguchi@


# 1.3 06-Feb-2018 tb

Respect the OPENSSL make variable everywhere so that

make OPENSSL=/usr/src/usr.bin/openssl/obj/openssl

actually does the expected thing instead of running a mixture of both the
openssl below /usr/obj and the one below /usr/bin. Found the hard way via
backtraces that made no sense whatsoever.

ok jsing


Revision tags: OPENBSD_6_1_BASE OPENBSD_6_2_BASE
# 1.2 27-Jan-2017 tom

More s/OSCP/OCSP/ typos

ok jmc@


# 1.1 06-Nov-2016 inoguchi

Add regress test script for openssl command.
ok beck@


# 1.55 14-Jul-2022 tb

Only run the client connection test with supported ciphers. Avoids test
breakage also noted by anton.


Revision tags: OPENBSD_7_1_BASE
# 1.54 05-Feb-2022 tb

Adapt appstest.sh for the new TLS_ names.


# 1.53 25-Oct-2021 tb

Drop two uses of the terrible asn1 kludge spotted by anton


Revision tags: OPENBSD_7_0_BASE
# 1.52 20-Sep-2021 inoguchi

Fix appstest.sh for testing with OpenSSL 3.0

- Fix 'Server Temp Key' check to work with both words "P-384" and "secp384r1".
- Test TLSv1 and TLSv1.1 only if OpenSSL version is 1.x.


# 1.51 21-Jun-2021 inoguchi

Add GnuTLS interoperability test in appstest.sh


# 1.50 12-May-2021 inoguchi

Modify cms test in appstest.sh to work with ec cert/key


# 1.49 27-Apr-2021 inoguchi

Add DTLS test in appstest.sh


# 1.48 24-Apr-2021 inoguchi

Remove "-4" option treatment and use it always on s_server test in appstest.sh


Revision tags: OPENBSD_6_9_BASE
# 1.47 26-Feb-2021 tb

zap spades of trailing whitespace


Revision tags: OPENBSD_6_8_BASE
# 1.46 01-Aug-2020 inoguchi

Replace hostname underscore with hyphen in appstest.sh


# 1.45 29-May-2020 inoguchi

Add checks for SH downgrade sentinel and HRR hash in appstest.sh


# 1.44 19-May-2020 inoguchi

Add -status and -servername test for s_server and s_client in appstest.sh


# 1.43 19-May-2020 inoguchi

Add -groups test for s_server and s_client in appstest.sh


# 1.42 18-May-2020 inoguchi

Add client certificate test in appstest.sh


# 1.41 18-May-2020 inoguchi

Rename variables for key, csr, pass, cert


# 1.40 17-May-2020 inoguchi

Add GOST certificate test in appstest.sh

Enabled by -g option, and default to disabled (RSA certificate is used)


# 1.39 17-May-2020 inoguchi

Suppress display output and reduce s_time to 1 sec in appstest.sh


# 1.38 17-May-2020 inoguchi

Fix server client test with TLSv1.3 in appstest.sh


# 1.37 15-May-2020 inoguchi

Factor out session reuse test and verification test


# 1.36 15-May-2020 inoguchi

Factor out the test for all available ciphers and add TLSv1.3 case


# 1.35 15-May-2020 inoguchi

Add ECDSA certificate test in appstest.sh

Enabled by -e option, and default to disabled (RSA certificate is used)


# 1.34 14-May-2020 inoguchi

Skip protocol version message check in appstest.sh

- OpenSSL1.1.1 with TLSv1.3 does not call SSL_SESSION_print() until NewSessionTicket arrival
- Shorten function name


# 1.33 14-May-2020 inoguchi

Factor out the protocol version test in appstest.sh

OTHER_OPENSSL default to eopenssl11


Revision tags: OPENBSD_6_7_BASE
# 1.32 26-Jan-2020 inoguchi

Restrict to use up to TLSv1.2 for test_server_client in appstest.sh

Currently, only s_client has TLSv1.3 and s_server does not.


# 1.31 25-Nov-2019 inoguchi

Add option for cms test in appstest.sh


# 1.30 24-Nov-2019 inoguchi

Add test for cms operations in appstest.sh


# 1.29 20-Nov-2019 inoguchi

Add test for cms -keyopt in appstest.sh


# 1.28 09-Nov-2019 inoguchi

Add test for req -addext in appstest.sh


# 1.27 05-Nov-2019 inoguchi

Remove trailing space in appstest.sh


# 1.26 05-Nov-2019 inoguchi

Add test for cms in appstest.sh


# 1.25 03-Nov-2019 inoguchi

Add RSA-PSS test for genpkey in appstest.sh


# 1.24 31-Oct-2019 inoguchi

Add RSA OAEP test for pkeyutl in appstest.sh


Revision tags: OPENBSD_6_6_BASE
# 1.23 17-Jul-2019 inoguchi

Update appstest.sh

- Add -modulus for dsa sub command
- Remove -nextprotoneg


# 1.22 27-Jun-2019 inoguchi

Add more option tests to req, ts, x509 and verify in appstest.sh


# 1.21 24-Jun-2019 inoguchi

Add more options test to ocsp in appstest.sh


# 1.20 23-Jun-2019 inoguchi

Add more option test to dgst in appstest.sh


# 1.19 22-Jun-2019 inoguchi

Add more option tests to ca in appstest.sh


# 1.18 13-Jun-2019 inoguchi

Add more options to pkcs12 and smime in appstest.sh


# 1.17 10-Jun-2019 inoguchi

Add pkcs12 options and smime tests for appstest.sh

- Add some options to pkcs12 test.
- Add smime tests for encrypt, decrypt and pk7out.


Revision tags: OPENBSD_6_5_BASE
# 1.16 16-Feb-2019 inoguchi

Add tests for pkeyutl


Revision tags: OPENBSD_6_4_BASE
# 1.15 15-Sep-2018 inoguchi

Modify regress appstest.sh for interoperability testing with OpenSSL 1.1.x

- add sleep before s_client instead of removing -pause option
- change check words for s_client output messages
- replace CAfile to CApath for s_time
- remove -prexit from s_client
- confirm openssl command path is executable


# 1.14 14-Sep-2018 inoguchi

Add interoperability test mode for regress appstest.sh

- test s_server and s_client between different version by option -i
- indicate other version by defining OTHER_OPENSSL environment variable
- fix "SSL/TLS" to "TLS/SSL", since TLS is correct as technical term
- s/SKIPPNG/SKIPPING/


# 1.13 08-Sep-2018 inoguchi

Fix indent and adjust line fit to 80 columns.


# 1.12 08-Sep-2018 inoguchi

Split test blocks into a function. Test contents are not changed.


# 1.11 08-Sep-2018 inoguchi

Test more ciphers and randomize the order in regress appstest.sh

- change test target ciphers
- randomize the test ciphers order
- display test cipher count


# 1.10 07-Sep-2018 inoguchi

tests all available TLSv1.2 ciphers


# 1.9 27-Aug-2018 inoguchi

Add protocol and cipher patterns in regress appstest.sh


# 1.8 26-Aug-2018 inoguchi

Stop s_server if error occurs in regress appstest.sh


# 1.7 23-Aug-2018 inoguchi

Add license header.


# 1.6 23-Aug-2018 inoguchi

Check reusing SSL/TLS session ticket by regression test

- Added checking for session ticket reusing with using openssl(1) s_server and
s_client command in appstest.sh
- Confirm certificate verification status.
- Save s_server message to log file.

ok tb@ and jsing@


# 1.5 10-Apr-2018 tb

tweak usage()


Revision tags: OPENBSD_6_3_BASE
# 1.4 19-Mar-2018 beck

Add a -q (for quick) mode to apptest.sh, and use it by default.
this means that running the regression test doesn't take forever
because we run a huge dhparam test and openssl speed tests.

ok inoguchi@


# 1.3 06-Feb-2018 tb

Respect the OPENSSL make variable everywhere so that

make OPENSSL=/usr/src/usr.bin/openssl/obj/openssl

actually does the expected thing instead of running a mixture of both the
openssl below /usr/obj and the one below /usr/bin. Found the hard way via
backtraces that made no sense whatsoever.

ok jsing


Revision tags: OPENBSD_6_1_BASE OPENBSD_6_2_BASE
# 1.2 27-Jan-2017 tom

More s/OSCP/OCSP/ typos

ok jmc@


# 1.1 06-Nov-2016 inoguchi

Add regress test script for openssl command.
ok beck@


# 1.54 05-Feb-2022 tb

Adapt appstest.sh for the new TLS_ names.


# 1.53 25-Oct-2021 tb

Drop two uses of the terrible asn1 kludge spotted by anton


Revision tags: OPENBSD_7_0_BASE
# 1.52 20-Sep-2021 inoguchi

Fix appstest.sh for testing with OpenSSL 3.0

- Fix 'Server Temp Key' check to work with both words "P-384" and "secp384r1".
- Test TLSv1 and TLSv1.1 only if OpenSSL version is 1.x.


# 1.51 21-Jun-2021 inoguchi

Add GnuTLS interoperability test in appstest.sh


# 1.50 12-May-2021 inoguchi

Modify cms test in appstest.sh to work with ec cert/key


# 1.49 27-Apr-2021 inoguchi

Add DTLS test in appstest.sh


# 1.48 24-Apr-2021 inoguchi

Remove "-4" option treatment and use it always on s_server test in appstest.sh


Revision tags: OPENBSD_6_9_BASE
# 1.47 26-Feb-2021 tb

zap spades of trailing whitespace


Revision tags: OPENBSD_6_8_BASE
# 1.46 01-Aug-2020 inoguchi

Replace hostname underscore with hyphen in appstest.sh


# 1.45 29-May-2020 inoguchi

Add checks for SH downgrade sentinel and HRR hash in appstest.sh


# 1.44 19-May-2020 inoguchi

Add -status and -servername test for s_server and s_client in appstest.sh


# 1.43 19-May-2020 inoguchi

Add -groups test for s_server and s_client in appstest.sh


# 1.42 18-May-2020 inoguchi

Add client certificate test in appstest.sh


# 1.41 18-May-2020 inoguchi

Rename variables for key, csr, pass, cert


# 1.40 17-May-2020 inoguchi

Add GOST certificate test in appstest.sh

Enabled by -g option, and default to disabled (RSA certificate is used)


# 1.39 17-May-2020 inoguchi

Suppress display output and reduce s_time to 1 sec in appstest.sh


# 1.38 17-May-2020 inoguchi

Fix server client test with TLSv1.3 in appstest.sh


# 1.37 15-May-2020 inoguchi

Factor out session reuse test and verification test


# 1.36 15-May-2020 inoguchi

Factor out the test for all available ciphers and add TLSv1.3 case


# 1.35 15-May-2020 inoguchi

Add ECDSA certificate test in appstest.sh

Enabled by -e option, and default to disabled (RSA certificate is used)


# 1.34 14-May-2020 inoguchi

Skip protocol version message check in appstest.sh

- OpenSSL1.1.1 with TLSv1.3 does not call SSL_SESSION_print() until NewSessionTicket arrival
- Shorten function name


# 1.33 14-May-2020 inoguchi

Factor out the protocol version test in appstest.sh

OTHER_OPENSSL default to eopenssl11


Revision tags: OPENBSD_6_7_BASE
# 1.32 26-Jan-2020 inoguchi

Restrict to use up to TLSv1.2 for test_server_client in appstest.sh

Currently, only s_client has TLSv1.3 and s_server does not.


# 1.31 25-Nov-2019 inoguchi

Add option for cms test in appstest.sh


# 1.30 24-Nov-2019 inoguchi

Add test for cms operations in appstest.sh


# 1.29 20-Nov-2019 inoguchi

Add test for cms -keyopt in appstest.sh


# 1.28 09-Nov-2019 inoguchi

Add test for req -addext in appstest.sh


# 1.27 05-Nov-2019 inoguchi

Remove trailing space in appstest.sh


# 1.26 05-Nov-2019 inoguchi

Add test for cms in appstest.sh


# 1.25 03-Nov-2019 inoguchi

Add RSA-PSS test for genpkey in appstest.sh


# 1.24 31-Oct-2019 inoguchi

Add RSA OAEP test for pkeyutl in appstest.sh


Revision tags: OPENBSD_6_6_BASE
# 1.23 17-Jul-2019 inoguchi

Update appstest.sh

- Add -modulus for dsa sub command
- Remove -nextprotoneg


# 1.22 27-Jun-2019 inoguchi

Add more option tests to req, ts, x509 and verify in appstest.sh


# 1.21 24-Jun-2019 inoguchi

Add more options test to ocsp in appstest.sh


# 1.20 23-Jun-2019 inoguchi

Add more option test to dgst in appstest.sh


# 1.19 22-Jun-2019 inoguchi

Add more option tests to ca in appstest.sh


# 1.18 13-Jun-2019 inoguchi

Add more options to pkcs12 and smime in appstest.sh


# 1.17 10-Jun-2019 inoguchi

Add pkcs12 options and smime tests for appstest.sh

- Add some options to pkcs12 test.
- Add smime tests for encrypt, decrypt and pk7out.


Revision tags: OPENBSD_6_5_BASE
# 1.16 16-Feb-2019 inoguchi

Add tests for pkeyutl


Revision tags: OPENBSD_6_4_BASE
# 1.15 15-Sep-2018 inoguchi

Modify regress appstest.sh for interoperability testing with OpenSSL 1.1.x

- add sleep before s_client instead of removing -pause option
- change check words for s_client output messages
- replace CAfile to CApath for s_time
- remove -prexit from s_client
- confirm openssl command path is executable


# 1.14 14-Sep-2018 inoguchi

Add interoperability test mode for regress appstest.sh

- test s_server and s_client between different version by option -i
- indicate other version by defining OTHER_OPENSSL environment variable
- fix "SSL/TLS" to "TLS/SSL", since TLS is correct as technical term
- s/SKIPPNG/SKIPPING/


# 1.13 08-Sep-2018 inoguchi

Fix indent and adjust line fit to 80 columns.


# 1.12 08-Sep-2018 inoguchi

Split test blocks into a function. Test contents are not changed.


# 1.11 08-Sep-2018 inoguchi

Test more ciphers and randomize the order in regress appstest.sh

- change test target ciphers
- randomize the test ciphers order
- display test cipher count


# 1.10 07-Sep-2018 inoguchi

tests all available TLSv1.2 ciphers


# 1.9 27-Aug-2018 inoguchi

Add protocol and cipher patterns in regress appstest.sh


# 1.8 26-Aug-2018 inoguchi

Stop s_server if error occurs in regress appstest.sh


# 1.7 23-Aug-2018 inoguchi

Add license header.


# 1.6 23-Aug-2018 inoguchi

Check reusing SSL/TLS session ticket by regression test

- Added checking for session ticket reusing with using openssl(1) s_server and
s_client command in appstest.sh
- Confirm certificate verification status.
- Save s_server message to log file.

ok tb@ and jsing@


# 1.5 10-Apr-2018 tb

tweak usage()


Revision tags: OPENBSD_6_3_BASE
# 1.4 19-Mar-2018 beck

Add a -q (for quick) mode to apptest.sh, and use it by default.
this means that running the regression test doesn't take forever
because we run a huge dhparam test and openssl speed tests.

ok inoguchi@


# 1.3 06-Feb-2018 tb

Respect the OPENSSL make variable everywhere so that

make OPENSSL=/usr/src/usr.bin/openssl/obj/openssl

actually does the expected thing instead of running a mixture of both the
openssl below /usr/obj and the one below /usr/bin. Found the hard way via
backtraces that made no sense whatsoever.

ok jsing


Revision tags: OPENBSD_6_1_BASE OPENBSD_6_2_BASE
# 1.2 27-Jan-2017 tom

More s/OSCP/OCSP/ typos

ok jmc@


# 1.1 06-Nov-2016 inoguchi

Add regress test script for openssl command.
ok beck@


# 1.53 25-Oct-2021 tb

Drop two uses of the terrible asn1 kludge spotted by anton


Revision tags: OPENBSD_7_0_BASE
# 1.52 20-Sep-2021 inoguchi

Fix appstest.sh for testing with OpenSSL 3.0

- Fix 'Server Temp Key' check to work with both words "P-384" and "secp384r1".
- Test TLSv1 and TLSv1.1 only if OpenSSL version is 1.x.


# 1.51 21-Jun-2021 inoguchi

Add GnuTLS interoperability test in appstest.sh


# 1.50 12-May-2021 inoguchi

Modify cms test in appstest.sh to work with ec cert/key


# 1.49 27-Apr-2021 inoguchi

Add DTLS test in appstest.sh


# 1.48 24-Apr-2021 inoguchi

Remove "-4" option treatment and use it always on s_server test in appstest.sh


Revision tags: OPENBSD_6_9_BASE
# 1.47 26-Feb-2021 tb

zap spades of trailing whitespace


Revision tags: OPENBSD_6_8_BASE
# 1.46 01-Aug-2020 inoguchi

Replace hostname underscore with hyphen in appstest.sh


# 1.45 29-May-2020 inoguchi

Add checks for SH downgrade sentinel and HRR hash in appstest.sh


# 1.44 19-May-2020 inoguchi

Add -status and -servername test for s_server and s_client in appstest.sh


# 1.43 19-May-2020 inoguchi

Add -groups test for s_server and s_client in appstest.sh


# 1.42 18-May-2020 inoguchi

Add client certificate test in appstest.sh


# 1.41 18-May-2020 inoguchi

Rename variables for key, csr, pass, cert


# 1.40 17-May-2020 inoguchi

Add GOST certificate test in appstest.sh

Enabled by -g option, and default to disabled (RSA certificate is used)


# 1.39 17-May-2020 inoguchi

Suppress display output and reduce s_time to 1 sec in appstest.sh


# 1.38 17-May-2020 inoguchi

Fix server client test with TLSv1.3 in appstest.sh


# 1.37 15-May-2020 inoguchi

Factor out session reuse test and verification test


# 1.36 15-May-2020 inoguchi

Factor out the test for all available ciphers and add TLSv1.3 case


# 1.35 15-May-2020 inoguchi

Add ECDSA certificate test in appstest.sh

Enabled by -e option, and default to disabled (RSA certificate is used)


# 1.34 14-May-2020 inoguchi

Skip protocol version message check in appstest.sh

- OpenSSL1.1.1 with TLSv1.3 does not call SSL_SESSION_print() until NewSessionTicket arrival
- Shorten function name


# 1.33 14-May-2020 inoguchi

Factor out the protocol version test in appstest.sh

OTHER_OPENSSL default to eopenssl11


Revision tags: OPENBSD_6_7_BASE
# 1.32 26-Jan-2020 inoguchi

Restrict to use up to TLSv1.2 for test_server_client in appstest.sh

Currently, only s_client has TLSv1.3 and s_server does not.


# 1.31 25-Nov-2019 inoguchi

Add option for cms test in appstest.sh


# 1.30 24-Nov-2019 inoguchi

Add test for cms operations in appstest.sh


# 1.29 20-Nov-2019 inoguchi

Add test for cms -keyopt in appstest.sh


# 1.28 09-Nov-2019 inoguchi

Add test for req -addext in appstest.sh


# 1.27 05-Nov-2019 inoguchi

Remove trailing space in appstest.sh


# 1.26 05-Nov-2019 inoguchi

Add test for cms in appstest.sh


# 1.25 03-Nov-2019 inoguchi

Add RSA-PSS test for genpkey in appstest.sh


# 1.24 31-Oct-2019 inoguchi

Add RSA OAEP test for pkeyutl in appstest.sh


Revision tags: OPENBSD_6_6_BASE
# 1.23 17-Jul-2019 inoguchi

Update appstest.sh

- Add -modulus for dsa sub command
- Remove -nextprotoneg


# 1.22 27-Jun-2019 inoguchi

Add more option tests to req, ts, x509 and verify in appstest.sh


# 1.21 24-Jun-2019 inoguchi

Add more options test to ocsp in appstest.sh


# 1.20 23-Jun-2019 inoguchi

Add more option test to dgst in appstest.sh


# 1.19 22-Jun-2019 inoguchi

Add more option tests to ca in appstest.sh


# 1.18 13-Jun-2019 inoguchi

Add more options to pkcs12 and smime in appstest.sh


# 1.17 10-Jun-2019 inoguchi

Add pkcs12 options and smime tests for appstest.sh

- Add some options to pkcs12 test.
- Add smime tests for encrypt, decrypt and pk7out.


Revision tags: OPENBSD_6_5_BASE
# 1.16 16-Feb-2019 inoguchi

Add tests for pkeyutl


Revision tags: OPENBSD_6_4_BASE
# 1.15 15-Sep-2018 inoguchi

Modify regress appstest.sh for interoperability testing with OpenSSL 1.1.x

- add sleep before s_client instead of removing -pause option
- change check words for s_client output messages
- replace CAfile to CApath for s_time
- remove -prexit from s_client
- confirm openssl command path is executable


# 1.14 14-Sep-2018 inoguchi

Add interoperability test mode for regress appstest.sh

- test s_server and s_client between different version by option -i
- indicate other version by defining OTHER_OPENSSL environment variable
- fix "SSL/TLS" to "TLS/SSL", since TLS is correct as technical term
- s/SKIPPNG/SKIPPING/


# 1.13 08-Sep-2018 inoguchi

Fix indent and adjust line fit to 80 columns.


# 1.12 08-Sep-2018 inoguchi

Split test blocks into a function. Test contents are not changed.


# 1.11 08-Sep-2018 inoguchi

Test more ciphers and randomize the order in regress appstest.sh

- change test target ciphers
- randomize the test ciphers order
- display test cipher count


# 1.10 07-Sep-2018 inoguchi

tests all available TLSv1.2 ciphers


# 1.9 27-Aug-2018 inoguchi

Add protocol and cipher patterns in regress appstest.sh


# 1.8 26-Aug-2018 inoguchi

Stop s_server if error occurs in regress appstest.sh


# 1.7 23-Aug-2018 inoguchi

Add license header.


# 1.6 23-Aug-2018 inoguchi

Check reusing SSL/TLS session ticket by regression test

- Added checking for session ticket reusing with using openssl(1) s_server and
s_client command in appstest.sh
- Confirm certificate verification status.
- Save s_server message to log file.

ok tb@ and jsing@


# 1.5 10-Apr-2018 tb

tweak usage()


Revision tags: OPENBSD_6_3_BASE
# 1.4 19-Mar-2018 beck

Add a -q (for quick) mode to apptest.sh, and use it by default.
this means that running the regression test doesn't take forever
because we run a huge dhparam test and openssl speed tests.

ok inoguchi@


# 1.3 06-Feb-2018 tb

Respect the OPENSSL make variable everywhere so that

make OPENSSL=/usr/src/usr.bin/openssl/obj/openssl

actually does the expected thing instead of running a mixture of both the
openssl below /usr/obj and the one below /usr/bin. Found the hard way via
backtraces that made no sense whatsoever.

ok jsing


Revision tags: OPENBSD_6_1_BASE OPENBSD_6_2_BASE
# 1.2 27-Jan-2017 tom

More s/OSCP/OCSP/ typos

ok jmc@


# 1.1 06-Nov-2016 inoguchi

Add regress test script for openssl command.
ok beck@


# 1.52 20-Sep-2021 inoguchi

Fix appstest.sh for testing with OpenSSL 3.0

- Fix 'Server Temp Key' check to work with both words "P-384" and "secp384r1".
- Test TLSv1 and TLSv1.1 only if OpenSSL version is 1.x.


# 1.51 21-Jun-2021 inoguchi

Add GnuTLS interoperability test in appstest.sh


# 1.50 12-May-2021 inoguchi

Modify cms test in appstest.sh to work with ec cert/key


# 1.49 27-Apr-2021 inoguchi

Add DTLS test in appstest.sh


# 1.48 24-Apr-2021 inoguchi

Remove "-4" option treatment and use it always on s_server test in appstest.sh


Revision tags: OPENBSD_6_9_BASE
# 1.47 26-Feb-2021 tb

zap spades of trailing whitespace


Revision tags: OPENBSD_6_8_BASE
# 1.46 01-Aug-2020 inoguchi

Replace hostname underscore with hyphen in appstest.sh


# 1.45 29-May-2020 inoguchi

Add checks for SH downgrade sentinel and HRR hash in appstest.sh


# 1.44 19-May-2020 inoguchi

Add -status and -servername test for s_server and s_client in appstest.sh


# 1.43 19-May-2020 inoguchi

Add -groups test for s_server and s_client in appstest.sh


# 1.42 18-May-2020 inoguchi

Add client certificate test in appstest.sh


# 1.41 18-May-2020 inoguchi

Rename variables for key, csr, pass, cert


# 1.40 17-May-2020 inoguchi

Add GOST certificate test in appstest.sh

Enabled by -g option, and default to disabled (RSA certificate is used)


# 1.39 17-May-2020 inoguchi

Suppress display output and reduce s_time to 1 sec in appstest.sh


# 1.38 17-May-2020 inoguchi

Fix server client test with TLSv1.3 in appstest.sh


# 1.37 15-May-2020 inoguchi

Factor out session reuse test and verification test


# 1.36 15-May-2020 inoguchi

Factor out the test for all available ciphers and add TLSv1.3 case


# 1.35 15-May-2020 inoguchi

Add ECDSA certificate test in appstest.sh

Enabled by -e option, and default to disabled (RSA certificate is used)


# 1.34 14-May-2020 inoguchi

Skip protocol version message check in appstest.sh

- OpenSSL1.1.1 with TLSv1.3 does not call SSL_SESSION_print() until NewSessionTicket arrival
- Shorten function name


# 1.33 14-May-2020 inoguchi

Factor out the protocol version test in appstest.sh

OTHER_OPENSSL default to eopenssl11


Revision tags: OPENBSD_6_7_BASE
# 1.32 26-Jan-2020 inoguchi

Restrict to use up to TLSv1.2 for test_server_client in appstest.sh

Currently, only s_client has TLSv1.3 and s_server does not.


# 1.31 25-Nov-2019 inoguchi

Add option for cms test in appstest.sh


# 1.30 24-Nov-2019 inoguchi

Add test for cms operations in appstest.sh


# 1.29 20-Nov-2019 inoguchi

Add test for cms -keyopt in appstest.sh


# 1.28 09-Nov-2019 inoguchi

Add test for req -addext in appstest.sh


# 1.27 05-Nov-2019 inoguchi

Remove trailing space in appstest.sh


# 1.26 05-Nov-2019 inoguchi

Add test for cms in appstest.sh


# 1.25 03-Nov-2019 inoguchi

Add RSA-PSS test for genpkey in appstest.sh


# 1.24 31-Oct-2019 inoguchi

Add RSA OAEP test for pkeyutl in appstest.sh


Revision tags: OPENBSD_6_6_BASE
# 1.23 17-Jul-2019 inoguchi

Update appstest.sh

- Add -modulus for dsa sub command
- Remove -nextprotoneg


# 1.22 27-Jun-2019 inoguchi

Add more option tests to req, ts, x509 and verify in appstest.sh


# 1.21 24-Jun-2019 inoguchi

Add more options test to ocsp in appstest.sh


# 1.20 23-Jun-2019 inoguchi

Add more option test to dgst in appstest.sh


# 1.19 22-Jun-2019 inoguchi

Add more option tests to ca in appstest.sh


# 1.18 13-Jun-2019 inoguchi

Add more options to pkcs12 and smime in appstest.sh


# 1.17 10-Jun-2019 inoguchi

Add pkcs12 options and smime tests for appstest.sh

- Add some options to pkcs12 test.
- Add smime tests for encrypt, decrypt and pk7out.


Revision tags: OPENBSD_6_5_BASE
# 1.16 16-Feb-2019 inoguchi

Add tests for pkeyutl


Revision tags: OPENBSD_6_4_BASE
# 1.15 15-Sep-2018 inoguchi

Modify regress appstest.sh for interoperability testing with OpenSSL 1.1.x

- add sleep before s_client instead of removing -pause option
- change check words for s_client output messages
- replace CAfile to CApath for s_time
- remove -prexit from s_client
- confirm openssl command path is executable


# 1.14 14-Sep-2018 inoguchi

Add interoperability test mode for regress appstest.sh

- test s_server and s_client between different version by option -i
- indicate other version by defining OTHER_OPENSSL environment variable
- fix "SSL/TLS" to "TLS/SSL", since TLS is correct as technical term
- s/SKIPPNG/SKIPPING/


# 1.13 08-Sep-2018 inoguchi

Fix indent and adjust line fit to 80 columns.


# 1.12 08-Sep-2018 inoguchi

Split test blocks into a function. Test contents are not changed.


# 1.11 08-Sep-2018 inoguchi

Test more ciphers and randomize the order in regress appstest.sh

- change test target ciphers
- randomize the test ciphers order
- display test cipher count


# 1.10 07-Sep-2018 inoguchi

tests all available TLSv1.2 ciphers


# 1.9 27-Aug-2018 inoguchi

Add protocol and cipher patterns in regress appstest.sh


# 1.8 26-Aug-2018 inoguchi

Stop s_server if error occurs in regress appstest.sh


# 1.7 23-Aug-2018 inoguchi

Add license header.


# 1.6 23-Aug-2018 inoguchi

Check reusing SSL/TLS session ticket by regression test

- Added checking for session ticket reusing with using openssl(1) s_server and
s_client command in appstest.sh
- Confirm certificate verification status.
- Save s_server message to log file.

ok tb@ and jsing@


# 1.5 10-Apr-2018 tb

tweak usage()


Revision tags: OPENBSD_6_3_BASE
# 1.4 19-Mar-2018 beck

Add a -q (for quick) mode to apptest.sh, and use it by default.
this means that running the regression test doesn't take forever
because we run a huge dhparam test and openssl speed tests.

ok inoguchi@


# 1.3 06-Feb-2018 tb

Respect the OPENSSL make variable everywhere so that

make OPENSSL=/usr/src/usr.bin/openssl/obj/openssl

actually does the expected thing instead of running a mixture of both the
openssl below /usr/obj and the one below /usr/bin. Found the hard way via
backtraces that made no sense whatsoever.

ok jsing


Revision tags: OPENBSD_6_1_BASE OPENBSD_6_2_BASE
# 1.2 27-Jan-2017 tom

More s/OSCP/OCSP/ typos

ok jmc@


# 1.1 06-Nov-2016 inoguchi

Add regress test script for openssl command.
ok beck@


# 1.51 21-Jun-2021 inoguchi

Add GnuTLS interoperability test in appstest.sh


# 1.50 12-May-2021 inoguchi

Modify cms test in appstest.sh to work with ec cert/key


# 1.49 27-Apr-2021 inoguchi

Add DTLS test in appstest.sh


# 1.48 24-Apr-2021 inoguchi

Remove "-4" option treatment and use it always on s_server test in appstest.sh


Revision tags: OPENBSD_6_9_BASE
# 1.47 26-Feb-2021 tb

zap spades of trailing whitespace


Revision tags: OPENBSD_6_8_BASE
# 1.46 01-Aug-2020 inoguchi

Replace hostname underscore with hyphen in appstest.sh


# 1.45 29-May-2020 inoguchi

Add checks for SH downgrade sentinel and HRR hash in appstest.sh


# 1.44 19-May-2020 inoguchi

Add -status and -servername test for s_server and s_client in appstest.sh


# 1.43 19-May-2020 inoguchi

Add -groups test for s_server and s_client in appstest.sh


# 1.42 18-May-2020 inoguchi

Add client certificate test in appstest.sh


# 1.41 18-May-2020 inoguchi

Rename variables for key, csr, pass, cert


# 1.40 17-May-2020 inoguchi

Add GOST certificate test in appstest.sh

Enabled by -g option, and default to disabled (RSA certificate is used)


# 1.39 17-May-2020 inoguchi

Suppress display output and reduce s_time to 1 sec in appstest.sh


# 1.38 17-May-2020 inoguchi

Fix server client test with TLSv1.3 in appstest.sh


# 1.37 15-May-2020 inoguchi

Factor out session reuse test and verification test


# 1.36 15-May-2020 inoguchi

Factor out the test for all available ciphers and add TLSv1.3 case


# 1.35 15-May-2020 inoguchi

Add ECDSA certificate test in appstest.sh

Enabled by -e option, and default to disabled (RSA certificate is used)


# 1.34 14-May-2020 inoguchi

Skip protocol version message check in appstest.sh

- OpenSSL1.1.1 with TLSv1.3 does not call SSL_SESSION_print() until NewSessionTicket arrival
- Shorten function name


# 1.33 14-May-2020 inoguchi

Factor out the protocol version test in appstest.sh

OTHER_OPENSSL default to eopenssl11


Revision tags: OPENBSD_6_7_BASE
# 1.32 26-Jan-2020 inoguchi

Restrict to use up to TLSv1.2 for test_server_client in appstest.sh

Currently, only s_client has TLSv1.3 and s_server does not.


# 1.31 25-Nov-2019 inoguchi

Add option for cms test in appstest.sh


# 1.30 24-Nov-2019 inoguchi

Add test for cms operations in appstest.sh


# 1.29 20-Nov-2019 inoguchi

Add test for cms -keyopt in appstest.sh


# 1.28 09-Nov-2019 inoguchi

Add test for req -addext in appstest.sh


# 1.27 05-Nov-2019 inoguchi

Remove trailing space in appstest.sh


# 1.26 05-Nov-2019 inoguchi

Add test for cms in appstest.sh


# 1.25 03-Nov-2019 inoguchi

Add RSA-PSS test for genpkey in appstest.sh


# 1.24 31-Oct-2019 inoguchi

Add RSA OAEP test for pkeyutl in appstest.sh


Revision tags: OPENBSD_6_6_BASE
# 1.23 17-Jul-2019 inoguchi

Update appstest.sh

- Add -modulus for dsa sub command
- Remove -nextprotoneg


# 1.22 27-Jun-2019 inoguchi

Add more option tests to req, ts, x509 and verify in appstest.sh


# 1.21 24-Jun-2019 inoguchi

Add more options test to ocsp in appstest.sh


# 1.20 23-Jun-2019 inoguchi

Add more option test to dgst in appstest.sh


# 1.19 22-Jun-2019 inoguchi

Add more option tests to ca in appstest.sh


# 1.18 13-Jun-2019 inoguchi

Add more options to pkcs12 and smime in appstest.sh


# 1.17 10-Jun-2019 inoguchi

Add pkcs12 options and smime tests for appstest.sh

- Add some options to pkcs12 test.
- Add smime tests for encrypt, decrypt and pk7out.


Revision tags: OPENBSD_6_5_BASE
# 1.16 16-Feb-2019 inoguchi

Add tests for pkeyutl


Revision tags: OPENBSD_6_4_BASE
# 1.15 15-Sep-2018 inoguchi

Modify regress appstest.sh for interoperability testing with OpenSSL 1.1.x

- add sleep before s_client instead of removing -pause option
- change check words for s_client output messages
- replace CAfile to CApath for s_time
- remove -prexit from s_client
- confirm openssl command path is executable


# 1.14 14-Sep-2018 inoguchi

Add interoperability test mode for regress appstest.sh

- test s_server and s_client between different version by option -i
- indicate other version by defining OTHER_OPENSSL environment variable
- fix "SSL/TLS" to "TLS/SSL", since TLS is correct as technical term
- s/SKIPPNG/SKIPPING/


# 1.13 08-Sep-2018 inoguchi

Fix indent and adjust line fit to 80 columns.


# 1.12 08-Sep-2018 inoguchi

Split test blocks into a function. Test contents are not changed.


# 1.11 08-Sep-2018 inoguchi

Test more ciphers and randomize the order in regress appstest.sh

- change test target ciphers
- randomize the test ciphers order
- display test cipher count


# 1.10 07-Sep-2018 inoguchi

tests all available TLSv1.2 ciphers


# 1.9 27-Aug-2018 inoguchi

Add protocol and cipher patterns in regress appstest.sh


# 1.8 26-Aug-2018 inoguchi

Stop s_server if error occurs in regress appstest.sh


# 1.7 23-Aug-2018 inoguchi

Add license header.


# 1.6 23-Aug-2018 inoguchi

Check reusing SSL/TLS session ticket by regression test

- Added checking for session ticket reusing with using openssl(1) s_server and
s_client command in appstest.sh
- Confirm certificate verification status.
- Save s_server message to log file.

ok tb@ and jsing@


# 1.5 10-Apr-2018 tb

tweak usage()


Revision tags: OPENBSD_6_3_BASE
# 1.4 19-Mar-2018 beck

Add a -q (for quick) mode to apptest.sh, and use it by default.
this means that running the regression test doesn't take forever
because we run a huge dhparam test and openssl speed tests.

ok inoguchi@


# 1.3 06-Feb-2018 tb

Respect the OPENSSL make variable everywhere so that

make OPENSSL=/usr/src/usr.bin/openssl/obj/openssl

actually does the expected thing instead of running a mixture of both the
openssl below /usr/obj and the one below /usr/bin. Found the hard way via
backtraces that made no sense whatsoever.

ok jsing


Revision tags: OPENBSD_6_1_BASE OPENBSD_6_2_BASE
# 1.2 27-Jan-2017 tom

More s/OSCP/OCSP/ typos

ok jmc@


# 1.1 06-Nov-2016 inoguchi

Add regress test script for openssl command.
ok beck@


# 1.50 12-May-2021 inoguchi

Modify cms test in appstest.sh to work with ec cert/key


# 1.49 27-Apr-2021 inoguchi

Add DTLS test in appstest.sh


# 1.48 24-Apr-2021 inoguchi

Remove "-4" option treatment and use it always on s_server test in appstest.sh


Revision tags: OPENBSD_6_9_BASE
# 1.47 26-Feb-2021 tb

zap spades of trailing whitespace


Revision tags: OPENBSD_6_8_BASE
# 1.46 01-Aug-2020 inoguchi

Replace hostname underscore with hyphen in appstest.sh


# 1.45 29-May-2020 inoguchi

Add checks for SH downgrade sentinel and HRR hash in appstest.sh


# 1.44 19-May-2020 inoguchi

Add -status and -servername test for s_server and s_client in appstest.sh


# 1.43 19-May-2020 inoguchi

Add -groups test for s_server and s_client in appstest.sh


# 1.42 18-May-2020 inoguchi

Add client certificate test in appstest.sh


# 1.41 18-May-2020 inoguchi

Rename variables for key, csr, pass, cert


# 1.40 17-May-2020 inoguchi

Add GOST certificate test in appstest.sh

Enabled by -g option, and default to disabled (RSA certificate is used)


# 1.39 17-May-2020 inoguchi

Suppress display output and reduce s_time to 1 sec in appstest.sh


# 1.38 17-May-2020 inoguchi

Fix server client test with TLSv1.3 in appstest.sh


# 1.37 15-May-2020 inoguchi

Factor out session reuse test and verification test


# 1.36 15-May-2020 inoguchi

Factor out the test for all available ciphers and add TLSv1.3 case


# 1.35 15-May-2020 inoguchi

Add ECDSA certificate test in appstest.sh

Enabled by -e option, and default to disabled (RSA certificate is used)


# 1.34 14-May-2020 inoguchi

Skip protocol version message check in appstest.sh

- OpenSSL1.1.1 with TLSv1.3 does not call SSL_SESSION_print() until NewSessionTicket arrival
- Shorten function name


# 1.33 14-May-2020 inoguchi

Factor out the protocol version test in appstest.sh

OTHER_OPENSSL default to eopenssl11


Revision tags: OPENBSD_6_7_BASE
# 1.32 26-Jan-2020 inoguchi

Restrict to use up to TLSv1.2 for test_server_client in appstest.sh

Currently, only s_client has TLSv1.3 and s_server does not.


# 1.31 25-Nov-2019 inoguchi

Add option for cms test in appstest.sh


# 1.30 24-Nov-2019 inoguchi

Add test for cms operations in appstest.sh


# 1.29 20-Nov-2019 inoguchi

Add test for cms -keyopt in appstest.sh


# 1.28 09-Nov-2019 inoguchi

Add test for req -addext in appstest.sh


# 1.27 05-Nov-2019 inoguchi

Remove trailing space in appstest.sh


# 1.26 05-Nov-2019 inoguchi

Add test for cms in appstest.sh


# 1.25 03-Nov-2019 inoguchi

Add RSA-PSS test for genpkey in appstest.sh


# 1.24 31-Oct-2019 inoguchi

Add RSA OAEP test for pkeyutl in appstest.sh


Revision tags: OPENBSD_6_6_BASE
# 1.23 17-Jul-2019 inoguchi

Update appstest.sh

- Add -modulus for dsa sub command
- Remove -nextprotoneg


# 1.22 27-Jun-2019 inoguchi

Add more option tests to req, ts, x509 and verify in appstest.sh


# 1.21 24-Jun-2019 inoguchi

Add more options test to ocsp in appstest.sh


# 1.20 23-Jun-2019 inoguchi

Add more option test to dgst in appstest.sh


# 1.19 22-Jun-2019 inoguchi

Add more option tests to ca in appstest.sh


# 1.18 13-Jun-2019 inoguchi

Add more options to pkcs12 and smime in appstest.sh


# 1.17 10-Jun-2019 inoguchi

Add pkcs12 options and smime tests for appstest.sh

- Add some options to pkcs12 test.
- Add smime tests for encrypt, decrypt and pk7out.


Revision tags: OPENBSD_6_5_BASE
# 1.16 16-Feb-2019 inoguchi

Add tests for pkeyutl


Revision tags: OPENBSD_6_4_BASE
# 1.15 15-Sep-2018 inoguchi

Modify regress appstest.sh for interoperability testing with OpenSSL 1.1.x

- add sleep before s_client instead of removing -pause option
- change check words for s_client output messages
- replace CAfile to CApath for s_time
- remove -prexit from s_client
- confirm openssl command path is executable


# 1.14 14-Sep-2018 inoguchi

Add interoperability test mode for regress appstest.sh

- test s_server and s_client between different version by option -i
- indicate other version by defining OTHER_OPENSSL environment variable
- fix "SSL/TLS" to "TLS/SSL", since TLS is correct as technical term
- s/SKIPPNG/SKIPPING/


# 1.13 08-Sep-2018 inoguchi

Fix indent and adjust line fit to 80 columns.


# 1.12 08-Sep-2018 inoguchi

Split test blocks into a function. Test contents are not changed.


# 1.11 08-Sep-2018 inoguchi

Test more ciphers and randomize the order in regress appstest.sh

- change test target ciphers
- randomize the test ciphers order
- display test cipher count


# 1.10 07-Sep-2018 inoguchi

tests all available TLSv1.2 ciphers


# 1.9 27-Aug-2018 inoguchi

Add protocol and cipher patterns in regress appstest.sh


# 1.8 26-Aug-2018 inoguchi

Stop s_server if error occurs in regress appstest.sh


# 1.7 23-Aug-2018 inoguchi

Add license header.


# 1.6 23-Aug-2018 inoguchi

Check reusing SSL/TLS session ticket by regression test

- Added checking for session ticket reusing with using openssl(1) s_server and
s_client command in appstest.sh
- Confirm certificate verification status.
- Save s_server message to log file.

ok tb@ and jsing@


# 1.5 10-Apr-2018 tb

tweak usage()


Revision tags: OPENBSD_6_3_BASE
# 1.4 19-Mar-2018 beck

Add a -q (for quick) mode to apptest.sh, and use it by default.
this means that running the regression test doesn't take forever
because we run a huge dhparam test and openssl speed tests.

ok inoguchi@


# 1.3 06-Feb-2018 tb

Respect the OPENSSL make variable everywhere so that

make OPENSSL=/usr/src/usr.bin/openssl/obj/openssl

actually does the expected thing instead of running a mixture of both the
openssl below /usr/obj and the one below /usr/bin. Found the hard way via
backtraces that made no sense whatsoever.

ok jsing


Revision tags: OPENBSD_6_1_BASE OPENBSD_6_2_BASE
# 1.2 27-Jan-2017 tom

More s/OSCP/OCSP/ typos

ok jmc@


# 1.1 06-Nov-2016 inoguchi

Add regress test script for openssl command.
ok beck@


# 1.49 27-Apr-2021 inoguchi

Add DTLS test in appstest.sh


# 1.48 24-Apr-2021 inoguchi

Remove "-4" option treatment and use it always on s_server test in appstest.sh


Revision tags: OPENBSD_6_9_BASE
# 1.47 26-Feb-2021 tb

zap spades of trailing whitespace


Revision tags: OPENBSD_6_8_BASE
# 1.46 01-Aug-2020 inoguchi

Replace hostname underscore with hyphen in appstest.sh


# 1.45 29-May-2020 inoguchi

Add checks for SH downgrade sentinel and HRR hash in appstest.sh


# 1.44 19-May-2020 inoguchi

Add -status and -servername test for s_server and s_client in appstest.sh


# 1.43 19-May-2020 inoguchi

Add -groups test for s_server and s_client in appstest.sh


# 1.42 18-May-2020 inoguchi

Add client certificate test in appstest.sh


# 1.41 18-May-2020 inoguchi

Rename variables for key, csr, pass, cert


# 1.40 17-May-2020 inoguchi

Add GOST certificate test in appstest.sh

Enabled by -g option, and default to disabled (RSA certificate is used)


# 1.39 17-May-2020 inoguchi

Suppress display output and reduce s_time to 1 sec in appstest.sh


# 1.38 17-May-2020 inoguchi

Fix server client test with TLSv1.3 in appstest.sh


# 1.37 15-May-2020 inoguchi

Factor out session reuse test and verification test


# 1.36 15-May-2020 inoguchi

Factor out the test for all available ciphers and add TLSv1.3 case


# 1.35 15-May-2020 inoguchi

Add ECDSA certificate test in appstest.sh

Enabled by -e option, and default to disabled (RSA certificate is used)


# 1.34 14-May-2020 inoguchi

Skip protocol version message check in appstest.sh

- OpenSSL1.1.1 with TLSv1.3 does not call SSL_SESSION_print() until NewSessionTicket arrival
- Shorten function name


# 1.33 14-May-2020 inoguchi

Factor out the protocol version test in appstest.sh

OTHER_OPENSSL default to eopenssl11


Revision tags: OPENBSD_6_7_BASE
# 1.32 26-Jan-2020 inoguchi

Restrict to use up to TLSv1.2 for test_server_client in appstest.sh

Currently, only s_client has TLSv1.3 and s_server does not.


# 1.31 25-Nov-2019 inoguchi

Add option for cms test in appstest.sh


# 1.30 24-Nov-2019 inoguchi

Add test for cms operations in appstest.sh


# 1.29 20-Nov-2019 inoguchi

Add test for cms -keyopt in appstest.sh


# 1.28 09-Nov-2019 inoguchi

Add test for req -addext in appstest.sh


# 1.27 05-Nov-2019 inoguchi

Remove trailing space in appstest.sh


# 1.26 05-Nov-2019 inoguchi

Add test for cms in appstest.sh


# 1.25 03-Nov-2019 inoguchi

Add RSA-PSS test for genpkey in appstest.sh


# 1.24 31-Oct-2019 inoguchi

Add RSA OAEP test for pkeyutl in appstest.sh


Revision tags: OPENBSD_6_6_BASE
# 1.23 17-Jul-2019 inoguchi

Update appstest.sh

- Add -modulus for dsa sub command
- Remove -nextprotoneg


# 1.22 27-Jun-2019 inoguchi

Add more option tests to req, ts, x509 and verify in appstest.sh


# 1.21 24-Jun-2019 inoguchi

Add more options test to ocsp in appstest.sh


# 1.20 23-Jun-2019 inoguchi

Add more option test to dgst in appstest.sh


# 1.19 22-Jun-2019 inoguchi

Add more option tests to ca in appstest.sh


# 1.18 13-Jun-2019 inoguchi

Add more options to pkcs12 and smime in appstest.sh


# 1.17 10-Jun-2019 inoguchi

Add pkcs12 options and smime tests for appstest.sh

- Add some options to pkcs12 test.
- Add smime tests for encrypt, decrypt and pk7out.


Revision tags: OPENBSD_6_5_BASE
# 1.16 16-Feb-2019 inoguchi

Add tests for pkeyutl


Revision tags: OPENBSD_6_4_BASE
# 1.15 15-Sep-2018 inoguchi

Modify regress appstest.sh for interoperability testing with OpenSSL 1.1.x

- add sleep before s_client instead of removing -pause option
- change check words for s_client output messages
- replace CAfile to CApath for s_time
- remove -prexit from s_client
- confirm openssl command path is executable


# 1.14 14-Sep-2018 inoguchi

Add interoperability test mode for regress appstest.sh

- test s_server and s_client between different version by option -i
- indicate other version by defining OTHER_OPENSSL environment variable
- fix "SSL/TLS" to "TLS/SSL", since TLS is correct as technical term
- s/SKIPPNG/SKIPPING/


# 1.13 08-Sep-2018 inoguchi

Fix indent and adjust line fit to 80 columns.


# 1.12 08-Sep-2018 inoguchi

Split test blocks into a function. Test contents are not changed.


# 1.11 08-Sep-2018 inoguchi

Test more ciphers and randomize the order in regress appstest.sh

- change test target ciphers
- randomize the test ciphers order
- display test cipher count


# 1.10 07-Sep-2018 inoguchi

tests all available TLSv1.2 ciphers


# 1.9 27-Aug-2018 inoguchi

Add protocol and cipher patterns in regress appstest.sh


# 1.8 26-Aug-2018 inoguchi

Stop s_server if error occurs in regress appstest.sh


# 1.7 23-Aug-2018 inoguchi

Add license header.


# 1.6 23-Aug-2018 inoguchi

Check reusing SSL/TLS session ticket by regression test

- Added checking for session ticket reusing with using openssl(1) s_server and
s_client command in appstest.sh
- Confirm certificate verification status.
- Save s_server message to log file.

ok tb@ and jsing@


# 1.5 10-Apr-2018 tb

tweak usage()


Revision tags: OPENBSD_6_3_BASE
# 1.4 19-Mar-2018 beck

Add a -q (for quick) mode to apptest.sh, and use it by default.
this means that running the regression test doesn't take forever
because we run a huge dhparam test and openssl speed tests.

ok inoguchi@


# 1.3 06-Feb-2018 tb

Respect the OPENSSL make variable everywhere so that

make OPENSSL=/usr/src/usr.bin/openssl/obj/openssl

actually does the expected thing instead of running a mixture of both the
openssl below /usr/obj and the one below /usr/bin. Found the hard way via
backtraces that made no sense whatsoever.

ok jsing


Revision tags: OPENBSD_6_1_BASE OPENBSD_6_2_BASE
# 1.2 27-Jan-2017 tom

More s/OSCP/OCSP/ typos

ok jmc@


# 1.1 06-Nov-2016 inoguchi

Add regress test script for openssl command.
ok beck@


# 1.48 24-Apr-2021 inoguchi

Remove "-4" option treatment and use it always on s_server test in appstest.sh


Revision tags: OPENBSD_6_9_BASE
# 1.47 26-Feb-2021 tb

zap spades of trailing whitespace


Revision tags: OPENBSD_6_8_BASE
# 1.46 01-Aug-2020 inoguchi

Replace hostname underscore with hyphen in appstest.sh


# 1.45 29-May-2020 inoguchi

Add checks for SH downgrade sentinel and HRR hash in appstest.sh


# 1.44 19-May-2020 inoguchi

Add -status and -servername test for s_server and s_client in appstest.sh


# 1.43 19-May-2020 inoguchi

Add -groups test for s_server and s_client in appstest.sh


# 1.42 18-May-2020 inoguchi

Add client certificate test in appstest.sh


# 1.41 18-May-2020 inoguchi

Rename variables for key, csr, pass, cert


# 1.40 17-May-2020 inoguchi

Add GOST certificate test in appstest.sh

Enabled by -g option, and default to disabled (RSA certificate is used)


# 1.39 17-May-2020 inoguchi

Suppress display output and reduce s_time to 1 sec in appstest.sh


# 1.38 17-May-2020 inoguchi

Fix server client test with TLSv1.3 in appstest.sh


# 1.37 15-May-2020 inoguchi

Factor out session reuse test and verification test


# 1.36 15-May-2020 inoguchi

Factor out the test for all available ciphers and add TLSv1.3 case


# 1.35 15-May-2020 inoguchi

Add ECDSA certificate test in appstest.sh

Enabled by -e option, and default to disabled (RSA certificate is used)


# 1.34 14-May-2020 inoguchi

Skip protocol version message check in appstest.sh

- OpenSSL1.1.1 with TLSv1.3 does not call SSL_SESSION_print() until NewSessionTicket arrival
- Shorten function name


# 1.33 14-May-2020 inoguchi

Factor out the protocol version test in appstest.sh

OTHER_OPENSSL default to eopenssl11


Revision tags: OPENBSD_6_7_BASE
# 1.32 26-Jan-2020 inoguchi

Restrict to use up to TLSv1.2 for test_server_client in appstest.sh

Currently, only s_client has TLSv1.3 and s_server does not.


# 1.31 25-Nov-2019 inoguchi

Add option for cms test in appstest.sh


# 1.30 24-Nov-2019 inoguchi

Add test for cms operations in appstest.sh


# 1.29 20-Nov-2019 inoguchi

Add test for cms -keyopt in appstest.sh


# 1.28 09-Nov-2019 inoguchi

Add test for req -addext in appstest.sh


# 1.27 05-Nov-2019 inoguchi

Remove trailing space in appstest.sh


# 1.26 05-Nov-2019 inoguchi

Add test for cms in appstest.sh


# 1.25 03-Nov-2019 inoguchi

Add RSA-PSS test for genpkey in appstest.sh


# 1.24 31-Oct-2019 inoguchi

Add RSA OAEP test for pkeyutl in appstest.sh


Revision tags: OPENBSD_6_6_BASE
# 1.23 17-Jul-2019 inoguchi

Update appstest.sh

- Add -modulus for dsa sub command
- Remove -nextprotoneg


# 1.22 27-Jun-2019 inoguchi

Add more option tests to req, ts, x509 and verify in appstest.sh


# 1.21 24-Jun-2019 inoguchi

Add more options test to ocsp in appstest.sh


# 1.20 23-Jun-2019 inoguchi

Add more option test to dgst in appstest.sh


# 1.19 22-Jun-2019 inoguchi

Add more option tests to ca in appstest.sh


# 1.18 13-Jun-2019 inoguchi

Add more options to pkcs12 and smime in appstest.sh


# 1.17 10-Jun-2019 inoguchi

Add pkcs12 options and smime tests for appstest.sh

- Add some options to pkcs12 test.
- Add smime tests for encrypt, decrypt and pk7out.


Revision tags: OPENBSD_6_5_BASE
# 1.16 16-Feb-2019 inoguchi

Add tests for pkeyutl


Revision tags: OPENBSD_6_4_BASE
# 1.15 15-Sep-2018 inoguchi

Modify regress appstest.sh for interoperability testing with OpenSSL 1.1.x

- add sleep before s_client instead of removing -pause option
- change check words for s_client output messages
- replace CAfile to CApath for s_time
- remove -prexit from s_client
- confirm openssl command path is executable


# 1.14 14-Sep-2018 inoguchi

Add interoperability test mode for regress appstest.sh

- test s_server and s_client between different version by option -i
- indicate other version by defining OTHER_OPENSSL environment variable
- fix "SSL/TLS" to "TLS/SSL", since TLS is correct as technical term
- s/SKIPPNG/SKIPPING/


# 1.13 08-Sep-2018 inoguchi

Fix indent and adjust line fit to 80 columns.


# 1.12 08-Sep-2018 inoguchi

Split test blocks into a function. Test contents are not changed.


# 1.11 08-Sep-2018 inoguchi

Test more ciphers and randomize the order in regress appstest.sh

- change test target ciphers
- randomize the test ciphers order
- display test cipher count


# 1.10 07-Sep-2018 inoguchi

tests all available TLSv1.2 ciphers


# 1.9 27-Aug-2018 inoguchi

Add protocol and cipher patterns in regress appstest.sh


# 1.8 26-Aug-2018 inoguchi

Stop s_server if error occurs in regress appstest.sh


# 1.7 23-Aug-2018 inoguchi

Add license header.


# 1.6 23-Aug-2018 inoguchi

Check reusing SSL/TLS session ticket by regression test

- Added checking for session ticket reusing with using openssl(1) s_server and
s_client command in appstest.sh
- Confirm certificate verification status.
- Save s_server message to log file.

ok tb@ and jsing@


# 1.5 10-Apr-2018 tb

tweak usage()


Revision tags: OPENBSD_6_3_BASE
# 1.4 19-Mar-2018 beck

Add a -q (for quick) mode to apptest.sh, and use it by default.
this means that running the regression test doesn't take forever
because we run a huge dhparam test and openssl speed tests.

ok inoguchi@


# 1.3 06-Feb-2018 tb

Respect the OPENSSL make variable everywhere so that

make OPENSSL=/usr/src/usr.bin/openssl/obj/openssl

actually does the expected thing instead of running a mixture of both the
openssl below /usr/obj and the one below /usr/bin. Found the hard way via
backtraces that made no sense whatsoever.

ok jsing


Revision tags: OPENBSD_6_1_BASE OPENBSD_6_2_BASE
# 1.2 27-Jan-2017 tom

More s/OSCP/OCSP/ typos

ok jmc@


# 1.1 06-Nov-2016 inoguchi

Add regress test script for openssl command.
ok beck@


# 1.47 26-Feb-2021 tb

zap spades of trailing whitespace


Revision tags: OPENBSD_6_8_BASE
# 1.46 01-Aug-2020 inoguchi

Replace hostname underscore with hyphen in appstest.sh


# 1.45 29-May-2020 inoguchi

Add checks for SH downgrade sentinel and HRR hash in appstest.sh


# 1.44 19-May-2020 inoguchi

Add -status and -servername test for s_server and s_client in appstest.sh


# 1.43 19-May-2020 inoguchi

Add -groups test for s_server and s_client in appstest.sh


# 1.42 18-May-2020 inoguchi

Add client certificate test in appstest.sh


# 1.41 18-May-2020 inoguchi

Rename variables for key, csr, pass, cert


# 1.40 17-May-2020 inoguchi

Add GOST certificate test in appstest.sh

Enabled by -g option, and default to disabled (RSA certificate is used)


# 1.39 17-May-2020 inoguchi

Suppress display output and reduce s_time to 1 sec in appstest.sh


# 1.38 17-May-2020 inoguchi

Fix server client test with TLSv1.3 in appstest.sh


# 1.37 15-May-2020 inoguchi

Factor out session reuse test and verification test


# 1.36 15-May-2020 inoguchi

Factor out the test for all available ciphers and add TLSv1.3 case


# 1.35 15-May-2020 inoguchi

Add ECDSA certificate test in appstest.sh

Enabled by -e option, and default to disabled (RSA certificate is used)


# 1.34 14-May-2020 inoguchi

Skip protocol version message check in appstest.sh

- OpenSSL1.1.1 with TLSv1.3 does not call SSL_SESSION_print() until NewSessionTicket arrival
- Shorten function name


# 1.33 14-May-2020 inoguchi

Factor out the protocol version test in appstest.sh

OTHER_OPENSSL default to eopenssl11


Revision tags: OPENBSD_6_7_BASE
# 1.32 26-Jan-2020 inoguchi

Restrict to use up to TLSv1.2 for test_server_client in appstest.sh

Currently, only s_client has TLSv1.3 and s_server does not.


# 1.31 25-Nov-2019 inoguchi

Add option for cms test in appstest.sh


# 1.30 24-Nov-2019 inoguchi

Add test for cms operations in appstest.sh


# 1.29 20-Nov-2019 inoguchi

Add test for cms -keyopt in appstest.sh


# 1.28 09-Nov-2019 inoguchi

Add test for req -addext in appstest.sh


# 1.27 05-Nov-2019 inoguchi

Remove trailing space in appstest.sh


# 1.26 05-Nov-2019 inoguchi

Add test for cms in appstest.sh


# 1.25 03-Nov-2019 inoguchi

Add RSA-PSS test for genpkey in appstest.sh


# 1.24 31-Oct-2019 inoguchi

Add RSA OAEP test for pkeyutl in appstest.sh


Revision tags: OPENBSD_6_6_BASE
# 1.23 17-Jul-2019 inoguchi

Update appstest.sh

- Add -modulus for dsa sub command
- Remove -nextprotoneg


# 1.22 27-Jun-2019 inoguchi

Add more option tests to req, ts, x509 and verify in appstest.sh


# 1.21 24-Jun-2019 inoguchi

Add more options test to ocsp in appstest.sh


# 1.20 23-Jun-2019 inoguchi

Add more option test to dgst in appstest.sh


# 1.19 22-Jun-2019 inoguchi

Add more option tests to ca in appstest.sh


# 1.18 13-Jun-2019 inoguchi

Add more options to pkcs12 and smime in appstest.sh


# 1.17 10-Jun-2019 inoguchi

Add pkcs12 options and smime tests for appstest.sh

- Add some options to pkcs12 test.
- Add smime tests for encrypt, decrypt and pk7out.


Revision tags: OPENBSD_6_5_BASE
# 1.16 16-Feb-2019 inoguchi

Add tests for pkeyutl


Revision tags: OPENBSD_6_4_BASE
# 1.15 15-Sep-2018 inoguchi

Modify regress appstest.sh for interoperability testing with OpenSSL 1.1.x

- add sleep before s_client instead of removing -pause option
- change check words for s_client output messages
- replace CAfile to CApath for s_time
- remove -prexit from s_client
- confirm openssl command path is executable


# 1.14 14-Sep-2018 inoguchi

Add interoperability test mode for regress appstest.sh

- test s_server and s_client between different version by option -i
- indicate other version by defining OTHER_OPENSSL environment variable
- fix "SSL/TLS" to "TLS/SSL", since TLS is correct as technical term
- s/SKIPPNG/SKIPPING/


# 1.13 08-Sep-2018 inoguchi

Fix indent and adjust line fit to 80 columns.


# 1.12 08-Sep-2018 inoguchi

Split test blocks into a function. Test contents are not changed.


# 1.11 08-Sep-2018 inoguchi

Test more ciphers and randomize the order in regress appstest.sh

- change test target ciphers
- randomize the test ciphers order
- display test cipher count


# 1.10 07-Sep-2018 inoguchi

tests all available TLSv1.2 ciphers


# 1.9 27-Aug-2018 inoguchi

Add protocol and cipher patterns in regress appstest.sh


# 1.8 26-Aug-2018 inoguchi

Stop s_server if error occurs in regress appstest.sh


# 1.7 23-Aug-2018 inoguchi

Add license header.


# 1.6 23-Aug-2018 inoguchi

Check reusing SSL/TLS session ticket by regression test

- Added checking for session ticket reusing with using openssl(1) s_server and
s_client command in appstest.sh
- Confirm certificate verification status.
- Save s_server message to log file.

ok tb@ and jsing@


# 1.5 10-Apr-2018 tb

tweak usage()


Revision tags: OPENBSD_6_3_BASE
# 1.4 19-Mar-2018 beck

Add a -q (for quick) mode to apptest.sh, and use it by default.
this means that running the regression test doesn't take forever
because we run a huge dhparam test and openssl speed tests.

ok inoguchi@


# 1.3 06-Feb-2018 tb

Respect the OPENSSL make variable everywhere so that

make OPENSSL=/usr/src/usr.bin/openssl/obj/openssl

actually does the expected thing instead of running a mixture of both the
openssl below /usr/obj and the one below /usr/bin. Found the hard way via
backtraces that made no sense whatsoever.

ok jsing


Revision tags: OPENBSD_6_1_BASE OPENBSD_6_2_BASE
# 1.2 27-Jan-2017 tom

More s/OSCP/OCSP/ typos

ok jmc@


# 1.1 06-Nov-2016 inoguchi

Add regress test script for openssl command.
ok beck@


# 1.46 01-Aug-2020 inoguchi

Replace hostname underscore with hyphen in appstest.sh


# 1.45 29-May-2020 inoguchi

Add checks for SH downgrade sentinel and HRR hash in appstest.sh


# 1.44 19-May-2020 inoguchi

Add -status and -servername test for s_server and s_client in appstest.sh


# 1.43 19-May-2020 inoguchi

Add -groups test for s_server and s_client in appstest.sh


# 1.42 18-May-2020 inoguchi

Add client certificate test in appstest.sh


# 1.41 18-May-2020 inoguchi

Rename variables for key, csr, pass, cert


# 1.40 17-May-2020 inoguchi

Add GOST certificate test in appstest.sh

Enabled by -g option, and default to disabled (RSA certificate is used)


# 1.39 17-May-2020 inoguchi

Suppress display output and reduce s_time to 1 sec in appstest.sh


# 1.38 17-May-2020 inoguchi

Fix server client test with TLSv1.3 in appstest.sh


# 1.37 15-May-2020 inoguchi

Factor out session reuse test and verification test


# 1.36 15-May-2020 inoguchi

Factor out the test for all available ciphers and add TLSv1.3 case


# 1.35 15-May-2020 inoguchi

Add ECDSA certificate test in appstest.sh

Enabled by -e option, and default to disabled (RSA certificate is used)


# 1.34 14-May-2020 inoguchi

Skip protocol version message check in appstest.sh

- OpenSSL1.1.1 with TLSv1.3 does not call SSL_SESSION_print() until NewSessionTicket arrival
- Shorten function name


# 1.33 14-May-2020 inoguchi

Factor out the protocol version test in appstest.sh

OTHER_OPENSSL default to eopenssl11


Revision tags: OPENBSD_6_7_BASE
# 1.32 26-Jan-2020 inoguchi

Restrict to use up to TLSv1.2 for test_server_client in appstest.sh

Currently, only s_client has TLSv1.3 and s_server does not.


# 1.31 25-Nov-2019 inoguchi

Add option for cms test in appstest.sh


# 1.30 24-Nov-2019 inoguchi

Add test for cms operations in appstest.sh


# 1.29 20-Nov-2019 inoguchi

Add test for cms -keyopt in appstest.sh


# 1.28 09-Nov-2019 inoguchi

Add test for req -addext in appstest.sh


# 1.27 05-Nov-2019 inoguchi

Remove trailing space in appstest.sh


# 1.26 05-Nov-2019 inoguchi

Add test for cms in appstest.sh


# 1.25 03-Nov-2019 inoguchi

Add RSA-PSS test for genpkey in appstest.sh


# 1.24 31-Oct-2019 inoguchi

Add RSA OAEP test for pkeyutl in appstest.sh


Revision tags: OPENBSD_6_6_BASE
# 1.23 17-Jul-2019 inoguchi

Update appstest.sh

- Add -modulus for dsa sub command
- Remove -nextprotoneg


# 1.22 27-Jun-2019 inoguchi

Add more option tests to req, ts, x509 and verify in appstest.sh


# 1.21 24-Jun-2019 inoguchi

Add more options test to ocsp in appstest.sh


# 1.20 23-Jun-2019 inoguchi

Add more option test to dgst in appstest.sh


# 1.19 22-Jun-2019 inoguchi

Add more option tests to ca in appstest.sh


# 1.18 13-Jun-2019 inoguchi

Add more options to pkcs12 and smime in appstest.sh


# 1.17 10-Jun-2019 inoguchi

Add pkcs12 options and smime tests for appstest.sh

- Add some options to pkcs12 test.
- Add smime tests for encrypt, decrypt and pk7out.


Revision tags: OPENBSD_6_5_BASE
# 1.16 16-Feb-2019 inoguchi

Add tests for pkeyutl


Revision tags: OPENBSD_6_4_BASE
# 1.15 15-Sep-2018 inoguchi

Modify regress appstest.sh for interoperability testing with OpenSSL 1.1.x

- add sleep before s_client instead of removing -pause option
- change check words for s_client output messages
- replace CAfile to CApath for s_time
- remove -prexit from s_client
- confirm openssl command path is executable


# 1.14 14-Sep-2018 inoguchi

Add interoperability test mode for regress appstest.sh

- test s_server and s_client between different version by option -i
- indicate other version by defining OTHER_OPENSSL environment variable
- fix "SSL/TLS" to "TLS/SSL", since TLS is correct as technical term
- s/SKIPPNG/SKIPPING/


# 1.13 08-Sep-2018 inoguchi

Fix indent and adjust line fit to 80 columns.


# 1.12 08-Sep-2018 inoguchi

Split test blocks into a function. Test contents are not changed.


# 1.11 08-Sep-2018 inoguchi

Test more ciphers and randomize the order in regress appstest.sh

- change test target ciphers
- randomize the test ciphers order
- display test cipher count


# 1.10 07-Sep-2018 inoguchi

tests all available TLSv1.2 ciphers


# 1.9 27-Aug-2018 inoguchi

Add protocol and cipher patterns in regress appstest.sh


# 1.8 26-Aug-2018 inoguchi

Stop s_server if error occurs in regress appstest.sh


# 1.7 23-Aug-2018 inoguchi

Add license header.


# 1.6 23-Aug-2018 inoguchi

Check reusing SSL/TLS session ticket by regression test

- Added checking for session ticket reusing with using openssl(1) s_server and
s_client command in appstest.sh
- Confirm certificate verification status.
- Save s_server message to log file.

ok tb@ and jsing@


# 1.5 10-Apr-2018 tb

tweak usage()


Revision tags: OPENBSD_6_3_BASE
# 1.4 19-Mar-2018 beck

Add a -q (for quick) mode to apptest.sh, and use it by default.
this means that running the regression test doesn't take forever
because we run a huge dhparam test and openssl speed tests.

ok inoguchi@


# 1.3 06-Feb-2018 tb

Respect the OPENSSL make variable everywhere so that

make OPENSSL=/usr/src/usr.bin/openssl/obj/openssl

actually does the expected thing instead of running a mixture of both the
openssl below /usr/obj and the one below /usr/bin. Found the hard way via
backtraces that made no sense whatsoever.

ok jsing


Revision tags: OPENBSD_6_1_BASE OPENBSD_6_2_BASE
# 1.2 27-Jan-2017 tom

More s/OSCP/OCSP/ typos

ok jmc@


# 1.1 06-Nov-2016 inoguchi

Add regress test script for openssl command.
ok beck@


# 1.45 29-May-2020 inoguchi

Add checks for SH downgrade sentinel and HRR hash in appstest.sh


# 1.44 19-May-2020 inoguchi

Add -status and -servername test for s_server and s_client in appstest.sh


# 1.43 19-May-2020 inoguchi

Add -groups test for s_server and s_client in appstest.sh


# 1.42 18-May-2020 inoguchi

Add client certificate test in appstest.sh


# 1.41 18-May-2020 inoguchi

Rename variables for key, csr, pass, cert


# 1.40 17-May-2020 inoguchi

Add GOST certificate test in appstest.sh

Enabled by -g option, and default to disabled (RSA certificate is used)


# 1.39 17-May-2020 inoguchi

Suppress display output and reduce s_time to 1 sec in appstest.sh


# 1.38 17-May-2020 inoguchi

Fix server client test with TLSv1.3 in appstest.sh


# 1.37 15-May-2020 inoguchi

Factor out session reuse test and verification test


# 1.36 15-May-2020 inoguchi

Factor out the test for all available ciphers and add TLSv1.3 case


# 1.35 15-May-2020 inoguchi

Add ECDSA certificate test in appstest.sh

Enabled by -e option, and default to disabled (RSA certificate is used)


# 1.34 14-May-2020 inoguchi

Skip protocol version message check in appstest.sh

- OpenSSL1.1.1 with TLSv1.3 does not call SSL_SESSION_print() until NewSessionTicket arrival
- Shorten function name


# 1.33 14-May-2020 inoguchi

Factor out the protocol version test in appstest.sh

OTHER_OPENSSL default to eopenssl11


Revision tags: OPENBSD_6_7_BASE
# 1.32 26-Jan-2020 inoguchi

Restrict to use up to TLSv1.2 for test_server_client in appstest.sh

Currently, only s_client has TLSv1.3 and s_server does not.


# 1.31 25-Nov-2019 inoguchi

Add option for cms test in appstest.sh


# 1.30 24-Nov-2019 inoguchi

Add test for cms operations in appstest.sh


# 1.29 20-Nov-2019 inoguchi

Add test for cms -keyopt in appstest.sh


# 1.28 09-Nov-2019 inoguchi

Add test for req -addext in appstest.sh


# 1.27 05-Nov-2019 inoguchi

Remove trailing space in appstest.sh


# 1.26 05-Nov-2019 inoguchi

Add test for cms in appstest.sh


# 1.25 03-Nov-2019 inoguchi

Add RSA-PSS test for genpkey in appstest.sh


# 1.24 31-Oct-2019 inoguchi

Add RSA OAEP test for pkeyutl in appstest.sh


Revision tags: OPENBSD_6_6_BASE
# 1.23 17-Jul-2019 inoguchi

Update appstest.sh

- Add -modulus for dsa sub command
- Remove -nextprotoneg


# 1.22 27-Jun-2019 inoguchi

Add more option tests to req, ts, x509 and verify in appstest.sh


# 1.21 24-Jun-2019 inoguchi

Add more options test to ocsp in appstest.sh


# 1.20 23-Jun-2019 inoguchi

Add more option test to dgst in appstest.sh


# 1.19 22-Jun-2019 inoguchi

Add more option tests to ca in appstest.sh


# 1.18 13-Jun-2019 inoguchi

Add more options to pkcs12 and smime in appstest.sh


# 1.17 10-Jun-2019 inoguchi

Add pkcs12 options and smime tests for appstest.sh

- Add some options to pkcs12 test.
- Add smime tests for encrypt, decrypt and pk7out.


Revision tags: OPENBSD_6_5_BASE
# 1.16 16-Feb-2019 inoguchi

Add tests for pkeyutl


Revision tags: OPENBSD_6_4_BASE
# 1.15 15-Sep-2018 inoguchi

Modify regress appstest.sh for interoperability testing with OpenSSL 1.1.x

- add sleep before s_client instead of removing -pause option
- change check words for s_client output messages
- replace CAfile to CApath for s_time
- remove -prexit from s_client
- confirm openssl command path is executable


# 1.14 14-Sep-2018 inoguchi

Add interoperability test mode for regress appstest.sh

- test s_server and s_client between different version by option -i
- indicate other version by defining OTHER_OPENSSL environment variable
- fix "SSL/TLS" to "TLS/SSL", since TLS is correct as technical term
- s/SKIPPNG/SKIPPING/


# 1.13 08-Sep-2018 inoguchi

Fix indent and adjust line fit to 80 columns.


# 1.12 08-Sep-2018 inoguchi

Split test blocks into a function. Test contents are not changed.


# 1.11 08-Sep-2018 inoguchi

Test more ciphers and randomize the order in regress appstest.sh

- change test target ciphers
- randomize the test ciphers order
- display test cipher count


# 1.10 07-Sep-2018 inoguchi

tests all available TLSv1.2 ciphers


# 1.9 27-Aug-2018 inoguchi

Add protocol and cipher patterns in regress appstest.sh


# 1.8 26-Aug-2018 inoguchi

Stop s_server if error occurs in regress appstest.sh


# 1.7 23-Aug-2018 inoguchi

Add license header.


# 1.6 23-Aug-2018 inoguchi

Check reusing SSL/TLS session ticket by regression test

- Added checking for session ticket reusing with using openssl(1) s_server and
s_client command in appstest.sh
- Confirm certificate verification status.
- Save s_server message to log file.

ok tb@ and jsing@


# 1.5 10-Apr-2018 tb

tweak usage()


Revision tags: OPENBSD_6_3_BASE
# 1.4 19-Mar-2018 beck

Add a -q (for quick) mode to apptest.sh, and use it by default.
this means that running the regression test doesn't take forever
because we run a huge dhparam test and openssl speed tests.

ok inoguchi@


# 1.3 06-Feb-2018 tb

Respect the OPENSSL make variable everywhere so that

make OPENSSL=/usr/src/usr.bin/openssl/obj/openssl

actually does the expected thing instead of running a mixture of both the
openssl below /usr/obj and the one below /usr/bin. Found the hard way via
backtraces that made no sense whatsoever.

ok jsing


Revision tags: OPENBSD_6_1_BASE OPENBSD_6_2_BASE
# 1.2 27-Jan-2017 tom

More s/OSCP/OCSP/ typos

ok jmc@


# 1.1 06-Nov-2016 inoguchi

Add regress test script for openssl command.
ok beck@


# 1.44 19-May-2020 inoguchi

Add -status and -servername test for s_server and s_client in appstest.sh


# 1.43 19-May-2020 inoguchi

Add -groups test for s_server and s_client in appstest.sh


# 1.42 18-May-2020 inoguchi

Add client certificate test in appstest.sh


# 1.41 18-May-2020 inoguchi

Rename variables for key, csr, pass, cert


# 1.40 17-May-2020 inoguchi

Add GOST certificate test in appstest.sh

Enabled by -g option, and default to disabled (RSA certificate is used)


# 1.39 17-May-2020 inoguchi

Suppress display output and reduce s_time to 1 sec in appstest.sh


# 1.38 17-May-2020 inoguchi

Fix server client test with TLSv1.3 in appstest.sh


# 1.37 15-May-2020 inoguchi

Factor out session reuse test and verification test


# 1.36 15-May-2020 inoguchi

Factor out the test for all available ciphers and add TLSv1.3 case


# 1.35 15-May-2020 inoguchi

Add ECDSA certificate test in appstest.sh

Enabled by -e option, and default to disabled (RSA certificate is used)


# 1.34 14-May-2020 inoguchi

Skip protocol version message check in appstest.sh

- OpenSSL1.1.1 with TLSv1.3 does not call SSL_SESSION_print() until NewSessionTicket arrival
- Shorten function name


# 1.33 14-May-2020 inoguchi

Factor out the protocol version test in appstest.sh

OTHER_OPENSSL default to eopenssl11


Revision tags: OPENBSD_6_7_BASE
# 1.32 26-Jan-2020 inoguchi

Restrict to use up to TLSv1.2 for test_server_client in appstest.sh

Currently, only s_client has TLSv1.3 and s_server does not.


# 1.31 25-Nov-2019 inoguchi

Add option for cms test in appstest.sh


# 1.30 24-Nov-2019 inoguchi

Add test for cms operations in appstest.sh


# 1.29 20-Nov-2019 inoguchi

Add test for cms -keyopt in appstest.sh


# 1.28 09-Nov-2019 inoguchi

Add test for req -addext in appstest.sh


# 1.27 05-Nov-2019 inoguchi

Remove trailing space in appstest.sh


# 1.26 05-Nov-2019 inoguchi

Add test for cms in appstest.sh


# 1.25 03-Nov-2019 inoguchi

Add RSA-PSS test for genpkey in appstest.sh


# 1.24 31-Oct-2019 inoguchi

Add RSA OAEP test for pkeyutl in appstest.sh


Revision tags: OPENBSD_6_6_BASE
# 1.23 17-Jul-2019 inoguchi

Update appstest.sh

- Add -modulus for dsa sub command
- Remove -nextprotoneg


# 1.22 27-Jun-2019 inoguchi

Add more option tests to req, ts, x509 and verify in appstest.sh


# 1.21 24-Jun-2019 inoguchi

Add more options test to ocsp in appstest.sh


# 1.20 23-Jun-2019 inoguchi

Add more option test to dgst in appstest.sh


# 1.19 22-Jun-2019 inoguchi

Add more option tests to ca in appstest.sh


# 1.18 13-Jun-2019 inoguchi

Add more options to pkcs12 and smime in appstest.sh


# 1.17 10-Jun-2019 inoguchi

Add pkcs12 options and smime tests for appstest.sh

- Add some options to pkcs12 test.
- Add smime tests for encrypt, decrypt and pk7out.


Revision tags: OPENBSD_6_5_BASE
# 1.16 16-Feb-2019 inoguchi

Add tests for pkeyutl


Revision tags: OPENBSD_6_4_BASE
# 1.15 15-Sep-2018 inoguchi

Modify regress appstest.sh for interoperability testing with OpenSSL 1.1.x

- add sleep before s_client instead of removing -pause option
- change check words for s_client output messages
- replace CAfile to CApath for s_time
- remove -prexit from s_client
- confirm openssl command path is executable


# 1.14 14-Sep-2018 inoguchi

Add interoperability test mode for regress appstest.sh

- test s_server and s_client between different version by option -i
- indicate other version by defining OTHER_OPENSSL environment variable
- fix "SSL/TLS" to "TLS/SSL", since TLS is correct as technical term
- s/SKIPPNG/SKIPPING/


# 1.13 08-Sep-2018 inoguchi

Fix indent and adjust line fit to 80 columns.


# 1.12 08-Sep-2018 inoguchi

Split test blocks into a function. Test contents are not changed.


# 1.11 08-Sep-2018 inoguchi

Test more ciphers and randomize the order in regress appstest.sh

- change test target ciphers
- randomize the test ciphers order
- display test cipher count


# 1.10 07-Sep-2018 inoguchi

tests all available TLSv1.2 ciphers


# 1.9 27-Aug-2018 inoguchi

Add protocol and cipher patterns in regress appstest.sh


# 1.8 26-Aug-2018 inoguchi

Stop s_server if error occurs in regress appstest.sh


# 1.7 23-Aug-2018 inoguchi

Add license header.


# 1.6 23-Aug-2018 inoguchi

Check reusing SSL/TLS session ticket by regression test

- Added checking for session ticket reusing with using openssl(1) s_server and
s_client command in appstest.sh
- Confirm certificate verification status.
- Save s_server message to log file.

ok tb@ and jsing@


# 1.5 10-Apr-2018 tb

tweak usage()


Revision tags: OPENBSD_6_3_BASE
# 1.4 19-Mar-2018 beck

Add a -q (for quick) mode to apptest.sh, and use it by default.
this means that running the regression test doesn't take forever
because we run a huge dhparam test and openssl speed tests.

ok inoguchi@


# 1.3 06-Feb-2018 tb

Respect the OPENSSL make variable everywhere so that

make OPENSSL=/usr/src/usr.bin/openssl/obj/openssl

actually does the expected thing instead of running a mixture of both the
openssl below /usr/obj and the one below /usr/bin. Found the hard way via
backtraces that made no sense whatsoever.

ok jsing


Revision tags: OPENBSD_6_1_BASE OPENBSD_6_2_BASE
# 1.2 27-Jan-2017 tom

More s/OSCP/OCSP/ typos

ok jmc@


# 1.1 06-Nov-2016 inoguchi

Add regress test script for openssl command.
ok beck@


# 1.42 18-May-2020 inoguchi

Add client certificate test in appstest.sh


# 1.41 18-May-2020 inoguchi

Rename variables for key, csr, pass, cert


# 1.40 17-May-2020 inoguchi

Add GOST certificate test in appstest.sh

Enabled by -g option, and default to disabled (RSA certificate is used)


# 1.39 17-May-2020 inoguchi

Suppress display output and reduce s_time to 1 sec in appstest.sh


# 1.38 17-May-2020 inoguchi

Fix server client test with TLSv1.3 in appstest.sh


# 1.37 15-May-2020 inoguchi

Factor out session reuse test and verification test


# 1.36 15-May-2020 inoguchi

Factor out the test for all available ciphers and add TLSv1.3 case


# 1.35 15-May-2020 inoguchi

Add ECDSA certificate test in appstest.sh

Enabled by -e option, and default to disabled (RSA certificate is used)


# 1.34 14-May-2020 inoguchi

Skip protocol version message check in appstest.sh

- OpenSSL1.1.1 with TLSv1.3 does not call SSL_SESSION_print() until NewSessionTicket arrival
- Shorten function name


# 1.33 14-May-2020 inoguchi

Factor out the protocol version test in appstest.sh

OTHER_OPENSSL default to eopenssl11


Revision tags: OPENBSD_6_7_BASE
# 1.32 26-Jan-2020 inoguchi

Restrict to use up to TLSv1.2 for test_server_client in appstest.sh

Currently, only s_client has TLSv1.3 and s_server does not.


# 1.31 25-Nov-2019 inoguchi

Add option for cms test in appstest.sh


# 1.30 24-Nov-2019 inoguchi

Add test for cms operations in appstest.sh


# 1.29 20-Nov-2019 inoguchi

Add test for cms -keyopt in appstest.sh


# 1.28 09-Nov-2019 inoguchi

Add test for req -addext in appstest.sh


# 1.27 05-Nov-2019 inoguchi

Remove trailing space in appstest.sh


# 1.26 05-Nov-2019 inoguchi

Add test for cms in appstest.sh


# 1.25 03-Nov-2019 inoguchi

Add RSA-PSS test for genpkey in appstest.sh


# 1.24 31-Oct-2019 inoguchi

Add RSA OAEP test for pkeyutl in appstest.sh


Revision tags: OPENBSD_6_6_BASE
# 1.23 17-Jul-2019 inoguchi

Update appstest.sh

- Add -modulus for dsa sub command
- Remove -nextprotoneg


# 1.22 27-Jun-2019 inoguchi

Add more option tests to req, ts, x509 and verify in appstest.sh


# 1.21 24-Jun-2019 inoguchi

Add more options test to ocsp in appstest.sh


# 1.20 23-Jun-2019 inoguchi

Add more option test to dgst in appstest.sh


# 1.19 22-Jun-2019 inoguchi

Add more option tests to ca in appstest.sh


# 1.18 13-Jun-2019 inoguchi

Add more options to pkcs12 and smime in appstest.sh


# 1.17 10-Jun-2019 inoguchi

Add pkcs12 options and smime tests for appstest.sh

- Add some options to pkcs12 test.
- Add smime tests for encrypt, decrypt and pk7out.


Revision tags: OPENBSD_6_5_BASE
# 1.16 16-Feb-2019 inoguchi

Add tests for pkeyutl


Revision tags: OPENBSD_6_4_BASE
# 1.15 15-Sep-2018 inoguchi

Modify regress appstest.sh for interoperability testing with OpenSSL 1.1.x

- add sleep before s_client instead of removing -pause option
- change check words for s_client output messages
- replace CAfile to CApath for s_time
- remove -prexit from s_client
- confirm openssl command path is executable


# 1.14 14-Sep-2018 inoguchi

Add interoperability test mode for regress appstest.sh

- test s_server and s_client between different version by option -i
- indicate other version by defining OTHER_OPENSSL environment variable
- fix "SSL/TLS" to "TLS/SSL", since TLS is correct as technical term
- s/SKIPPNG/SKIPPING/


# 1.13 08-Sep-2018 inoguchi

Fix indent and adjust line fit to 80 columns.


# 1.12 08-Sep-2018 inoguchi

Split test blocks into a function. Test contents are not changed.


# 1.11 08-Sep-2018 inoguchi

Test more ciphers and randomize the order in regress appstest.sh

- change test target ciphers
- randomize the test ciphers order
- display test cipher count


# 1.10 07-Sep-2018 inoguchi

tests all available TLSv1.2 ciphers


# 1.9 27-Aug-2018 inoguchi

Add protocol and cipher patterns in regress appstest.sh


# 1.8 26-Aug-2018 inoguchi

Stop s_server if error occurs in regress appstest.sh


# 1.7 23-Aug-2018 inoguchi

Add license header.


# 1.6 23-Aug-2018 inoguchi

Check reusing SSL/TLS session ticket by regression test

- Added checking for session ticket reusing with using openssl(1) s_server and
s_client command in appstest.sh
- Confirm certificate verification status.
- Save s_server message to log file.

ok tb@ and jsing@


# 1.5 10-Apr-2018 tb

tweak usage()


Revision tags: OPENBSD_6_3_BASE
# 1.4 19-Mar-2018 beck

Add a -q (for quick) mode to apptest.sh, and use it by default.
this means that running the regression test doesn't take forever
because we run a huge dhparam test and openssl speed tests.

ok inoguchi@


# 1.3 06-Feb-2018 tb

Respect the OPENSSL make variable everywhere so that

make OPENSSL=/usr/src/usr.bin/openssl/obj/openssl

actually does the expected thing instead of running a mixture of both the
openssl below /usr/obj and the one below /usr/bin. Found the hard way via
backtraces that made no sense whatsoever.

ok jsing


Revision tags: OPENBSD_6_1_BASE OPENBSD_6_2_BASE
# 1.2 27-Jan-2017 tom

More s/OSCP/OCSP/ typos

ok jmc@


# 1.1 06-Nov-2016 inoguchi

Add regress test script for openssl command.
ok beck@


# 1.40 17-May-2020 inoguchi

Add GOST certificate test in appstest.sh

Enabled by -g option, and default to disabled (RSA certificate is used)


# 1.39 17-May-2020 inoguchi

Suppress display output and reduce s_time to 1 sec in appstest.sh


# 1.38 17-May-2020 inoguchi

Fix server client test with TLSv1.3 in appstest.sh


# 1.37 15-May-2020 inoguchi

Factor out session reuse test and verification test


# 1.36 15-May-2020 inoguchi

Factor out the test for all available ciphers and add TLSv1.3 case


# 1.35 15-May-2020 inoguchi

Add ECDSA certificate test in appstest.sh

Enabled by -e option, and default to disabled (RSA certificate is used)


# 1.34 14-May-2020 inoguchi

Skip protocol version message check in appstest.sh

- OpenSSL1.1.1 with TLSv1.3 does not call SSL_SESSION_print() until NewSessionTicket arrival
- Shorten function name


# 1.33 14-May-2020 inoguchi

Factor out the protocol version test in appstest.sh

OTHER_OPENSSL default to eopenssl11


Revision tags: OPENBSD_6_7_BASE
# 1.32 26-Jan-2020 inoguchi

Restrict to use up to TLSv1.2 for test_server_client in appstest.sh

Currently, only s_client has TLSv1.3 and s_server does not.


# 1.31 25-Nov-2019 inoguchi

Add option for cms test in appstest.sh


# 1.30 24-Nov-2019 inoguchi

Add test for cms operations in appstest.sh


# 1.29 20-Nov-2019 inoguchi

Add test for cms -keyopt in appstest.sh


# 1.28 09-Nov-2019 inoguchi

Add test for req -addext in appstest.sh


# 1.27 05-Nov-2019 inoguchi

Remove trailing space in appstest.sh


# 1.26 05-Nov-2019 inoguchi

Add test for cms in appstest.sh


# 1.25 03-Nov-2019 inoguchi

Add RSA-PSS test for genpkey in appstest.sh


# 1.24 31-Oct-2019 inoguchi

Add RSA OAEP test for pkeyutl in appstest.sh


Revision tags: OPENBSD_6_6_BASE
# 1.23 17-Jul-2019 inoguchi

Update appstest.sh

- Add -modulus for dsa sub command
- Remove -nextprotoneg


# 1.22 27-Jun-2019 inoguchi

Add more option tests to req, ts, x509 and verify in appstest.sh


# 1.21 24-Jun-2019 inoguchi

Add more options test to ocsp in appstest.sh


# 1.20 23-Jun-2019 inoguchi

Add more option test to dgst in appstest.sh


# 1.19 22-Jun-2019 inoguchi

Add more option tests to ca in appstest.sh


# 1.18 13-Jun-2019 inoguchi

Add more options to pkcs12 and smime in appstest.sh


# 1.17 10-Jun-2019 inoguchi

Add pkcs12 options and smime tests for appstest.sh

- Add some options to pkcs12 test.
- Add smime tests for encrypt, decrypt and pk7out.


Revision tags: OPENBSD_6_5_BASE
# 1.16 16-Feb-2019 inoguchi

Add tests for pkeyutl


Revision tags: OPENBSD_6_4_BASE
# 1.15 15-Sep-2018 inoguchi

Modify regress appstest.sh for interoperability testing with OpenSSL 1.1.x

- add sleep before s_client instead of removing -pause option
- change check words for s_client output messages
- replace CAfile to CApath for s_time
- remove -prexit from s_client
- confirm openssl command path is executable


# 1.14 14-Sep-2018 inoguchi

Add interoperability test mode for regress appstest.sh

- test s_server and s_client between different version by option -i
- indicate other version by defining OTHER_OPENSSL environment variable
- fix "SSL/TLS" to "TLS/SSL", since TLS is correct as technical term
- s/SKIPPNG/SKIPPING/


# 1.13 08-Sep-2018 inoguchi

Fix indent and adjust line fit to 80 columns.


# 1.12 08-Sep-2018 inoguchi

Split test blocks into a function. Test contents are not changed.


# 1.11 08-Sep-2018 inoguchi

Test more ciphers and randomize the order in regress appstest.sh

- change test target ciphers
- randomize the test ciphers order
- display test cipher count


# 1.10 07-Sep-2018 inoguchi

tests all available TLSv1.2 ciphers


# 1.9 27-Aug-2018 inoguchi

Add protocol and cipher patterns in regress appstest.sh


# 1.8 26-Aug-2018 inoguchi

Stop s_server if error occurs in regress appstest.sh


# 1.7 23-Aug-2018 inoguchi

Add license header.


# 1.6 23-Aug-2018 inoguchi

Check reusing SSL/TLS session ticket by regression test

- Added checking for session ticket reusing with using openssl(1) s_server and
s_client command in appstest.sh
- Confirm certificate verification status.
- Save s_server message to log file.

ok tb@ and jsing@


# 1.5 10-Apr-2018 tb

tweak usage()


Revision tags: OPENBSD_6_3_BASE
# 1.4 19-Mar-2018 beck

Add a -q (for quick) mode to apptest.sh, and use it by default.
this means that running the regression test doesn't take forever
because we run a huge dhparam test and openssl speed tests.

ok inoguchi@


# 1.3 06-Feb-2018 tb

Respect the OPENSSL make variable everywhere so that

make OPENSSL=/usr/src/usr.bin/openssl/obj/openssl

actually does the expected thing instead of running a mixture of both the
openssl below /usr/obj and the one below /usr/bin. Found the hard way via
backtraces that made no sense whatsoever.

ok jsing


Revision tags: OPENBSD_6_1_BASE OPENBSD_6_2_BASE
# 1.2 27-Jan-2017 tom

More s/OSCP/OCSP/ typos

ok jmc@


# 1.1 06-Nov-2016 inoguchi

Add regress test script for openssl command.
ok beck@


# 1.37 15-May-2020 inoguchi

Factor out session reuse test and verification test


# 1.36 15-May-2020 inoguchi

Factor out the test for all available ciphers and add TLSv1.3 case


# 1.35 15-May-2020 inoguchi

Add ECDSA certificate test in appstest.sh

Enabled by -e option, and default to disabled (RSA certificate is used)


# 1.34 14-May-2020 inoguchi

Skip protocol version message check in appstest.sh

- OpenSSL1.1.1 with TLSv1.3 does not call SSL_SESSION_print() until NewSessionTicket arrival
- Shorten function name


# 1.33 14-May-2020 inoguchi

Factor out the protocol version test in appstest.sh

OTHER_OPENSSL default to eopenssl11


Revision tags: OPENBSD_6_7_BASE
# 1.32 26-Jan-2020 inoguchi

Restrict to use up to TLSv1.2 for test_server_client in appstest.sh

Currently, only s_client has TLSv1.3 and s_server does not.


# 1.31 25-Nov-2019 inoguchi

Add option for cms test in appstest.sh


# 1.30 24-Nov-2019 inoguchi

Add test for cms operations in appstest.sh


# 1.29 20-Nov-2019 inoguchi

Add test for cms -keyopt in appstest.sh


# 1.28 09-Nov-2019 inoguchi

Add test for req -addext in appstest.sh


# 1.27 05-Nov-2019 inoguchi

Remove trailing space in appstest.sh


# 1.26 05-Nov-2019 inoguchi

Add test for cms in appstest.sh


# 1.25 03-Nov-2019 inoguchi

Add RSA-PSS test for genpkey in appstest.sh


# 1.24 31-Oct-2019 inoguchi

Add RSA OAEP test for pkeyutl in appstest.sh


Revision tags: OPENBSD_6_6_BASE
# 1.23 17-Jul-2019 inoguchi

Update appstest.sh

- Add -modulus for dsa sub command
- Remove -nextprotoneg


# 1.22 27-Jun-2019 inoguchi

Add more option tests to req, ts, x509 and verify in appstest.sh


# 1.21 24-Jun-2019 inoguchi

Add more options test to ocsp in appstest.sh


# 1.20 23-Jun-2019 inoguchi

Add more option test to dgst in appstest.sh


# 1.19 22-Jun-2019 inoguchi

Add more option tests to ca in appstest.sh


# 1.18 13-Jun-2019 inoguchi

Add more options to pkcs12 and smime in appstest.sh


# 1.17 10-Jun-2019 inoguchi

Add pkcs12 options and smime tests for appstest.sh

- Add some options to pkcs12 test.
- Add smime tests for encrypt, decrypt and pk7out.


Revision tags: OPENBSD_6_5_BASE
# 1.16 16-Feb-2019 inoguchi

Add tests for pkeyutl


Revision tags: OPENBSD_6_4_BASE
# 1.15 15-Sep-2018 inoguchi

Modify regress appstest.sh for interoperability testing with OpenSSL 1.1.x

- add sleep before s_client instead of removing -pause option
- change check words for s_client output messages
- replace CAfile to CApath for s_time
- remove -prexit from s_client
- confirm openssl command path is executable


# 1.14 14-Sep-2018 inoguchi

Add interoperability test mode for regress appstest.sh

- test s_server and s_client between different version by option -i
- indicate other version by defining OTHER_OPENSSL environment variable
- fix "SSL/TLS" to "TLS/SSL", since TLS is correct as technical term
- s/SKIPPNG/SKIPPING/


# 1.13 08-Sep-2018 inoguchi

Fix indent and adjust line fit to 80 columns.


# 1.12 08-Sep-2018 inoguchi

Split test blocks into a function. Test contents are not changed.


# 1.11 08-Sep-2018 inoguchi

Test more ciphers and randomize the order in regress appstest.sh

- change test target ciphers
- randomize the test ciphers order
- display test cipher count


# 1.10 07-Sep-2018 inoguchi

tests all available TLSv1.2 ciphers


# 1.9 27-Aug-2018 inoguchi

Add protocol and cipher patterns in regress appstest.sh


# 1.8 26-Aug-2018 inoguchi

Stop s_server if error occurs in regress appstest.sh


# 1.7 23-Aug-2018 inoguchi

Add license header.


# 1.6 23-Aug-2018 inoguchi

Check reusing SSL/TLS session ticket by regression test

- Added checking for session ticket reusing with using openssl(1) s_server and
s_client command in appstest.sh
- Confirm certificate verification status.
- Save s_server message to log file.

ok tb@ and jsing@


# 1.5 10-Apr-2018 tb

tweak usage()


Revision tags: OPENBSD_6_3_BASE
# 1.4 19-Mar-2018 beck

Add a -q (for quick) mode to apptest.sh, and use it by default.
this means that running the regression test doesn't take forever
because we run a huge dhparam test and openssl speed tests.

ok inoguchi@


# 1.3 06-Feb-2018 tb

Respect the OPENSSL make variable everywhere so that

make OPENSSL=/usr/src/usr.bin/openssl/obj/openssl

actually does the expected thing instead of running a mixture of both the
openssl below /usr/obj and the one below /usr/bin. Found the hard way via
backtraces that made no sense whatsoever.

ok jsing


Revision tags: OPENBSD_6_1_BASE OPENBSD_6_2_BASE
# 1.2 27-Jan-2017 tom

More s/OSCP/OCSP/ typos

ok jmc@


# 1.1 06-Nov-2016 inoguchi

Add regress test script for openssl command.
ok beck@


# 1.34 14-May-2020 inoguchi

Skip protocol version message check in appstest.sh

- OpenSSL1.1.1 with TLSv1.3 does not call SSL_SESSION_print() until NewSessionTicket arrival
- Shorten function name


# 1.33 14-May-2020 inoguchi

Factor out the protocol version test in appstest.sh

OTHER_OPENSSL default to eopenssl11


Revision tags: OPENBSD_6_7_BASE
# 1.32 26-Jan-2020 inoguchi

Restrict to use up to TLSv1.2 for test_server_client in appstest.sh

Currently, only s_client has TLSv1.3 and s_server does not.


# 1.31 25-Nov-2019 inoguchi

Add option for cms test in appstest.sh


# 1.30 24-Nov-2019 inoguchi

Add test for cms operations in appstest.sh


# 1.29 20-Nov-2019 inoguchi

Add test for cms -keyopt in appstest.sh


# 1.28 09-Nov-2019 inoguchi

Add test for req -addext in appstest.sh


# 1.27 05-Nov-2019 inoguchi

Remove trailing space in appstest.sh


# 1.26 05-Nov-2019 inoguchi

Add test for cms in appstest.sh


# 1.25 03-Nov-2019 inoguchi

Add RSA-PSS test for genpkey in appstest.sh


# 1.24 31-Oct-2019 inoguchi

Add RSA OAEP test for pkeyutl in appstest.sh


Revision tags: OPENBSD_6_6_BASE
# 1.23 17-Jul-2019 inoguchi

Update appstest.sh

- Add -modulus for dsa sub command
- Remove -nextprotoneg


# 1.22 27-Jun-2019 inoguchi

Add more option tests to req, ts, x509 and verify in appstest.sh


# 1.21 24-Jun-2019 inoguchi

Add more options test to ocsp in appstest.sh


# 1.20 23-Jun-2019 inoguchi

Add more option test to dgst in appstest.sh


# 1.19 22-Jun-2019 inoguchi

Add more option tests to ca in appstest.sh


# 1.18 13-Jun-2019 inoguchi

Add more options to pkcs12 and smime in appstest.sh


# 1.17 10-Jun-2019 inoguchi

Add pkcs12 options and smime tests for appstest.sh

- Add some options to pkcs12 test.
- Add smime tests for encrypt, decrypt and pk7out.


Revision tags: OPENBSD_6_5_BASE
# 1.16 16-Feb-2019 inoguchi

Add tests for pkeyutl


Revision tags: OPENBSD_6_4_BASE
# 1.15 15-Sep-2018 inoguchi

Modify regress appstest.sh for interoperability testing with OpenSSL 1.1.x

- add sleep before s_client instead of removing -pause option
- change check words for s_client output messages
- replace CAfile to CApath for s_time
- remove -prexit from s_client
- confirm openssl command path is executable


# 1.14 14-Sep-2018 inoguchi

Add interoperability test mode for regress appstest.sh

- test s_server and s_client between different version by option -i
- indicate other version by defining OTHER_OPENSSL environment variable
- fix "SSL/TLS" to "TLS/SSL", since TLS is correct as technical term
- s/SKIPPNG/SKIPPING/


# 1.13 08-Sep-2018 inoguchi

Fix indent and adjust line fit to 80 columns.


# 1.12 08-Sep-2018 inoguchi

Split test blocks into a function. Test contents are not changed.


# 1.11 08-Sep-2018 inoguchi

Test more ciphers and randomize the order in regress appstest.sh

- change test target ciphers
- randomize the test ciphers order
- display test cipher count


# 1.10 07-Sep-2018 inoguchi

tests all available TLSv1.2 ciphers


# 1.9 27-Aug-2018 inoguchi

Add protocol and cipher patterns in regress appstest.sh


# 1.8 26-Aug-2018 inoguchi

Stop s_server if error occurs in regress appstest.sh


# 1.7 23-Aug-2018 inoguchi

Add license header.


# 1.6 23-Aug-2018 inoguchi

Check reusing SSL/TLS session ticket by regression test

- Added checking for session ticket reusing with using openssl(1) s_server and
s_client command in appstest.sh
- Confirm certificate verification status.
- Save s_server message to log file.

ok tb@ and jsing@


# 1.5 10-Apr-2018 tb

tweak usage()


Revision tags: OPENBSD_6_3_BASE
# 1.4 19-Mar-2018 beck

Add a -q (for quick) mode to apptest.sh, and use it by default.
this means that running the regression test doesn't take forever
because we run a huge dhparam test and openssl speed tests.

ok inoguchi@


# 1.3 06-Feb-2018 tb

Respect the OPENSSL make variable everywhere so that

make OPENSSL=/usr/src/usr.bin/openssl/obj/openssl

actually does the expected thing instead of running a mixture of both the
openssl below /usr/obj and the one below /usr/bin. Found the hard way via
backtraces that made no sense whatsoever.

ok jsing


Revision tags: OPENBSD_6_1_BASE OPENBSD_6_2_BASE
# 1.2 27-Jan-2017 tom

More s/OSCP/OCSP/ typos

ok jmc@


# 1.1 06-Nov-2016 inoguchi

Add regress test script for openssl command.
ok beck@


# 1.32 26-Jan-2020 inoguchi

Restrict to use up to TLSv1.2 for test_server_client in appstest.sh

Currently, only s_client has TLSv1.3 and s_server does not.


# 1.31 25-Nov-2019 inoguchi

Add option for cms test in appstest.sh


# 1.30 24-Nov-2019 inoguchi

Add test for cms operations in appstest.sh


# 1.29 20-Nov-2019 inoguchi

Add test for cms -keyopt in appstest.sh


# 1.28 09-Nov-2019 inoguchi

Add test for req -addext in appstest.sh


# 1.27 05-Nov-2019 inoguchi

Remove trailing space in appstest.sh


# 1.26 05-Nov-2019 inoguchi

Add test for cms in appstest.sh


# 1.25 03-Nov-2019 inoguchi

Add RSA-PSS test for genpkey in appstest.sh


# 1.24 31-Oct-2019 inoguchi

Add RSA OAEP test for pkeyutl in appstest.sh


Revision tags: OPENBSD_6_6_BASE
# 1.23 17-Jul-2019 inoguchi

Update appstest.sh

- Add -modulus for dsa sub command
- Remove -nextprotoneg


# 1.22 27-Jun-2019 inoguchi

Add more option tests to req, ts, x509 and verify in appstest.sh


# 1.21 24-Jun-2019 inoguchi

Add more options test to ocsp in appstest.sh


# 1.20 23-Jun-2019 inoguchi

Add more option test to dgst in appstest.sh


# 1.19 22-Jun-2019 inoguchi

Add more option tests to ca in appstest.sh


# 1.18 13-Jun-2019 inoguchi

Add more options to pkcs12 and smime in appstest.sh


# 1.17 10-Jun-2019 inoguchi

Add pkcs12 options and smime tests for appstest.sh

- Add some options to pkcs12 test.
- Add smime tests for encrypt, decrypt and pk7out.


Revision tags: OPENBSD_6_5_BASE
# 1.16 16-Feb-2019 inoguchi

Add tests for pkeyutl


Revision tags: OPENBSD_6_4_BASE
# 1.15 15-Sep-2018 inoguchi

Modify regress appstest.sh for interoperability testing with OpenSSL 1.1.x

- add sleep before s_client instead of removing -pause option
- change check words for s_client output messages
- replace CAfile to CApath for s_time
- remove -prexit from s_client
- confirm openssl command path is executable


# 1.14 14-Sep-2018 inoguchi

Add interoperability test mode for regress appstest.sh

- test s_server and s_client between different version by option -i
- indicate other version by defining OTHER_OPENSSL environment variable
- fix "SSL/TLS" to "TLS/SSL", since TLS is correct as technical term
- s/SKIPPNG/SKIPPING/


# 1.13 08-Sep-2018 inoguchi

Fix indent and adjust line fit to 80 columns.


# 1.12 08-Sep-2018 inoguchi

Split test blocks into a function. Test contents are not changed.


# 1.11 08-Sep-2018 inoguchi

Test more ciphers and randomize the order in regress appstest.sh

- change test target ciphers
- randomize the test ciphers order
- display test cipher count


# 1.10 07-Sep-2018 inoguchi

tests all available TLSv1.2 ciphers


# 1.9 27-Aug-2018 inoguchi

Add protocol and cipher patterns in regress appstest.sh


# 1.8 26-Aug-2018 inoguchi

Stop s_server if error occurs in regress appstest.sh


# 1.7 23-Aug-2018 inoguchi

Add license header.


# 1.6 23-Aug-2018 inoguchi

Check reusing SSL/TLS session ticket by regression test

- Added checking for session ticket reusing with using openssl(1) s_server and
s_client command in appstest.sh
- Confirm certificate verification status.
- Save s_server message to log file.

ok tb@ and jsing@


# 1.5 10-Apr-2018 tb

tweak usage()


Revision tags: OPENBSD_6_3_BASE
# 1.4 19-Mar-2018 beck

Add a -q (for quick) mode to apptest.sh, and use it by default.
this means that running the regression test doesn't take forever
because we run a huge dhparam test and openssl speed tests.

ok inoguchi@


# 1.3 06-Feb-2018 tb

Respect the OPENSSL make variable everywhere so that

make OPENSSL=/usr/src/usr.bin/openssl/obj/openssl

actually does the expected thing instead of running a mixture of both the
openssl below /usr/obj and the one below /usr/bin. Found the hard way via
backtraces that made no sense whatsoever.

ok jsing


Revision tags: OPENBSD_6_1_BASE OPENBSD_6_2_BASE
# 1.2 27-Jan-2017 tom

More s/OSCP/OCSP/ typos

ok jmc@


# 1.1 06-Nov-2016 inoguchi

Add regress test script for openssl command.
ok beck@


# 1.31 25-Nov-2019 inoguchi

Add option for cms test in appstest.sh


# 1.30 24-Nov-2019 inoguchi

Add test for cms operations in appstest.sh


# 1.29 20-Nov-2019 inoguchi

Add test for cms -keyopt in appstest.sh


# 1.28 09-Nov-2019 inoguchi

Add test for req -addext in appstest.sh


# 1.27 05-Nov-2019 inoguchi

Remove trailing space in appstest.sh


# 1.26 05-Nov-2019 inoguchi

Add test for cms in appstest.sh


# 1.25 03-Nov-2019 inoguchi

Add RSA-PSS test for genpkey in appstest.sh


# 1.24 31-Oct-2019 inoguchi

Add RSA OAEP test for pkeyutl in appstest.sh


Revision tags: OPENBSD_6_6_BASE
# 1.23 17-Jul-2019 inoguchi

Update appstest.sh

- Add -modulus for dsa sub command
- Remove -nextprotoneg


# 1.22 27-Jun-2019 inoguchi

Add more option tests to req, ts, x509 and verify in appstest.sh


# 1.21 24-Jun-2019 inoguchi

Add more options test to ocsp in appstest.sh


# 1.20 23-Jun-2019 inoguchi

Add more option test to dgst in appstest.sh


# 1.19 22-Jun-2019 inoguchi

Add more option tests to ca in appstest.sh


# 1.18 13-Jun-2019 inoguchi

Add more options to pkcs12 and smime in appstest.sh


# 1.17 10-Jun-2019 inoguchi

Add pkcs12 options and smime tests for appstest.sh

- Add some options to pkcs12 test.
- Add smime tests for encrypt, decrypt and pk7out.


Revision tags: OPENBSD_6_5_BASE
# 1.16 16-Feb-2019 inoguchi

Add tests for pkeyutl


Revision tags: OPENBSD_6_4_BASE
# 1.15 15-Sep-2018 inoguchi

Modify regress appstest.sh for interoperability testing with OpenSSL 1.1.x

- add sleep before s_client instead of removing -pause option
- change check words for s_client output messages
- replace CAfile to CApath for s_time
- remove -prexit from s_client
- confirm openssl command path is executable


# 1.14 14-Sep-2018 inoguchi

Add interoperability test mode for regress appstest.sh

- test s_server and s_client between different version by option -i
- indicate other version by defining OTHER_OPENSSL environment variable
- fix "SSL/TLS" to "TLS/SSL", since TLS is correct as technical term
- s/SKIPPNG/SKIPPING/


# 1.13 08-Sep-2018 inoguchi

Fix indent and adjust line fit to 80 columns.


# 1.12 08-Sep-2018 inoguchi

Split test blocks into a function. Test contents are not changed.


# 1.11 08-Sep-2018 inoguchi

Test more ciphers and randomize the order in regress appstest.sh

- change test target ciphers
- randomize the test ciphers order
- display test cipher count


# 1.10 07-Sep-2018 inoguchi

tests all available TLSv1.2 ciphers


# 1.9 27-Aug-2018 inoguchi

Add protocol and cipher patterns in regress appstest.sh


# 1.8 26-Aug-2018 inoguchi

Stop s_server if error occurs in regress appstest.sh


# 1.7 23-Aug-2018 inoguchi

Add license header.


# 1.6 23-Aug-2018 inoguchi

Check reusing SSL/TLS session ticket by regression test

- Added checking for session ticket reusing with using openssl(1) s_server and
s_client command in appstest.sh
- Confirm certificate verification status.
- Save s_server message to log file.

ok tb@ and jsing@


# 1.5 10-Apr-2018 tb

tweak usage()


Revision tags: OPENBSD_6_3_BASE
# 1.4 19-Mar-2018 beck

Add a -q (for quick) mode to apptest.sh, and use it by default.
this means that running the regression test doesn't take forever
because we run a huge dhparam test and openssl speed tests.

ok inoguchi@


# 1.3 06-Feb-2018 tb

Respect the OPENSSL make variable everywhere so that

make OPENSSL=/usr/src/usr.bin/openssl/obj/openssl

actually does the expected thing instead of running a mixture of both the
openssl below /usr/obj and the one below /usr/bin. Found the hard way via
backtraces that made no sense whatsoever.

ok jsing


Revision tags: OPENBSD_6_1_BASE OPENBSD_6_2_BASE
# 1.2 27-Jan-2017 tom

More s/OSCP/OCSP/ typos

ok jmc@


# 1.1 06-Nov-2016 inoguchi

Add regress test script for openssl command.
ok beck@


# 1.30 24-Nov-2019 inoguchi

Add test for cms operations in appstest.sh


# 1.29 20-Nov-2019 inoguchi

Add test for cms -keyopt in appstest.sh


# 1.28 09-Nov-2019 inoguchi

Add test for req -addext in appstest.sh


# 1.27 05-Nov-2019 inoguchi

Remove trailing space in appstest.sh


# 1.26 05-Nov-2019 inoguchi

Add test for cms in appstest.sh


# 1.25 03-Nov-2019 inoguchi

Add RSA-PSS test for genpkey in appstest.sh


# 1.24 31-Oct-2019 inoguchi

Add RSA OAEP test for pkeyutl in appstest.sh


Revision tags: OPENBSD_6_6_BASE
# 1.23 17-Jul-2019 inoguchi

Update appstest.sh

- Add -modulus for dsa sub command
- Remove -nextprotoneg


# 1.22 27-Jun-2019 inoguchi

Add more option tests to req, ts, x509 and verify in appstest.sh


# 1.21 24-Jun-2019 inoguchi

Add more options test to ocsp in appstest.sh


# 1.20 23-Jun-2019 inoguchi

Add more option test to dgst in appstest.sh


# 1.19 22-Jun-2019 inoguchi

Add more option tests to ca in appstest.sh


# 1.18 13-Jun-2019 inoguchi

Add more options to pkcs12 and smime in appstest.sh


# 1.17 10-Jun-2019 inoguchi

Add pkcs12 options and smime tests for appstest.sh

- Add some options to pkcs12 test.
- Add smime tests for encrypt, decrypt and pk7out.


Revision tags: OPENBSD_6_5_BASE
# 1.16 16-Feb-2019 inoguchi

Add tests for pkeyutl


Revision tags: OPENBSD_6_4_BASE
# 1.15 15-Sep-2018 inoguchi

Modify regress appstest.sh for interoperability testing with OpenSSL 1.1.x

- add sleep before s_client instead of removing -pause option
- change check words for s_client output messages
- replace CAfile to CApath for s_time
- remove -prexit from s_client
- confirm openssl command path is executable


# 1.14 14-Sep-2018 inoguchi

Add interoperability test mode for regress appstest.sh

- test s_server and s_client between different version by option -i
- indicate other version by defining OTHER_OPENSSL environment variable
- fix "SSL/TLS" to "TLS/SSL", since TLS is correct as technical term
- s/SKIPPNG/SKIPPING/


# 1.13 08-Sep-2018 inoguchi

Fix indent and adjust line fit to 80 columns.


# 1.12 08-Sep-2018 inoguchi

Split test blocks into a function. Test contents are not changed.


# 1.11 08-Sep-2018 inoguchi

Test more ciphers and randomize the order in regress appstest.sh

- change test target ciphers
- randomize the test ciphers order
- display test cipher count


# 1.10 07-Sep-2018 inoguchi

tests all available TLSv1.2 ciphers


# 1.9 27-Aug-2018 inoguchi

Add protocol and cipher patterns in regress appstest.sh


# 1.8 26-Aug-2018 inoguchi

Stop s_server if error occurs in regress appstest.sh


# 1.7 23-Aug-2018 inoguchi

Add license header.


# 1.6 23-Aug-2018 inoguchi

Check reusing SSL/TLS session ticket by regression test

- Added checking for session ticket reusing with using openssl(1) s_server and
s_client command in appstest.sh
- Confirm certificate verification status.
- Save s_server message to log file.

ok tb@ and jsing@


# 1.5 10-Apr-2018 tb

tweak usage()


Revision tags: OPENBSD_6_3_BASE
# 1.4 19-Mar-2018 beck

Add a -q (for quick) mode to apptest.sh, and use it by default.
this means that running the regression test doesn't take forever
because we run a huge dhparam test and openssl speed tests.

ok inoguchi@


# 1.3 06-Feb-2018 tb

Respect the OPENSSL make variable everywhere so that

make OPENSSL=/usr/src/usr.bin/openssl/obj/openssl

actually does the expected thing instead of running a mixture of both the
openssl below /usr/obj and the one below /usr/bin. Found the hard way via
backtraces that made no sense whatsoever.

ok jsing


Revision tags: OPENBSD_6_1_BASE OPENBSD_6_2_BASE
# 1.2 27-Jan-2017 tom

More s/OSCP/OCSP/ typos

ok jmc@


# 1.1 06-Nov-2016 inoguchi

Add regress test script for openssl command.
ok beck@


# 1.29 20-Nov-2019 inoguchi

Add test for cms -keyopt in appstest.sh


# 1.28 09-Nov-2019 inoguchi

Add test for req -addext in appstest.sh


# 1.27 05-Nov-2019 inoguchi

Remove trailing space in appstest.sh


# 1.26 05-Nov-2019 inoguchi

Add test for cms in appstest.sh


# 1.25 03-Nov-2019 inoguchi

Add RSA-PSS test for genpkey in appstest.sh


# 1.24 31-Oct-2019 inoguchi

Add RSA OAEP test for pkeyutl in appstest.sh


Revision tags: OPENBSD_6_6_BASE
# 1.23 17-Jul-2019 inoguchi

Update appstest.sh

- Add -modulus for dsa sub command
- Remove -nextprotoneg


# 1.22 27-Jun-2019 inoguchi

Add more option tests to req, ts, x509 and verify in appstest.sh


# 1.21 24-Jun-2019 inoguchi

Add more options test to ocsp in appstest.sh


# 1.20 23-Jun-2019 inoguchi

Add more option test to dgst in appstest.sh


# 1.19 22-Jun-2019 inoguchi

Add more option tests to ca in appstest.sh


# 1.18 13-Jun-2019 inoguchi

Add more options to pkcs12 and smime in appstest.sh


# 1.17 10-Jun-2019 inoguchi

Add pkcs12 options and smime tests for appstest.sh

- Add some options to pkcs12 test.
- Add smime tests for encrypt, decrypt and pk7out.


Revision tags: OPENBSD_6_5_BASE
# 1.16 16-Feb-2019 inoguchi

Add tests for pkeyutl


Revision tags: OPENBSD_6_4_BASE
# 1.15 15-Sep-2018 inoguchi

Modify regress appstest.sh for interoperability testing with OpenSSL 1.1.x

- add sleep before s_client instead of removing -pause option
- change check words for s_client output messages
- replace CAfile to CApath for s_time
- remove -prexit from s_client
- confirm openssl command path is executable


# 1.14 14-Sep-2018 inoguchi

Add interoperability test mode for regress appstest.sh

- test s_server and s_client between different version by option -i
- indicate other version by defining OTHER_OPENSSL environment variable
- fix "SSL/TLS" to "TLS/SSL", since TLS is correct as technical term
- s/SKIPPNG/SKIPPING/


# 1.13 08-Sep-2018 inoguchi

Fix indent and adjust line fit to 80 columns.


# 1.12 08-Sep-2018 inoguchi

Split test blocks into a function. Test contents are not changed.


# 1.11 08-Sep-2018 inoguchi

Test more ciphers and randomize the order in regress appstest.sh

- change test target ciphers
- randomize the test ciphers order
- display test cipher count


# 1.10 07-Sep-2018 inoguchi

tests all available TLSv1.2 ciphers


# 1.9 27-Aug-2018 inoguchi

Add protocol and cipher patterns in regress appstest.sh


# 1.8 26-Aug-2018 inoguchi

Stop s_server if error occurs in regress appstest.sh


# 1.7 23-Aug-2018 inoguchi

Add license header.


# 1.6 23-Aug-2018 inoguchi

Check reusing SSL/TLS session ticket by regression test

- Added checking for session ticket reusing with using openssl(1) s_server and
s_client command in appstest.sh
- Confirm certificate verification status.
- Save s_server message to log file.

ok tb@ and jsing@


# 1.5 10-Apr-2018 tb

tweak usage()


Revision tags: OPENBSD_6_3_BASE
# 1.4 19-Mar-2018 beck

Add a -q (for quick) mode to apptest.sh, and use it by default.
this means that running the regression test doesn't take forever
because we run a huge dhparam test and openssl speed tests.

ok inoguchi@


# 1.3 06-Feb-2018 tb

Respect the OPENSSL make variable everywhere so that

make OPENSSL=/usr/src/usr.bin/openssl/obj/openssl

actually does the expected thing instead of running a mixture of both the
openssl below /usr/obj and the one below /usr/bin. Found the hard way via
backtraces that made no sense whatsoever.

ok jsing


Revision tags: OPENBSD_6_1_BASE OPENBSD_6_2_BASE
# 1.2 27-Jan-2017 tom

More s/OSCP/OCSP/ typos

ok jmc@


# 1.1 06-Nov-2016 inoguchi

Add regress test script for openssl command.
ok beck@


# 1.28 09-Nov-2019 inoguchi

Add test for req -addext in appstest.sh


# 1.27 05-Nov-2019 inoguchi

Remove trailing space in appstest.sh


# 1.26 05-Nov-2019 inoguchi

Add test for cms in appstest.sh


# 1.25 03-Nov-2019 inoguchi

Add RSA-PSS test for genpkey in appstest.sh


# 1.24 31-Oct-2019 inoguchi

Add RSA OAEP test for pkeyutl in appstest.sh


Revision tags: OPENBSD_6_6_BASE
# 1.23 17-Jul-2019 inoguchi

Update appstest.sh

- Add -modulus for dsa sub command
- Remove -nextprotoneg


# 1.22 27-Jun-2019 inoguchi

Add more option tests to req, ts, x509 and verify in appstest.sh


# 1.21 24-Jun-2019 inoguchi

Add more options test to ocsp in appstest.sh


# 1.20 23-Jun-2019 inoguchi

Add more option test to dgst in appstest.sh


# 1.19 22-Jun-2019 inoguchi

Add more option tests to ca in appstest.sh


# 1.18 13-Jun-2019 inoguchi

Add more options to pkcs12 and smime in appstest.sh


# 1.17 10-Jun-2019 inoguchi

Add pkcs12 options and smime tests for appstest.sh

- Add some options to pkcs12 test.
- Add smime tests for encrypt, decrypt and pk7out.


Revision tags: OPENBSD_6_5_BASE
# 1.16 16-Feb-2019 inoguchi

Add tests for pkeyutl


Revision tags: OPENBSD_6_4_BASE
# 1.15 15-Sep-2018 inoguchi

Modify regress appstest.sh for interoperability testing with OpenSSL 1.1.x

- add sleep before s_client instead of removing -pause option
- change check words for s_client output messages
- replace CAfile to CApath for s_time
- remove -prexit from s_client
- confirm openssl command path is executable


# 1.14 14-Sep-2018 inoguchi

Add interoperability test mode for regress appstest.sh

- test s_server and s_client between different version by option -i
- indicate other version by defining OTHER_OPENSSL environment variable
- fix "SSL/TLS" to "TLS/SSL", since TLS is correct as technical term
- s/SKIPPNG/SKIPPING/


# 1.13 08-Sep-2018 inoguchi

Fix indent and adjust line fit to 80 columns.


# 1.12 08-Sep-2018 inoguchi

Split test blocks into a function. Test contents are not changed.


# 1.11 08-Sep-2018 inoguchi

Test more ciphers and randomize the order in regress appstest.sh

- change test target ciphers
- randomize the test ciphers order
- display test cipher count


# 1.10 07-Sep-2018 inoguchi

tests all available TLSv1.2 ciphers


# 1.9 27-Aug-2018 inoguchi

Add protocol and cipher patterns in regress appstest.sh


# 1.8 26-Aug-2018 inoguchi

Stop s_server if error occurs in regress appstest.sh


# 1.7 23-Aug-2018 inoguchi

Add license header.


# 1.6 23-Aug-2018 inoguchi

Check reusing SSL/TLS session ticket by regression test

- Added checking for session ticket reusing with using openssl(1) s_server and
s_client command in appstest.sh
- Confirm certificate verification status.
- Save s_server message to log file.

ok tb@ and jsing@


# 1.5 10-Apr-2018 tb

tweak usage()


Revision tags: OPENBSD_6_3_BASE
# 1.4 19-Mar-2018 beck

Add a -q (for quick) mode to apptest.sh, and use it by default.
this means that running the regression test doesn't take forever
because we run a huge dhparam test and openssl speed tests.

ok inoguchi@


# 1.3 06-Feb-2018 tb

Respect the OPENSSL make variable everywhere so that

make OPENSSL=/usr/src/usr.bin/openssl/obj/openssl

actually does the expected thing instead of running a mixture of both the
openssl below /usr/obj and the one below /usr/bin. Found the hard way via
backtraces that made no sense whatsoever.

ok jsing


Revision tags: OPENBSD_6_1_BASE OPENBSD_6_2_BASE
# 1.2 27-Jan-2017 tom

More s/OSCP/OCSP/ typos

ok jmc@


# 1.1 06-Nov-2016 inoguchi

Add regress test script for openssl command.
ok beck@


# 1.27 05-Nov-2019 inoguchi

Remove trailing space in appstest.sh


# 1.26 05-Nov-2019 inoguchi

Add test for cms in appstest.sh


# 1.25 03-Nov-2019 inoguchi

Add RSA-PSS test for genpkey in appstest.sh


# 1.24 31-Oct-2019 inoguchi

Add RSA OAEP test for pkeyutl in appstest.sh


Revision tags: OPENBSD_6_6_BASE
# 1.23 17-Jul-2019 inoguchi

Update appstest.sh

- Add -modulus for dsa sub command
- Remove -nextprotoneg


# 1.22 27-Jun-2019 inoguchi

Add more option tests to req, ts, x509 and verify in appstest.sh


# 1.21 24-Jun-2019 inoguchi

Add more options test to ocsp in appstest.sh


# 1.20 23-Jun-2019 inoguchi

Add more option test to dgst in appstest.sh


# 1.19 22-Jun-2019 inoguchi

Add more option tests to ca in appstest.sh


# 1.18 13-Jun-2019 inoguchi

Add more options to pkcs12 and smime in appstest.sh


# 1.17 10-Jun-2019 inoguchi

Add pkcs12 options and smime tests for appstest.sh

- Add some options to pkcs12 test.
- Add smime tests for encrypt, decrypt and pk7out.


Revision tags: OPENBSD_6_5_BASE
# 1.16 16-Feb-2019 inoguchi

Add tests for pkeyutl


Revision tags: OPENBSD_6_4_BASE
# 1.15 15-Sep-2018 inoguchi

Modify regress appstest.sh for interoperability testing with OpenSSL 1.1.x

- add sleep before s_client instead of removing -pause option
- change check words for s_client output messages
- replace CAfile to CApath for s_time
- remove -prexit from s_client
- confirm openssl command path is executable


# 1.14 14-Sep-2018 inoguchi

Add interoperability test mode for regress appstest.sh

- test s_server and s_client between different version by option -i
- indicate other version by defining OTHER_OPENSSL environment variable
- fix "SSL/TLS" to "TLS/SSL", since TLS is correct as technical term
- s/SKIPPNG/SKIPPING/


# 1.13 08-Sep-2018 inoguchi

Fix indent and adjust line fit to 80 columns.


# 1.12 08-Sep-2018 inoguchi

Split test blocks into a function. Test contents are not changed.


# 1.11 08-Sep-2018 inoguchi

Test more ciphers and randomize the order in regress appstest.sh

- change test target ciphers
- randomize the test ciphers order
- display test cipher count


# 1.10 07-Sep-2018 inoguchi

tests all available TLSv1.2 ciphers


# 1.9 27-Aug-2018 inoguchi

Add protocol and cipher patterns in regress appstest.sh


# 1.8 26-Aug-2018 inoguchi

Stop s_server if error occurs in regress appstest.sh


# 1.7 23-Aug-2018 inoguchi

Add license header.


# 1.6 23-Aug-2018 inoguchi

Check reusing SSL/TLS session ticket by regression test

- Added checking for session ticket reusing with using openssl(1) s_server and
s_client command in appstest.sh
- Confirm certificate verification status.
- Save s_server message to log file.

ok tb@ and jsing@


# 1.5 10-Apr-2018 tb

tweak usage()


Revision tags: OPENBSD_6_3_BASE
# 1.4 19-Mar-2018 beck

Add a -q (for quick) mode to apptest.sh, and use it by default.
this means that running the regression test doesn't take forever
because we run a huge dhparam test and openssl speed tests.

ok inoguchi@


# 1.3 06-Feb-2018 tb

Respect the OPENSSL make variable everywhere so that

make OPENSSL=/usr/src/usr.bin/openssl/obj/openssl

actually does the expected thing instead of running a mixture of both the
openssl below /usr/obj and the one below /usr/bin. Found the hard way via
backtraces that made no sense whatsoever.

ok jsing


Revision tags: OPENBSD_6_1_BASE OPENBSD_6_2_BASE
# 1.2 27-Jan-2017 tom

More s/OSCP/OCSP/ typos

ok jmc@


# 1.1 06-Nov-2016 inoguchi

Add regress test script for openssl command.
ok beck@


# 1.25 03-Nov-2019 inoguchi

Add RSA-PSS test for genpkey in appstest.sh


# 1.24 31-Oct-2019 inoguchi

Add RSA OAEP test for pkeyutl in appstest.sh


Revision tags: OPENBSD_6_6_BASE
# 1.23 17-Jul-2019 inoguchi

Update appstest.sh

- Add -modulus for dsa sub command
- Remove -nextprotoneg


# 1.22 27-Jun-2019 inoguchi

Add more option tests to req, ts, x509 and verify in appstest.sh


# 1.21 24-Jun-2019 inoguchi

Add more options test to ocsp in appstest.sh


# 1.20 23-Jun-2019 inoguchi

Add more option test to dgst in appstest.sh


# 1.19 22-Jun-2019 inoguchi

Add more option tests to ca in appstest.sh


# 1.18 13-Jun-2019 inoguchi

Add more options to pkcs12 and smime in appstest.sh


# 1.17 10-Jun-2019 inoguchi

Add pkcs12 options and smime tests for appstest.sh

- Add some options to pkcs12 test.
- Add smime tests for encrypt, decrypt and pk7out.


Revision tags: OPENBSD_6_5_BASE
# 1.16 16-Feb-2019 inoguchi

Add tests for pkeyutl


Revision tags: OPENBSD_6_4_BASE
# 1.15 15-Sep-2018 inoguchi

Modify regress appstest.sh for interoperability testing with OpenSSL 1.1.x

- add sleep before s_client instead of removing -pause option
- change check words for s_client output messages
- replace CAfile to CApath for s_time
- remove -prexit from s_client
- confirm openssl command path is executable


# 1.14 14-Sep-2018 inoguchi

Add interoperability test mode for regress appstest.sh

- test s_server and s_client between different version by option -i
- indicate other version by defining OTHER_OPENSSL environment variable
- fix "SSL/TLS" to "TLS/SSL", since TLS is correct as technical term
- s/SKIPPNG/SKIPPING/


# 1.13 08-Sep-2018 inoguchi

Fix indent and adjust line fit to 80 columns.


# 1.12 08-Sep-2018 inoguchi

Split test blocks into a function. Test contents are not changed.


# 1.11 08-Sep-2018 inoguchi

Test more ciphers and randomize the order in regress appstest.sh

- change test target ciphers
- randomize the test ciphers order
- display test cipher count


# 1.10 07-Sep-2018 inoguchi

tests all available TLSv1.2 ciphers


# 1.9 27-Aug-2018 inoguchi

Add protocol and cipher patterns in regress appstest.sh


# 1.8 26-Aug-2018 inoguchi

Stop s_server if error occurs in regress appstest.sh


# 1.7 23-Aug-2018 inoguchi

Add license header.


# 1.6 23-Aug-2018 inoguchi

Check reusing SSL/TLS session ticket by regression test

- Added checking for session ticket reusing with using openssl(1) s_server and
s_client command in appstest.sh
- Confirm certificate verification status.
- Save s_server message to log file.

ok tb@ and jsing@


# 1.5 10-Apr-2018 tb

tweak usage()


Revision tags: OPENBSD_6_3_BASE
# 1.4 19-Mar-2018 beck

Add a -q (for quick) mode to apptest.sh, and use it by default.
this means that running the regression test doesn't take forever
because we run a huge dhparam test and openssl speed tests.

ok inoguchi@


# 1.3 06-Feb-2018 tb

Respect the OPENSSL make variable everywhere so that

make OPENSSL=/usr/src/usr.bin/openssl/obj/openssl

actually does the expected thing instead of running a mixture of both the
openssl below /usr/obj and the one below /usr/bin. Found the hard way via
backtraces that made no sense whatsoever.

ok jsing


Revision tags: OPENBSD_6_1_BASE OPENBSD_6_2_BASE
# 1.2 27-Jan-2017 tom

More s/OSCP/OCSP/ typos

ok jmc@


# 1.1 06-Nov-2016 inoguchi

Add regress test script for openssl command.
ok beck@


# 1.24 31-Oct-2019 inoguchi

Add RSA OAEP test for pkeyutl in appstest.sh


Revision tags: OPENBSD_6_6_BASE
# 1.23 17-Jul-2019 inoguchi

Update appstest.sh

- Add -modulus for dsa sub command
- Remove -nextprotoneg


# 1.22 27-Jun-2019 inoguchi

Add more option tests to req, ts, x509 and verify in appstest.sh


# 1.21 24-Jun-2019 inoguchi

Add more options test to ocsp in appstest.sh


# 1.20 23-Jun-2019 inoguchi

Add more option test to dgst in appstest.sh


# 1.19 22-Jun-2019 inoguchi

Add more option tests to ca in appstest.sh


# 1.18 13-Jun-2019 inoguchi

Add more options to pkcs12 and smime in appstest.sh


# 1.17 10-Jun-2019 inoguchi

Add pkcs12 options and smime tests for appstest.sh

- Add some options to pkcs12 test.
- Add smime tests for encrypt, decrypt and pk7out.


Revision tags: OPENBSD_6_5_BASE
# 1.16 16-Feb-2019 inoguchi

Add tests for pkeyutl


Revision tags: OPENBSD_6_4_BASE
# 1.15 15-Sep-2018 inoguchi

Modify regress appstest.sh for interoperability testing with OpenSSL 1.1.x

- add sleep before s_client instead of removing -pause option
- change check words for s_client output messages
- replace CAfile to CApath for s_time
- remove -prexit from s_client
- confirm openssl command path is executable


# 1.14 14-Sep-2018 inoguchi

Add interoperability test mode for regress appstest.sh

- test s_server and s_client between different version by option -i
- indicate other version by defining OTHER_OPENSSL environment variable
- fix "SSL/TLS" to "TLS/SSL", since TLS is correct as technical term
- s/SKIPPNG/SKIPPING/


# 1.13 08-Sep-2018 inoguchi

Fix indent and adjust line fit to 80 columns.


# 1.12 08-Sep-2018 inoguchi

Split test blocks into a function. Test contents are not changed.


# 1.11 08-Sep-2018 inoguchi

Test more ciphers and randomize the order in regress appstest.sh

- change test target ciphers
- randomize the test ciphers order
- display test cipher count


# 1.10 07-Sep-2018 inoguchi

tests all available TLSv1.2 ciphers


# 1.9 27-Aug-2018 inoguchi

Add protocol and cipher patterns in regress appstest.sh


# 1.8 26-Aug-2018 inoguchi

Stop s_server if error occurs in regress appstest.sh


# 1.7 23-Aug-2018 inoguchi

Add license header.


# 1.6 23-Aug-2018 inoguchi

Check reusing SSL/TLS session ticket by regression test

- Added checking for session ticket reusing with using openssl(1) s_server and
s_client command in appstest.sh
- Confirm certificate verification status.
- Save s_server message to log file.

ok tb@ and jsing@


# 1.5 10-Apr-2018 tb

tweak usage()


Revision tags: OPENBSD_6_3_BASE
# 1.4 19-Mar-2018 beck

Add a -q (for quick) mode to apptest.sh, and use it by default.
this means that running the regression test doesn't take forever
because we run a huge dhparam test and openssl speed tests.

ok inoguchi@


# 1.3 06-Feb-2018 tb

Respect the OPENSSL make variable everywhere so that

make OPENSSL=/usr/src/usr.bin/openssl/obj/openssl

actually does the expected thing instead of running a mixture of both the
openssl below /usr/obj and the one below /usr/bin. Found the hard way via
backtraces that made no sense whatsoever.

ok jsing


Revision tags: OPENBSD_6_1_BASE OPENBSD_6_2_BASE
# 1.2 27-Jan-2017 tom

More s/OSCP/OCSP/ typos

ok jmc@


# 1.1 06-Nov-2016 inoguchi

Add regress test script for openssl command.
ok beck@


# 1.23 17-Jul-2019 inoguchi

Update appstest.sh

- Add -modulus for dsa sub command
- Remove -nextprotoneg


# 1.22 27-Jun-2019 inoguchi

Add more option tests to req, ts, x509 and verify in appstest.sh


# 1.21 24-Jun-2019 inoguchi

Add more options test to ocsp in appstest.sh


# 1.20 23-Jun-2019 inoguchi

Add more option test to dgst in appstest.sh


# 1.19 22-Jun-2019 inoguchi

Add more option tests to ca in appstest.sh


# 1.18 13-Jun-2019 inoguchi

Add more options to pkcs12 and smime in appstest.sh


# 1.17 10-Jun-2019 inoguchi

Add pkcs12 options and smime tests for appstest.sh

- Add some options to pkcs12 test.
- Add smime tests for encrypt, decrypt and pk7out.


Revision tags: OPENBSD_6_5_BASE
# 1.16 16-Feb-2019 inoguchi

Add tests for pkeyutl


Revision tags: OPENBSD_6_4_BASE
# 1.15 15-Sep-2018 inoguchi

Modify regress appstest.sh for interoperability testing with OpenSSL 1.1.x

- add sleep before s_client instead of removing -pause option
- change check words for s_client output messages
- replace CAfile to CApath for s_time
- remove -prexit from s_client
- confirm openssl command path is executable


# 1.14 14-Sep-2018 inoguchi

Add interoperability test mode for regress appstest.sh

- test s_server and s_client between different version by option -i
- indicate other version by defining OTHER_OPENSSL environment variable
- fix "SSL/TLS" to "TLS/SSL", since TLS is correct as technical term
- s/SKIPPNG/SKIPPING/


# 1.13 08-Sep-2018 inoguchi

Fix indent and adjust line fit to 80 columns.


# 1.12 08-Sep-2018 inoguchi

Split test blocks into a function. Test contents are not changed.


# 1.11 08-Sep-2018 inoguchi

Test more ciphers and randomize the order in regress appstest.sh

- change test target ciphers
- randomize the test ciphers order
- display test cipher count


# 1.10 07-Sep-2018 inoguchi

tests all available TLSv1.2 ciphers


# 1.9 27-Aug-2018 inoguchi

Add protocol and cipher patterns in regress appstest.sh


# 1.8 26-Aug-2018 inoguchi

Stop s_server if error occurs in regress appstest.sh


# 1.7 23-Aug-2018 inoguchi

Add license header.


# 1.6 23-Aug-2018 inoguchi

Check reusing SSL/TLS session ticket by regression test

- Added checking for session ticket reusing with using openssl(1) s_server and
s_client command in appstest.sh
- Confirm certificate verification status.
- Save s_server message to log file.

ok tb@ and jsing@


# 1.5 10-Apr-2018 tb

tweak usage()


Revision tags: OPENBSD_6_3_BASE
# 1.4 19-Mar-2018 beck

Add a -q (for quick) mode to apptest.sh, and use it by default.
this means that running the regression test doesn't take forever
because we run a huge dhparam test and openssl speed tests.

ok inoguchi@


# 1.3 06-Feb-2018 tb

Respect the OPENSSL make variable everywhere so that

make OPENSSL=/usr/src/usr.bin/openssl/obj/openssl

actually does the expected thing instead of running a mixture of both the
openssl below /usr/obj and the one below /usr/bin. Found the hard way via
backtraces that made no sense whatsoever.

ok jsing


Revision tags: OPENBSD_6_1_BASE OPENBSD_6_2_BASE
# 1.2 27-Jan-2017 tom

More s/OSCP/OCSP/ typos

ok jmc@


# 1.1 06-Nov-2016 inoguchi

Add regress test script for openssl command.
ok beck@


# 1.22 27-Jun-2019 inoguchi

Add more option tests to req, ts, x509 and verify in appstest.sh


# 1.21 24-Jun-2019 inoguchi

Add more options test to ocsp in appstest.sh


# 1.20 23-Jun-2019 inoguchi

Add more option test to dgst in appstest.sh


# 1.19 22-Jun-2019 inoguchi

Add more option tests to ca in appstest.sh


# 1.18 13-Jun-2019 inoguchi

Add more options to pkcs12 and smime in appstest.sh


# 1.17 10-Jun-2019 inoguchi

Add pkcs12 options and smime tests for appstest.sh

- Add some options to pkcs12 test.
- Add smime tests for encrypt, decrypt and pk7out.


Revision tags: OPENBSD_6_5_BASE
# 1.16 16-Feb-2019 inoguchi

Add tests for pkeyutl


Revision tags: OPENBSD_6_4_BASE
# 1.15 15-Sep-2018 inoguchi

Modify regress appstest.sh for interoperability testing with OpenSSL 1.1.x

- add sleep before s_client instead of removing -pause option
- change check words for s_client output messages
- replace CAfile to CApath for s_time
- remove -prexit from s_client
- confirm openssl command path is executable


# 1.14 14-Sep-2018 inoguchi

Add interoperability test mode for regress appstest.sh

- test s_server and s_client between different version by option -i
- indicate other version by defining OTHER_OPENSSL environment variable
- fix "SSL/TLS" to "TLS/SSL", since TLS is correct as technical term
- s/SKIPPNG/SKIPPING/


# 1.13 08-Sep-2018 inoguchi

Fix indent and adjust line fit to 80 columns.


# 1.12 08-Sep-2018 inoguchi

Split test blocks into a function. Test contents are not changed.


# 1.11 08-Sep-2018 inoguchi

Test more ciphers and randomize the order in regress appstest.sh

- change test target ciphers
- randomize the test ciphers order
- display test cipher count


# 1.10 07-Sep-2018 inoguchi

tests all available TLSv1.2 ciphers


# 1.9 27-Aug-2018 inoguchi

Add protocol and cipher patterns in regress appstest.sh


# 1.8 26-Aug-2018 inoguchi

Stop s_server if error occurs in regress appstest.sh


# 1.7 23-Aug-2018 inoguchi

Add license header.


# 1.6 23-Aug-2018 inoguchi

Check reusing SSL/TLS session ticket by regression test

- Added checking for session ticket reusing with using openssl(1) s_server and
s_client command in appstest.sh
- Confirm certificate verification status.
- Save s_server message to log file.

ok tb@ and jsing@


# 1.5 10-Apr-2018 tb

tweak usage()


Revision tags: OPENBSD_6_3_BASE
# 1.4 19-Mar-2018 beck

Add a -q (for quick) mode to apptest.sh, and use it by default.
this means that running the regression test doesn't take forever
because we run a huge dhparam test and openssl speed tests.

ok inoguchi@


# 1.3 06-Feb-2018 tb

Respect the OPENSSL make variable everywhere so that

make OPENSSL=/usr/src/usr.bin/openssl/obj/openssl

actually does the expected thing instead of running a mixture of both the
openssl below /usr/obj and the one below /usr/bin. Found the hard way via
backtraces that made no sense whatsoever.

ok jsing


Revision tags: OPENBSD_6_1_BASE OPENBSD_6_2_BASE
# 1.2 27-Jan-2017 tom

More s/OSCP/OCSP/ typos

ok jmc@


# 1.1 06-Nov-2016 inoguchi

Add regress test script for openssl command.
ok beck@


# 1.21 24-Jun-2019 inoguchi

Add more options test to ocsp in appstest.sh


# 1.20 23-Jun-2019 inoguchi

Add more option test to dgst in appstest.sh


# 1.19 22-Jun-2019 inoguchi

Add more option tests to ca in appstest.sh


# 1.18 13-Jun-2019 inoguchi

Add more options to pkcs12 and smime in appstest.sh


# 1.17 10-Jun-2019 inoguchi

Add pkcs12 options and smime tests for appstest.sh

- Add some options to pkcs12 test.
- Add smime tests for encrypt, decrypt and pk7out.


Revision tags: OPENBSD_6_5_BASE
# 1.16 16-Feb-2019 inoguchi

Add tests for pkeyutl


Revision tags: OPENBSD_6_4_BASE
# 1.15 15-Sep-2018 inoguchi

Modify regress appstest.sh for interoperability testing with OpenSSL 1.1.x

- add sleep before s_client instead of removing -pause option
- change check words for s_client output messages
- replace CAfile to CApath for s_time
- remove -prexit from s_client
- confirm openssl command path is executable


# 1.14 14-Sep-2018 inoguchi

Add interoperability test mode for regress appstest.sh

- test s_server and s_client between different version by option -i
- indicate other version by defining OTHER_OPENSSL environment variable
- fix "SSL/TLS" to "TLS/SSL", since TLS is correct as technical term
- s/SKIPPNG/SKIPPING/


# 1.13 08-Sep-2018 inoguchi

Fix indent and adjust line fit to 80 columns.


# 1.12 08-Sep-2018 inoguchi

Split test blocks into a function. Test contents are not changed.


# 1.11 08-Sep-2018 inoguchi

Test more ciphers and randomize the order in regress appstest.sh

- change test target ciphers
- randomize the test ciphers order
- display test cipher count


# 1.10 07-Sep-2018 inoguchi

tests all available TLSv1.2 ciphers


# 1.9 27-Aug-2018 inoguchi

Add protocol and cipher patterns in regress appstest.sh


# 1.8 26-Aug-2018 inoguchi

Stop s_server if error occurs in regress appstest.sh


# 1.7 23-Aug-2018 inoguchi

Add license header.


# 1.6 23-Aug-2018 inoguchi

Check reusing SSL/TLS session ticket by regression test

- Added checking for session ticket reusing with using openssl(1) s_server and
s_client command in appstest.sh
- Confirm certificate verification status.
- Save s_server message to log file.

ok tb@ and jsing@


# 1.5 10-Apr-2018 tb

tweak usage()


Revision tags: OPENBSD_6_3_BASE
# 1.4 19-Mar-2018 beck

Add a -q (for quick) mode to apptest.sh, and use it by default.
this means that running the regression test doesn't take forever
because we run a huge dhparam test and openssl speed tests.

ok inoguchi@


# 1.3 06-Feb-2018 tb

Respect the OPENSSL make variable everywhere so that

make OPENSSL=/usr/src/usr.bin/openssl/obj/openssl

actually does the expected thing instead of running a mixture of both the
openssl below /usr/obj and the one below /usr/bin. Found the hard way via
backtraces that made no sense whatsoever.

ok jsing


Revision tags: OPENBSD_6_1_BASE OPENBSD_6_2_BASE
# 1.2 27-Jan-2017 tom

More s/OSCP/OCSP/ typos

ok jmc@


# 1.1 06-Nov-2016 inoguchi

Add regress test script for openssl command.
ok beck@


# 1.20 23-Jun-2019 inoguchi

Add more option test to dgst in appstest.sh


# 1.19 22-Jun-2019 inoguchi

Add more option tests to ca in appstest.sh


# 1.18 13-Jun-2019 inoguchi

Add more options to pkcs12 and smime in appstest.sh


# 1.17 10-Jun-2019 inoguchi

Add pkcs12 options and smime tests for appstest.sh

- Add some options to pkcs12 test.
- Add smime tests for encrypt, decrypt and pk7out.


Revision tags: OPENBSD_6_5_BASE
# 1.16 16-Feb-2019 inoguchi

Add tests for pkeyutl


Revision tags: OPENBSD_6_4_BASE
# 1.15 15-Sep-2018 inoguchi

Modify regress appstest.sh for interoperability testing with OpenSSL 1.1.x

- add sleep before s_client instead of removing -pause option
- change check words for s_client output messages
- replace CAfile to CApath for s_time
- remove -prexit from s_client
- confirm openssl command path is executable


# 1.14 14-Sep-2018 inoguchi

Add interoperability test mode for regress appstest.sh

- test s_server and s_client between different version by option -i
- indicate other version by defining OTHER_OPENSSL environment variable
- fix "SSL/TLS" to "TLS/SSL", since TLS is correct as technical term
- s/SKIPPNG/SKIPPING/


# 1.13 08-Sep-2018 inoguchi

Fix indent and adjust line fit to 80 columns.


# 1.12 08-Sep-2018 inoguchi

Split test blocks into a function. Test contents are not changed.


# 1.11 08-Sep-2018 inoguchi

Test more ciphers and randomize the order in regress appstest.sh

- change test target ciphers
- randomize the test ciphers order
- display test cipher count


# 1.10 07-Sep-2018 inoguchi

tests all available TLSv1.2 ciphers


# 1.9 27-Aug-2018 inoguchi

Add protocol and cipher patterns in regress appstest.sh


# 1.8 26-Aug-2018 inoguchi

Stop s_server if error occurs in regress appstest.sh


# 1.7 23-Aug-2018 inoguchi

Add license header.


# 1.6 23-Aug-2018 inoguchi

Check reusing SSL/TLS session ticket by regression test

- Added checking for session ticket reusing with using openssl(1) s_server and
s_client command in appstest.sh
- Confirm certificate verification status.
- Save s_server message to log file.

ok tb@ and jsing@


# 1.5 10-Apr-2018 tb

tweak usage()


Revision tags: OPENBSD_6_3_BASE
# 1.4 19-Mar-2018 beck

Add a -q (for quick) mode to apptest.sh, and use it by default.
this means that running the regression test doesn't take forever
because we run a huge dhparam test and openssl speed tests.

ok inoguchi@


# 1.3 06-Feb-2018 tb

Respect the OPENSSL make variable everywhere so that

make OPENSSL=/usr/src/usr.bin/openssl/obj/openssl

actually does the expected thing instead of running a mixture of both the
openssl below /usr/obj and the one below /usr/bin. Found the hard way via
backtraces that made no sense whatsoever.

ok jsing


Revision tags: OPENBSD_6_1_BASE OPENBSD_6_2_BASE
# 1.2 27-Jan-2017 tom

More s/OSCP/OCSP/ typos

ok jmc@


# 1.1 06-Nov-2016 inoguchi

Add regress test script for openssl command.
ok beck@


# 1.18 13-Jun-2019 inoguchi

Add more options to pkcs12 and smime in appstest.sh


# 1.17 10-Jun-2019 inoguchi

Add pkcs12 options and smime tests for appstest.sh

- Add some options to pkcs12 test.
- Add smime tests for encrypt, decrypt and pk7out.


Revision tags: OPENBSD_6_5_BASE
# 1.16 16-Feb-2019 inoguchi

Add tests for pkeyutl


Revision tags: OPENBSD_6_4_BASE
# 1.15 15-Sep-2018 inoguchi

Modify regress appstest.sh for interoperability testing with OpenSSL 1.1.x

- add sleep before s_client instead of removing -pause option
- change check words for s_client output messages
- replace CAfile to CApath for s_time
- remove -prexit from s_client
- confirm openssl command path is executable


# 1.14 14-Sep-2018 inoguchi

Add interoperability test mode for regress appstest.sh

- test s_server and s_client between different version by option -i
- indicate other version by defining OTHER_OPENSSL environment variable
- fix "SSL/TLS" to "TLS/SSL", since TLS is correct as technical term
- s/SKIPPNG/SKIPPING/


# 1.13 08-Sep-2018 inoguchi

Fix indent and adjust line fit to 80 columns.


# 1.12 08-Sep-2018 inoguchi

Split test blocks into a function. Test contents are not changed.


# 1.11 08-Sep-2018 inoguchi

Test more ciphers and randomize the order in regress appstest.sh

- change test target ciphers
- randomize the test ciphers order
- display test cipher count


# 1.10 07-Sep-2018 inoguchi

tests all available TLSv1.2 ciphers


# 1.9 27-Aug-2018 inoguchi

Add protocol and cipher patterns in regress appstest.sh


# 1.8 26-Aug-2018 inoguchi

Stop s_server if error occurs in regress appstest.sh


# 1.7 23-Aug-2018 inoguchi

Add license header.


# 1.6 23-Aug-2018 inoguchi

Check reusing SSL/TLS session ticket by regression test

- Added checking for session ticket reusing with using openssl(1) s_server and
s_client command in appstest.sh
- Confirm certificate verification status.
- Save s_server message to log file.

ok tb@ and jsing@


# 1.5 10-Apr-2018 tb

tweak usage()


Revision tags: OPENBSD_6_3_BASE
# 1.4 19-Mar-2018 beck

Add a -q (for quick) mode to apptest.sh, and use it by default.
this means that running the regression test doesn't take forever
because we run a huge dhparam test and openssl speed tests.

ok inoguchi@


# 1.3 06-Feb-2018 tb

Respect the OPENSSL make variable everywhere so that

make OPENSSL=/usr/src/usr.bin/openssl/obj/openssl

actually does the expected thing instead of running a mixture of both the
openssl below /usr/obj and the one below /usr/bin. Found the hard way via
backtraces that made no sense whatsoever.

ok jsing


Revision tags: OPENBSD_6_1_BASE OPENBSD_6_2_BASE
# 1.2 27-Jan-2017 tom

More s/OSCP/OCSP/ typos

ok jmc@


# 1.1 06-Nov-2016 inoguchi

Add regress test script for openssl command.
ok beck@


# 1.17 10-Jun-2019 inoguchi

Add pkcs12 options and smime tests for appstest.sh

- Add some options to pkcs12 test.
- Add smime tests for encrypt, decrypt and pk7out.


Revision tags: OPENBSD_6_5_BASE
# 1.16 16-Feb-2019 inoguchi

Add tests for pkeyutl


Revision tags: OPENBSD_6_4_BASE
# 1.15 15-Sep-2018 inoguchi

Modify regress appstest.sh for interoperability testing with OpenSSL 1.1.x

- add sleep before s_client instead of removing -pause option
- change check words for s_client output messages
- replace CAfile to CApath for s_time
- remove -prexit from s_client
- confirm openssl command path is executable


# 1.14 14-Sep-2018 inoguchi

Add interoperability test mode for regress appstest.sh

- test s_server and s_client between different version by option -i
- indicate other version by defining OTHER_OPENSSL environment variable
- fix "SSL/TLS" to "TLS/SSL", since TLS is correct as technical term
- s/SKIPPNG/SKIPPING/


# 1.13 08-Sep-2018 inoguchi

Fix indent and adjust line fit to 80 columns.


# 1.12 08-Sep-2018 inoguchi

Split test blocks into a function. Test contents are not changed.


# 1.11 08-Sep-2018 inoguchi

Test more ciphers and randomize the order in regress appstest.sh

- change test target ciphers
- randomize the test ciphers order
- display test cipher count


# 1.10 07-Sep-2018 inoguchi

tests all available TLSv1.2 ciphers


# 1.9 27-Aug-2018 inoguchi

Add protocol and cipher patterns in regress appstest.sh


# 1.8 26-Aug-2018 inoguchi

Stop s_server if error occurs in regress appstest.sh


# 1.7 23-Aug-2018 inoguchi

Add license header.


# 1.6 23-Aug-2018 inoguchi

Check reusing SSL/TLS session ticket by regression test

- Added checking for session ticket reusing with using openssl(1) s_server and
s_client command in appstest.sh
- Confirm certificate verification status.
- Save s_server message to log file.

ok tb@ and jsing@


# 1.5 10-Apr-2018 tb

tweak usage()


Revision tags: OPENBSD_6_3_BASE
# 1.4 19-Mar-2018 beck

Add a -q (for quick) mode to apptest.sh, and use it by default.
this means that running the regression test doesn't take forever
because we run a huge dhparam test and openssl speed tests.

ok inoguchi@


# 1.3 06-Feb-2018 tb

Respect the OPENSSL make variable everywhere so that

make OPENSSL=/usr/src/usr.bin/openssl/obj/openssl

actually does the expected thing instead of running a mixture of both the
openssl below /usr/obj and the one below /usr/bin. Found the hard way via
backtraces that made no sense whatsoever.

ok jsing


Revision tags: OPENBSD_6_1_BASE OPENBSD_6_2_BASE
# 1.2 27-Jan-2017 tom

More s/OSCP/OCSP/ typos

ok jmc@


# 1.1 06-Nov-2016 inoguchi

Add regress test script for openssl command.
ok beck@


# 1.16 16-Feb-2019 inoguchi

Add tests for pkeyutl


Revision tags: OPENBSD_6_4_BASE
# 1.15 15-Sep-2018 inoguchi

Modify regress appstest.sh for interoperability testing with OpenSSL 1.1.x

- add sleep before s_client instead of removing -pause option
- change check words for s_client output messages
- replace CAfile to CApath for s_time
- remove -prexit from s_client
- confirm openssl command path is executable


# 1.14 14-Sep-2018 inoguchi

Add interoperability test mode for regress appstest.sh

- test s_server and s_client between different version by option -i
- indicate other version by defining OTHER_OPENSSL environment variable
- fix "SSL/TLS" to "TLS/SSL", since TLS is correct as technical term
- s/SKIPPNG/SKIPPING/


# 1.13 08-Sep-2018 inoguchi

Fix indent and adjust line fit to 80 columns.


# 1.12 08-Sep-2018 inoguchi

Split test blocks into a function. Test contents are not changed.


# 1.11 08-Sep-2018 inoguchi

Test more ciphers and randomize the order in regress appstest.sh

- change test target ciphers
- randomize the test ciphers order
- display test cipher count


# 1.10 07-Sep-2018 inoguchi

tests all available TLSv1.2 ciphers


# 1.9 27-Aug-2018 inoguchi

Add protocol and cipher patterns in regress appstest.sh


# 1.8 26-Aug-2018 inoguchi

Stop s_server if error occurs in regress appstest.sh


# 1.7 23-Aug-2018 inoguchi

Add license header.


# 1.6 23-Aug-2018 inoguchi

Check reusing SSL/TLS session ticket by regression test

- Added checking for session ticket reusing with using openssl(1) s_server and
s_client command in appstest.sh
- Confirm certificate verification status.
- Save s_server message to log file.

ok tb@ and jsing@


# 1.5 10-Apr-2018 tb

tweak usage()


Revision tags: OPENBSD_6_3_BASE
# 1.4 19-Mar-2018 beck

Add a -q (for quick) mode to apptest.sh, and use it by default.
this means that running the regression test doesn't take forever
because we run a huge dhparam test and openssl speed tests.

ok inoguchi@


# 1.3 06-Feb-2018 tb

Respect the OPENSSL make variable everywhere so that

make OPENSSL=/usr/src/usr.bin/openssl/obj/openssl

actually does the expected thing instead of running a mixture of both the
openssl below /usr/obj and the one below /usr/bin. Found the hard way via
backtraces that made no sense whatsoever.

ok jsing


Revision tags: OPENBSD_6_1_BASE OPENBSD_6_2_BASE
# 1.2 27-Jan-2017 tom

More s/OSCP/OCSP/ typos

ok jmc@


# 1.1 06-Nov-2016 inoguchi

Add regress test script for openssl command.
ok beck@


# 1.15 15-Sep-2018 inoguchi

Modify regress appstest.sh for interoperability testing with OpenSSL 1.1.x

- add sleep before s_client instead of removing -pause option
- change check words for s_client output messages
- replace CAfile to CApath for s_time
- remove -prexit from s_client
- confirm openssl command path is executable


# 1.14 14-Sep-2018 inoguchi

Add interoperability test mode for regress appstest.sh

- test s_server and s_client between different version by option -i
- indicate other version by defining OTHER_OPENSSL environment variable
- fix "SSL/TLS" to "TLS/SSL", since TLS is correct as technical term
- s/SKIPPNG/SKIPPING/


# 1.13 08-Sep-2018 inoguchi

Fix indent and adjust line fit to 80 columns.


# 1.12 08-Sep-2018 inoguchi

Split test blocks into a function. Test contents are not changed.


# 1.11 08-Sep-2018 inoguchi

Test more ciphers and randomize the order in regress appstest.sh

- change test target ciphers
- randomize the test ciphers order
- display test cipher count


# 1.10 07-Sep-2018 inoguchi

tests all available TLSv1.2 ciphers


# 1.9 27-Aug-2018 inoguchi

Add protocol and cipher patterns in regress appstest.sh


# 1.8 26-Aug-2018 inoguchi

Stop s_server if error occurs in regress appstest.sh


# 1.7 23-Aug-2018 inoguchi

Add license header.


# 1.6 23-Aug-2018 inoguchi

Check reusing SSL/TLS session ticket by regression test

- Added checking for session ticket reusing with using openssl(1) s_server and
s_client command in appstest.sh
- Confirm certificate verification status.
- Save s_server message to log file.

ok tb@ and jsing@


# 1.5 10-Apr-2018 tb

tweak usage()


Revision tags: OPENBSD_6_3_BASE
# 1.4 19-Mar-2018 beck

Add a -q (for quick) mode to apptest.sh, and use it by default.
this means that running the regression test doesn't take forever
because we run a huge dhparam test and openssl speed tests.

ok inoguchi@


# 1.3 06-Feb-2018 tb

Respect the OPENSSL make variable everywhere so that

make OPENSSL=/usr/src/usr.bin/openssl/obj/openssl

actually does the expected thing instead of running a mixture of both the
openssl below /usr/obj and the one below /usr/bin. Found the hard way via
backtraces that made no sense whatsoever.

ok jsing


Revision tags: OPENBSD_6_1_BASE OPENBSD_6_2_BASE
# 1.2 27-Jan-2017 tom

More s/OSCP/OCSP/ typos

ok jmc@


# 1.1 06-Nov-2016 inoguchi

Add regress test script for openssl command.
ok beck@


# 1.9 27-Aug-2018 inoguchi

Add protocol and cipher patterns in regress appstest.sh


# 1.8 26-Aug-2018 inoguchi

Stop s_server if error occurs in regress appstest.sh


# 1.7 23-Aug-2018 inoguchi

Add license header.


# 1.6 23-Aug-2018 inoguchi

Check reusing SSL/TLS session ticket by regression test

- Added checking for session ticket reusing with using openssl(1) s_server and
s_client command in appstest.sh
- Confirm certificate verification status.
- Save s_server message to log file.

ok tb@ and jsing@


# 1.5 10-Apr-2018 tb

tweak usage()


Revision tags: OPENBSD_6_3_BASE
# 1.4 19-Mar-2018 beck

Add a -q (for quick) mode to apptest.sh, and use it by default.
this means that running the regression test doesn't take forever
because we run a huge dhparam test and openssl speed tests.

ok inoguchi@


# 1.3 06-Feb-2018 tb

Respect the OPENSSL make variable everywhere so that

make OPENSSL=/usr/src/usr.bin/openssl/obj/openssl

actually does the expected thing instead of running a mixture of both the
openssl below /usr/obj and the one below /usr/bin. Found the hard way via
backtraces that made no sense whatsoever.

ok jsing


Revision tags: OPENBSD_6_1_BASE OPENBSD_6_2_BASE
# 1.2 27-Jan-2017 tom

More s/OSCP/OCSP/ typos

ok jmc@


# 1.1 06-Nov-2016 inoguchi

Add regress test script for openssl command.
ok beck@


# 1.5 10-Apr-2018 tb

tweak usage()


Revision tags: OPENBSD_6_3_BASE
# 1.4 19-Mar-2018 beck

Add a -q (for quick) mode to apptest.sh, and use it by default.
this means that running the regression test doesn't take forever
because we run a huge dhparam test and openssl speed tests.

ok inoguchi@


# 1.3 06-Feb-2018 tb

Respect the OPENSSL make variable everywhere so that

make OPENSSL=/usr/src/usr.bin/openssl/obj/openssl

actually does the expected thing instead of running a mixture of both the
openssl below /usr/obj and the one below /usr/bin. Found the hard way via
backtraces that made no sense whatsoever.

ok jsing


Revision tags: OPENBSD_6_1_BASE OPENBSD_6_2_BASE
# 1.2 27-Jan-2017 tom

More s/OSCP/OCSP/ typos

ok jmc@


# 1.1 06-Nov-2016 inoguchi

Add regress test script for openssl command.
ok beck@


Revision tags: OPENBSD_6_3_BASE
# 1.4 19-Mar-2018 beck

Add a -q (for quick) mode to apptest.sh, and use it by default.
this means that running the regression test doesn't take forever
because we run a huge dhparam test and openssl speed tests.

ok inoguchi@


# 1.3 06-Feb-2018 tb

Respect the OPENSSL make variable everywhere so that

make OPENSSL=/usr/src/usr.bin/openssl/obj/openssl

actually does the expected thing instead of running a mixture of both the
openssl below /usr/obj and the one below /usr/bin. Found the hard way via
backtraces that made no sense whatsoever.

ok jsing


Revision tags: OPENBSD_6_1_BASE OPENBSD_6_2_BASE
# 1.2 27-Jan-2017 tom

More s/OSCP/OCSP/ typos

ok jmc@


# 1.1 06-Nov-2016 inoguchi

Add regress test script for openssl command.
ok beck@


# 1.3 06-Feb-2018 tb

Respect the OPENSSL make variable everywhere so that

make OPENSSL=/usr/src/usr.bin/openssl/obj/openssl

actually does the expected thing instead of running a mixture of both the
openssl below /usr/obj and the one below /usr/bin. Found the hard way via
backtraces that made no sense whatsoever.

ok jsing


Revision tags: OPENBSD_6_1_BASE OPENBSD_6_2_BASE
# 1.2 27-Jan-2017 tom

More s/OSCP/OCSP/ typos

ok jmc@


# 1.1 06-Nov-2016 inoguchi

Add regress test script for openssl command.
ok beck@


Revision tags: OPENBSD_6_1_BASE OPENBSD_6_2_BASE
# 1.2 27-Jan-2017 tom

More s/OSCP/OCSP/ typos

ok jmc@


# 1.1 06-Nov-2016 inoguchi

Add regress test script for openssl command.
ok beck@