There are several areas to improve SSL connection (and general SSL traffic latency). Some of these may impact security in some small or great way.
(These are for ssl.conf using Apache)
Disable the Domain lookup, and allow Non-SNI to reach primary domain
- SSLStrictSNIVHostCheck off
Instead of named hosts, use IP address for the :443 VHOST entry
Cache SSL Sessions
- SSLSessionCache shmcb:/run/httpd/sslcache(512000)
- SSLSessionCacheTimeout 300
Allow for faster SSL Protocol order, general compatibility, medium security:
- SSLProtocol all -SSLv3
- SSLCipherSuite ALL:+HIGH:+TLSv1:!ADH:!EXP:!SSLv2:!MEDIUM:!LOW:!NULL:!aNULL
- SSLHonorCipherOrder on
OCSP Stapling (speeds up SSL)
- SSLUseStapling on
- SSLStaplingResponderTimeout 5
- SSLStaplingReturnResponderErrors off
- SSLStaplingCache shmcb:/run/ocsp(128000)
HSTS (can do preload so http:// requests become https:// requests in the browser
- Header always set Strict-Transport-Security "max-age=63072000; includeSubdomains; preload"
Submit for preload here: https://hstspreload.appspot.com/
Consider the following more advanced implementations:
- HTTP/2 with HPACK
- Brotli Compression
Other non-SSL issues that may help speed up connnection
Another directive for Apache in httpd.conf