Gopher will be faster by nature of gemini using TLS. However, gopher is inherently less secure than gemini. If you are wanting the TLS, gemini _should_ load your document faster than the https (even with minimal headers included for the https version, there is still more header overhead to just make the request and there is a lot more header overhead in most responses).
