The mistake was is making a relative comparison on such super small numbers. If your TTFB is less than 2ms, then you are fine. You are better than fine.
If your TTFB is 1.5 seconds, then you are struggling.
In determining if you have a TTFB issue comparing the relative improvement of super small numbers isn't likely to help you much.