I think that the original squake was written against svgalib. So the ttyquake package contains a libvga that's probably a shim, translating the output to aalib.
Most Quake ports use OpenGL, SDL, etc for graphics, and won't work directly with the ttyquake files. Which is why I described using sdlquake to achieve the same effect, in my other comment.