On: Launch HN: Tinfoil (YC X25): Verifiable Privacy for Cloud AI

[tealcod]

Would it be possible to run something like vLLM or TensortRT-llm with tinfoil?

[FrasiertheLion → tealcod]

We’re already using vllm as our inference server for our standard models. We can run whatever inference server for custom deployments.