Is there a lower limit of hardware for "good enough" performance? I plan to integrate Flide into an existing product that is a desktop app for lesser-powered laptops that needs a local model.
Thanks! If the laptop has a 6GB NVIDIA GPU, Flide can serve the 0.8B model on it.
Otherwise, llama.cpp or LM Studio is a better choice for CPU-only devices or smaller GPUs.
> On one H200 with OneJev1.6-0.8B, Flide answers one email in 10.0 ms and all 10,000 in 28 seconds, 3.5 times as fast as the fastest other engine for one email and 4.1 times for all of them.
If not H200 but a 6GB GPU laptop how long would it take? Order of magnitude idea would be helpful
