AFAIK Taalas, the company behind this demo, still only have their initially "hardwarized" model available to test in ChatJimmy, which IIRC is a rather stupid Llama 3ish 8b.
Don't get me wrong though, that demo is still incredibly impressive & makes me very much excited for the hardware-based model era (potentially) ahead.
Once you've experienced those speeds, you really start to think about the whole class of things that becomes possible; massively parallel decode paths, extensive reasoning loops, etc…
Just for another data point, I haven’t gotten Wayland screen sharing to work reliably at all. I tried it in Fedora 35 and Ubuntu 22, where Wayland is the default. On Fedora it just didn’t work, and on Ubuntu, Firefox would crash every time. On Chrome it sort of worked after some updates. For Slack you needed to launch from the terminal with special environment variables. There were also weird bugs around docking my laptop, requiring hard resets. All in all, for any sort of modern remote work it wasn’t usable. I switched back to X11 and it’s been smooth sailing. I do miss the fancy trackpad gestures.
Don't use distributions that are stuck with older versions of libraries that are under a ton of active development. Wayland on Ubuntu was okay for me, but running up-to-date Wayland and Pipewire libraries fixed the issues I was having with the distribution's Wayland support.
reply