Tried this for few minutes, and it makes my phone run hot. Whats the CPU/GPu intensive work this app is doing on the device? I thought all the queries are sent to the server and no on device processing.
It's using whisper to do speech to text, which is a non-trivial amount of on device processing. At least that's why I think it's heating up my phone, because that was the first thing I wanted to try.
Yeah I think these new models are going to burn through your battery like dried leaves, even if you have the very latest phones. I ran a reduced Vicuna on my 14 Pro and it heated up very quickly.
Hi! Thanks so much for your comment! Could you expand a bit on what you'd like with A/B testing?
All of the values can be fetched across projects / clients, it's essentially a simple K:V store with broad libraries. For example, if you have a key "price" whose value is a number "100", you can call:
configly.get(price)
from all your clients (provided they are all using the same API KEY).
Today, clients download at the granularity of an entire key-value. So if you changed that price to "150", it'd fetch the entirety of "150" and not just the digit flip. Were you envisioning a case of storing a lot of data?
Today, our free service is capped at 100kb total. Was there a use case you had in mind?
A/B Testing for a K:V, key(“button-color”) = “red” for 10%, “green” for 90%
In a Enterprise, where there are multiple teams wanting to manage their own K:V store, having a global K:V is helpful. Also being able to refer to a project to refer to their K:V
if key(“price”) = “100” is set in Global and one of the projects is setting it again to a different val or same show a warning that you’re rewriting that.