To what extent were they correct and to what extent not? Is their correctness also linked to the correctness of the similar argument today or you're just noting the analogy?
It's cool that this is possible on a single node but I still think distributed is the way.
The point of these tools is productivity. What are you trying to accomplish and how long does it take to accomplish? This includes time spent writing code and fussing with configs. This would take <1min to run and <10 to write on a cluster. Happy to might make a demo to prove it.
Yes cost matters also, but running many machines for a short period of time is the same as one for a long time? Open to honest rebuttal.
Or basically a generic nestable `remote_parallel_map` for python functions over lists of objects.
I haven't had a chance to fully watch the video yet / I understand it focuses on lower levels of abstraction / GPU programming. But I'd love to know how this fit's into what the speaker is looking for / what it's missing (other than obviously it not being a way to program GPU's) (also full disclosure I am a co-founder).
1. I'd have phone/video calls with people who face the problem im solving, usually from my personal network / asking people on linkedin. In these calls I'd really try to learn about the problem and how they're solving it now. Possibly make presales on the phone at this point if the problem seems really intense and frequent.
2. Quickly build MVP
3. Send MVP to everyone I spoke with
4. observe whether it solves their problem
How do I know I can trust the factual consistency metric? You linked to a research paper in the docs but reading a research paper is the last thing I want to do right now.
Thanks for checking us out! We measure factual consistency using a NLP task known as "natural language inference". We then compare 2 sentences to know if one is an 'entailment' of another (for example - if "there are 3000 oranges in the supermarket", an entailment would be "there are oranges in the supermarket" - which would get a high score whereas "there are no oranges in the supermarket" would be a contradiction. We use the score of the entailment class to get a measure of how factually consistent it is.
We provide a high-level summary in the documentation (https://docs.confident-ai.com/docs/measuring_llm_performance...) and will be sharing an in-depth blog article on it soon!
I was down bad and started throwing ideas at startup accelerators until I got money to work on one.
Motivation to spend all of my time working on ideas came from anxiety about my future. I know Im capable of building something cool and useful, my biggest fear is never giving it my all, then looking back and feeling like I wasted a good hand in life.
reply