Hacker News new | past | comments | ask | show | jobs | submit login
Show HN: ChatGPT vs. Jurassic vs. Bard vs. Claude (olilo.ai)
25 points by jithinraj 11 months ago | hide | past | favorite | 24 comments



Great site, but it looks like GPT4 doesn't work anymore, and Palm generates errors sometimes.

Here's the error for GPT: > An error occurred: You exceeded your current quota, please check your plan and billing details.

And here is the error for Palm: > An error occurred: can only concatenate str (not "NoneType") to str


I'm sorry that you couldn't get results from GPT4 & PaLM2! We restored some credit to GPT4 and it was exhausted in no time.

We are going to add some more credits.

Thank you for trying and sharing the error messages, greatly appreciate it.


Now all works except OpenAI due to incorrect key.


Thank you, updated the key.


Hey HN!

We made this LLMs comparison tool because we were spending way too much time entering the same prompt on multiple websites to compare the results.

We thought the community might find it useful too.

Let us know if there is some way to make this more useful.

Jithin & Sajith


Thank you for doing this. I have also consulted with different LLMs, but it can be time-consuming. Receiving advice from multiple "big brothers" is far better than taking advice from just one. Even though GPT-4 is often (but not always) the "wisest" one.


Glad you like it! Like the big brother concept. :)

Let us know if there are other features that could be helpful for you.


Interesting!

Here are some features that I will find useful.

1 - Option to customize the model parameters.

2 - Selective model comparison, once you extend the supported models it can be inefficient to run all the models all the time, selective execution can give more control to users to execute only required comparison models.

3 - Share option.


Noted, actionable feedback. Thank you.


i would honestly pay for this if the ui went all out and i really like claudes answer heres what i inputted ::

----why do i tire faster with the map/courses in a mario kart game vs a shooting fps game map? --ur running around in circles in mario kart 64 >>thats why it gets boring ur running and lapping around the same place over and over -----i believe extreme creativity open mindednes and focus and hard work vs 1 million dollars is alot more valuable -------------------------------------- LLM #1 ready...>>>>>>

An error occurred: You exceeded your current quota, please check your plan and billing details.

LLM #2 ready...

PalM2>>>>>>>>>> -- being a millionaire opens so many doors of opportunity LLM #3 ready...

Jurassic 2 Ultra -----who agrees with me I agree with your statement that extreme creativity, open-mindedness, focus, and hard work can be more valuable than a million dollars. Creative ideas and solutions have the potential to change the world and make a difference in people's lives, while a million dollars is simply a material possession. Hard work and dedication are often necessary to bring creative concepts to fruition, and being open-minded allows us to consider different perspectives and approaches. Ultimately, the impact and value of creativity can far exceed that of monetary wealth.

LLM #4 ready...

Claude>>>>>> There are a few potential reasons why you may tire faster playing Mario Kart compared to an FPS game: Repetitive motions - In Mario Kart, you are constantly making the same steering and button pressing motions lap after lap. This can cause fatigue faster than the more varied movements of an FPS.

Focus - Mario Kart requires intense focus on the track to hit the optimal racing lines. This high level of visual and mental focus can be draining over time. FPS games have more breaks in concentration.

Familiarity - After several laps on a Mario Kart track, your brain becomes extremely familiar with the route. This means you don't have to visually process as much new information, allowing your mind and body to relax and feel tired. FPS maps are usually new each time.

Posture - The seated, controller-gripping posture of Mario Kart can cause more physical fatigue than the varied postures of an FPS played with mouse


Surprisingly, Claude has more fans! Glad you find it useful! We will be making changes to the UI. Many are willing to pay, but we don't know how much to charge for it yet! What do you think?

Sorry about the ChatGPT4 results, will restore it. Thank you for trying.


Thank you, this makes it very easy to show why you should not trust LLMs for facts!

Prompt: Give me the best battery warranty out of all EVs sold in the USA.

Responses:

     1-The Lucid Air has the best battery warranty out of all EVs sold in the USA. It comes with an 8-year/100,000-mile warranty on the battery and electric drive components.

     2-As of my knowledge cut-off in 2022, the Tesla Model 3 Long Range AWD has the longest battery warranty out of all EVs sold in the USA at eight years or 120,000 miles, whichever comes first.

     3-As of 2021, the Hyundai Kona Electric and Hyundai Ioniq Electric offer the best battery warranty among all electric vehicles sold in the USA. Both Hyundai models offer a Lifetime Battery Warranty, which is the longest warranty out there. This is in contrast to other manufacturers like Tesla, which offer 8-year or 100,000 to 150,000 mile warranties, depending on the model. However, always check with the individual manufacturer as warranties can change.

     4-Unfortunately there is no single definitive "best" EV battery warranty in the US, as warranties can vary quite a bit between automakers and models. However, some EVs with notably good battery warranties in the US market include:
     Hyundai Kona Electric - 10 year/100,000 mile battery warranty
     Chevrolet Bolt EV - 8 year/100,000 mile battery warranty
     Tesla Model 3/Y - 8 year/100,000-120,000 mile battery warranty
     Nissan Leaf - 8 year/100,000 mile battery warranty
     Kia Niro EV - 10 year/100,000 mile battery warranty
     Key factors in assessing EV battery warranties include the length of time and mileage covered, as well as details like percentage of capacity retained and any stipulations on transferability, rapid charging limitations, etc. Tesla and Hyundai/Kia tend to stand out as having some of the most comprehensive.
The correct answer is Rivian. Rivian has 175,000 miles or 8 year battery warranty. This warranty was in effect in 2021, so all models should know about it. Putting the Kia Nero in very last does not make logical sense, as it can and should be placed 'at the top' with 10 years of warranty. The statement about a Lifetime Battery Warranty for Hyundai applies only to its 2019 models, so it should be eliminated. The LLMs are extrapolating information into newer models, and this hallucination/lie is creating misinformation on factual info.


Haha. Happy to help! :D


Excellent work. I have just learned about the performance of other LLMs. Based on my prompt, Jurassic is the fastest, and Claude is the smartest.


Interesting observation! Glad that you find it useful, thank you.


Unfortunately its gonna be abused like hell so you'll end up shutting it down or requiring API keys for each one of them :(


Great foresight! Thank you for checking it out.

That's right, the usage was something beyond what we expected. It looks like API keys or capping are the way to do it.

Any suggestions to keep the service live and useful for non-spammers / abusers?


Claude provided the only useful answer


Interesting, what's the delta like?

Thanks for trying. :)


The quota on chatGPT exceeded :(


Hey, sorry you couldn't try the ChatGPT result. We are adding more credits to it. Thank you for trying.


Update: PaLM2(BARD) is up and running now.


Very useful guys! Kudos


Thank you, glad you like it. :)




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: