On: ChatGPT is really good at roleplaying

[varunramesh]

I had some good results with Vicuna, but haven't tried it for gaming/fantasy roleplay yet.

[xrd → varunramesh]

What specs do you need for vicuna? Can you run it on regular hardware, or are you using a cloud GPU?

[simonw → xrd]

I've run Vicuna 7B directly in my web browser - https://simonwillison.net/2023/Apr/16/web-llm/ - and on my iPhone: https://simonwillison.net/2023/May/1/lets-be-bear-or-bunny/

[xrd → simonw]

Hi Simon. How do I ask questions about that post? I didn't see comments enabled.

[simonw → xrd]

Asking them here works fine! I decided not to deal with the moderation overhead of managing comments on my own blog.

[xrd → simonw]

Totally get it.

Basically I've tried running the demos (the linked demo page) from that project inside Chrome 113. I keep getting a network error. Appears to me that huggingface LFS download, the model obviously, isn't available.

I also tried to clone the repository locally but the instructions aren't entirely clear on how to get the models installed.

Did you clone and run locally? Or are you using the demo site? Or perhaps in something like Colab?