august11's comments

On: BitNet: Inference framework for 1-bit LLMs

[august11]

In their demo they're running 3B model.

On: No, it doesn't cost Anthropic $5k per Claude Code user

[august11]

They are clearly making money overall.

On: Enchanted – Ollama app now on macOS

[august11]

Enchanted app now supports macOS

- Supports latest Ollama Chat API - Conversation history included in the API calls - Dark/Light mode - Conversation history is stored on your device - Markdown support (nicely displays tables/lists/code blocks) - Voice prompts - Image attachments for prompts - Specify system prompt used for every conversations - Edit message content or submit message with different model - Delete single conversation / delete all conversations - macOS command panel Ctrl + ⌘ + K

https://www.youtube.com/watch?v=zW3roZ_vM5Q

On: Ollama iOS app Enchanted now supports audio recordings and image prompts

[august11]

Hi guys, I just implemented audio recording and image prompts (for models that support it like llava). Project is open source and available on App Store.

Sharing the latest promo video here

https://www.youtube.com/watch?v=_0L9Qz1Gn2Y

On: App for self hosted LLMs (llama, mistral, vicuna)

[august11]

For the last week I was working on open source iOS App (similar to ChatGPT) that can be used with self hosted models using Ollama.

I think the future is for many people to have private, unfiltered LLM and this app gives you nice UI to communicate with it. App requires to run ollama model before you can use the app.

I have many features planned like image input, but looking forward to hear some feedback to guide the development.