Yes, llama.cpp, qwen 27b and 35b, llama-cpp-manager for managing model configs.(...

		anubhav200 1 day ago \| parent \| context \| favorite \| on: Ask HN: Has anyone replaced Claude/GPT with a loca... Yes, llama.cpp, qwen 27b and 35b, llama-cpp-manager for managing model configs.(https://github.com/anubhavgupta/llama-cpp-manager)
		help