llama cpp has python bindings: https://pypi.org/project/llama-cpp-python/
Here's using it with langchain: https://python.langchain.com/docs/integrations/llms/llamacpp
llama cpp has python bindings: https://pypi.org/project/llama-cpp-python/
Here's using it with langchain: https://python.langchain.com/docs/integrations/llms/llamacpp