You are right, since arch is an ingress wasm filter it can be setup inside Istio just like any other envoy filter. You would need to pass arch_config someone which should be easy. We will have samples/demos for Istio and K8s deployments sometime in future. If you want us to focus on this area more please go ahead and create an issue in our issues page at https://github.com/katanemo/arch/issues
Great to hear that - walk us a bit more how you are planning on using the filter? The filter today does communicate with a model_server service for the intelligence piece. Were you thinking of using the filter for outbound LLM traffic management?
They can be cooperative. I had to work M-F and weekends and they let me serve detention during active school hours, typically during lunch hours or a study hall block.
reply