Show HN: Giskard – Testing framework dedicated to LLMs and Tabular ML models

[alexcombessie]

https://github.com/Giskard-AI/giskard

[mattbit]

Hey, Giskard team member here! I am around to discuss and read your feedback.

I’ve worked in particular on automatic scanning of ML models for bugs and problems, the idea was to systematically scan for general issues and automatically find segments of data on which the model performs worse than average. If you have questions, I am happy to discuss here.

[hugolsqrn]

Very exciting to see Giskard coming around to bring trust to LLMs!

[alexcombessie → hugolsqrn]

Thanks! LLM testing is a specific challenge, we’re interested in your feedback on our alpha version.

Here’s a notebook to try it: https://docs.giskard.ai/en/latest/reference/notebooks/llm_co...

[jplassmann]

Awesome!! Exactly what I was looking for!

[alexcombessie → jplassmann]

Thanks! We’re interested in your feedback as it’s still a beta version.

Here is our documentation to get started: https://docs.giskard.ai/

[mxcrbn]

Interesting stuff!

[alexcombessie → mxcrbn]

Thanks! We’re interested in your feedback as it’s still a beta version. Here is our documentation to get started: https://docs.giskard.ai/

[beppbopp]

Will test it out this weekend