I wanted to bring together a few projects I've been working with recently, and figured the best way to do so was to make an interactive 3D clone of myself for my own website.
This uses my flutter_filament[0] package for rendering (ignore the name, it's no longer Flutter-only), Jaspr[1] (a Dart framework for building reactive UIs, syntax inspired by Flutter), Avaturn[2] for the avatar, Cartesia[3] for the voice cloning, DiffSHEG[4] for the skeletal animations (though scaled down considerably), FaceDiffuser[5] for the facial animation and sherpa-onnx[6] for the speech recognition.
[0] https://github.com/nmfisher/flutter_filament
[1] https://github.com/schultek/jaspr
[2] https://avaturn.me
[3] https://cartesia.ai
[4] https://github.com/JeremyCJM/DiffSHEG
[5] https://github.com/uuembodiedsocialai/FaceDiffuser
[6] https://github.com/k2-fsa/sherpa-onnx
