Leaned in way more on the 2d game aspect of it, and have video drop-off too, but the place it came from: "being able to have multiple conversations in the same shared space without hearing everyone at the same time" is the same.
I have a standing virtual happy hour with some friends every week. If I can figure out how to get this to work with my docker/traefik deployment, I'll have to try it with my friend group and see how it works.
Thanks for creating and sharing this!
It's one additional line in `/use/share/jitsi-meet/index.html` to include a very small JS file that sets up a RPC pipe between my window and the Jitsi Meet window.
Other than that, I wore everything in vanilla JS and HTML5, so there aren't any other dependencies to manage, no build systems to run. Just dump the files somewhere (I'm running the front end in Azure CDN right now) and go.
Lately, I'm involved with a few meetups that miss the dynamic of a real meetup. So I threw this together to hopefully get some semblance of the meetup space again.
It's really simple. Jitsi Meet has a web app API that basically loads a standard Jitsi Meet install in an iframe, with some inter-window communication setup using Window.postMessage. I add a small hack on Jitsi Meet's default install to take my own postMessage calls to sniff out the HTML audio elements Jitsi Meet creates and modifies their volume.
For the position of participants, I use Jitsi Meets inter-user text messaging system to send data packages. Then I just scale each user's audio volume based on a linear scale. Anyone closer than 3 squares is rendered in full volume, and anyone further than 14 is muted. And of course, settings in the scripts to scale these values. They could even be per-user, if they wanted to scale how well they can hear.
There's no stereo pan or ambisonics, but hopefully the volume level scaling is enough to make for useful meetups.
The result: the video conferencing only showed faces! Imagine the possibilities of moving those faces around a stage, or using virtual cutouts where the faces would appear, etc.
It was very very fun, I have screenshots of 10 people connecting at once -- hit me up if you want to pursue something :-)
They make tech that takes data from streamed games and lets you use that data to make interactive client side overlays on the stream that sync to the game.
I am also working on my own Jitsi Hack, trying to add feature for Agile meetings -> https://meet.retrolution.co/?utm_source=HN
I was thinking to add some features similar to yours in order to implemented Liberating Structures http://www.liberatingstructures.com/
I'm generally of the opinion that the video feed is useless in 90% of teleconferencing situations.
Also, reminds me that I need to submit a pull request for their iframe API, because I stumbled on some missing information in it. Luckily, was pretty easy to guess at the right values.
Screenshots in the readme would do wonders for getting the point across.
Now if only Zoom had a robust plugin system...
If so, this seems like it could "easily" be expanded into something like Roll20 where tokens are on a gridded map with an image background.
I had a Jitsi Meet server kicking around months before coronavirus and now it's seeing more use. I'll give this an install!