Hey, I'm currently building a website that I think would fit well with what you're looking for. It's called Reason, and it's designed to help find small (3-10 users per chat or so) group chats about the topics you're interested in. I started working on this specifically because the casual, small places to meet like-minded people on the internet have kind of disappeared.
http://www.reason.so/