I believe a consultancy model, where many companies fund the development by paying for specific need could work. It seems Igalia works this way and they are involved in the development of most mainstream browser engines. I don't know how that would scale.