One issue with targeting a small market and trying to grow it is if your business relies on your truly innovative/unique/original idea IMMEDIATELY it will get copied either by the big guys or by other small fish who are more than willing to race you to the bottom on profits.
You must build your business on something beyond an idea.
You must build your business on something beyond an idea.
Intellectual property, customer relationships, the brand, reputation, quality, luxury value, etc...
It's trite but true: ideas are worthless, execution is everything.