You should build for your market. Unless you're specifically targeting a market segment that has accessibility requirements, then you should do the least amount of work possible to provide value, then iterate. When creating a product in an early stage market, most development time is better suited to discovering an MVP than adding accessibility features. Think of it as premature optimization.