Basic Web Technology - PHP/ Ruby on Rails or ASP.Net is not that difficult to learn. It may be a good idea to know the basics.
I am not a pure techie and am building a web app. It took more than a couple of months to find the right techie. In the mean time, I outsourced development on ODesk so that there is some momentum by the time I build my own tech team. Now we are almost at the verge of launching our first app.
It is certainly do-able. Takes a little longer and costs a little more. But in any startup, the cost of building the first iteration of the product is not the most significant.
But you absolutely must have clarity on what your product is and who is going to use it.