Yes. You have to be searching the area where the plane crashed though. So far they have only searched the area where the plane did not crash. Uncertainty in the final minutes of flight have contributed to making the job of locating any wreckage very difficult. The ocean is large and deep and finding something as small as a passenger jet is hard unless you can narrow the search area.
Bits of MH370 have been retrieved from Madagascar beaches. The body of the plane itself may have drifted many kilometers away from the point of impact as it sank but it doesn't matter since we have no idea where it first fell other than a general "southern Indian ocean"