You can, it's just very difficult to grab items from several surrounding squares without accidentally grabbing the flower as well. The more you do it, the more likely you are to mess it up.
There’s a 1.4 change that stops you from trying to eat fruit when feeding jars, as long as you keep the button held down as you move. I wonder if it’ll be fixed for crops vs. machines someday.