If the patent was invalid for reasons known to the people threatening action, then I think it's reasonable to at least be called fraud. If they were (or might've been) operating under the belief that the patent was legit - and certainly granting by the USPTO would dispose one to this belief, if there wasn't some reason they knew better - then I think it's as you say.
