Neither gives me jitters, although I only take small doses of Adderall at a time. Adderall doesn't give me a crash when it wears off like caffeine does.
Adderall can make me more high-strung at times. A little more intense, a little more irritable.
It's a trade-off, of course... because failing to get necessary shit done can also make a person quite stressed out, you know? So Adderall, by helping me get stuff done, also indirectly improves my mood. It's not a magic cure, but it has been worth it for me.