Your personal RFID card has your picture on it, along with other information. Swapping it with someone else is not really an option, because at that point if the train personnel comes by you are technically without a valid ticket and will be given a ticket.
Or just jump over the turnstiles.