We already have these restrictions on us now; that joke in my post was in part to point this out. I know most of the Dead Kennedys songs verbatim. If I perform them publicly, it's copyright infringement already. If I write them down from my own memory, it's copyright infringement too.
Just getting rid of copyright law is dangerous, though. It'd be unilateral disarmament, because there are plenty of other mechanisms, like EULAs, that can be used to control what was previously copyrighted. We'd need massive reform of all the legal systems at once, lest we eviscerate the only tools we have (i.e., copyleft) while leaving all the opponents' tools in place.
Just getting rid of copyright law is dangerous, though. It'd be unilateral disarmament, because there are plenty of other mechanisms, like EULAs, that can be used to control what was previously copyrighted. We'd need massive reform of all the legal systems at once, lest we eviscerate the only tools we have (i.e., copyleft) while leaving all the opponents' tools in place.