Yes, but the steam releases typically still have Steamworks DRM, as far as I know - otherwise Steam Achievements and similar features wouldn't work. Has that changed? Can you just copy the folder out of steamapps and run it on another computer?
yes, just tested with binding of issac for instance, which has steam achivements and steam cloud sync, works without steam on a different system entirely.