Yes as said before plus:
- Obey robots.txt to the full extend
- Name your access, i.e. label your bot
- Don't use shady tactics such as IP rotation
- Provide web site owners the option to fully block access
of your bots (yes, communicate your full IP ranges)
Again - this is from a content owner who paid for his content.