Yes, you can often avoid them. In some cases they will specifically be blocking your way (but those do not respawn once defeated).