Why do search engines so obediently follow robots.txt?

Hello there! Today, we’ve prepared a story about search engines and robots.txt. Have you ever wondered why search engines bother to follow…