Why do we have to do that？

You may be more easily influenced by the external environment, and you may have some feelings and associations in some ordinary leisure activities such as reading. Think about your usual experience. Actually, it's no big deal. Don't worry too much. If you spend more time studying or working when your mind is full of other things, you won't always think about them.