takes its toll on you

If something takes its toll on you, it means that some kind of loss or damage has occurred through an accident or other type of disaster. This may be a physical disaster of some sort like an earthquake which has taken its toll on you in a more literal sense because you now have to deal with the ramifications. Another more figurative way to use this phrase is when something is affecting you in a more emotional or psychological way.