Excellent response, and pretty much what I was going to say. I have a few hobbies (games, movies, camping, reading, live music) that I don't always have time for, at the same time. So sometimes I'll spend my free time hiking and camping, other times I'll watch movies in the evenings when I get home, and other times I'll play games.
Even something you enjoy can get tiring, if you do it a lot; and there's nothing wrong with putting that aside for a time, to spend time doing other things you like.