"I'm so glad they cancelled hanging out with me so they could get more done," said no-one ever
There will always be more to do. The mythical state of Getting Everything Done does not exist. If you make any part of your life contingent on Getting Everything Done, that part of your life will die. Friendships, hobbies, journeys, loves, books unread, they all die the same way: when you say you're too busy for them.