the fastest way to turn off my xbox controller when its connected to my mac with bluetooth is to take off the cover and pop out a battery
holding the button is supposed to work, but that usually just opens steam or the macos launchpad or start alttabing or something else entirely for like a minute before turning off. the battery method is WAY faster