Went on the tour with a bunch of other foreign tourists and some middle-aged Japanese. A rather depressing number of people showed up at the front gate, apparently having not done any research. You need a (free) reservation to get in. Now you know. Not that any of you would ever throw a tantrum in front of a palace guard.