Foreign Minister Alexander Downer said Sunday he was planning a trip to North Korea, the first time an Australian minister has visited the secretive c