Earlier in the day, he was sworn in with four key cabinet members, including new Foreign Minister Penny Wong, who is travelling with him to Japan.