Early last year, as Tony Abbott criss-crossed Asia with a Praetorian guard of Australia’s wealthiest and most powerful business people, furiously lining up free trade agreements, James Packer was a permanent fixture at the head of the group.