The ALP may have lost the numbers in the NT parliament, after Minister for Indigenous Policy, Alison Anderson, walked out on her cabinet post this afternoon.