In all democracies, policies that you're running on have to have effects before the next presidential election to assist in the reelection campaign. Ending visa programs will not significantly change demographics until 5-20 years down the line. Unless you think that Stephen Bannon will end democracy before the next election, ending visa programs will not be enough for him.
I didn't see the quote where Bannon said that the effects would take too long.