'Any foreigner unwilling to swear his full allegiance to the U.S. should not be allowed to remain here'