The actor denied being Mr. Fantasy despite many believing him to be the man behind the ill-fitting wig and fake teeth