When I invited someone through a misspelled email address I deleted the invite, but their email stayed on the invite list, simply saying 'deleted'. Deleting an email address invite should make it not be on the list anymore.