whatif wahtif vahtif

what if some of the unique tokens i am generating aren't unique but just aren't indexed because they only occur so rarely? what then?  i could be missing out on a parallelism of myself documenting words.  i'll never get to meet this other guy who is conceiving of the same words as me. feelsconfusingman