Tokenizing

Tokenizing is a process of identifying the elements of a sentence, such as phrases, words, abbreviations, and symbols, prior to the creation of an index.