What are tokens in PostgreSQL?

A token can be a keyword, an identifier, a quoted identifier, a literal (or constant), or a distinctive personality symbol. Tokens are generally separated with the aid of whitespace (space, tab, newline), however, need not be if there is no ambiguity (which is usually only the case if an exceptional persona is adjoining to some other token type).