View Forum Topic

Forums
CS520
PostgreSQL FTS question

Author	Message
yurimuradyan Posts: 42	Posted 02:14 May 27, 2009 \| Is there a way to tokenize/not tokenize fields in postgreSql? I am having a problem with the usernames being tokenized. Thanks! Sorry, please disregard. I was looking at something else. Last edited by yurimuradyan at 02:15 May 27, 2009.
cysun Posts: 2935	Posted 08:26 May 27, 2009 \| Tokenization is done by a parser, which is part of a text search "configuration" in PostgreSQL. PostgreSQL has only one built-in parser, which can be customized to handle (or not handle) certain token types. To change the default parsing behavior, you need to customize the parser, then create a new configuration. See http://www.postgresql.org/docs/8.3/static/textsearch-configuration.html for more details.

Author

Message

yurimuradyan

Posts: 42

Posted 02:14 May 27, 2009 |

Is there a way to tokenize/not tokenize fields in postgreSql? I am having a problem with the usernames being tokenized. Thanks!

Sorry, please disregard. I was looking at something else.

Last edited by yurimuradyan at 02:15 May 27, 2009.

cysun

Posts: 2935

Posted 08:26 May 27, 2009 |

Tokenization is done by a parser, which is part of a text search "configuration" in PostgreSQL. PostgreSQL has only one built-in parser, which can be customized to handle (or not handle) certain token types. To change the default parsing behavior, you need to customize the parser, then create a new configuration. See http://www.postgresql.org/docs/8.3/static/textsearch-configuration.html for more details.