---
title: Whitespace
---

The whitespace tokenizer is exactly like the [simple](/v2/tokenizers/available_tokenizers/simple) tokenizer, but splits only on whitespace and preserves
punctuation. It also lowercases by default.

```sql
CREATE INDEX search_idx ON mock_items
USING bm25 (id, (description::pdb.whitespace))
WITH (key_field='id');
```

To get a feel for this tokenizer, run the following command and replace the text with your own:

```sql
SELECT 'Tokenize me!'::pdb.whitespace::text[];
```

```ini Expected Response
      text
----------------
 {tokenize,me!}
(1 row)
```