Token Splitter
Stage 1 of 3
Stage 1: input
Add the text you want to inspect.
Spaces, punctuation, code, and unusual names can all change the token boundaries.
Stage 1 of 3
Stage 1: input
Spaces, punctuation, code, and unusual names can all change the token boundaries.