This is an attempt to make one of the shortest sentence tokenizers.(possibly 25 lines)
The tokenizer is ready and shall be put up on 3rd April upon conclusion of the demonstration, it tokenizes 3500+ texts in a second on my Machine.
utkarshrai/Sentence-Tokenizer
Folders and files
| Name | Name | Last commit date | ||
|---|---|---|---|---|