interitty/tokenizer
Use regular expressions to split a given string into tokens.
时间：2022-08-26 14:09
attla/data-token
Turn everything into a token: randomized or predictable.
时间：2022-07-13 02:08
turanjanin/serbian-language-tools
Set of tools for tokenization, transliteration and diacritic restoration of a text written in Serbian language.
时间：2021-05-24 14:02
mistralys/jtokenizer
Modernized, composer compatible version of Tim Whitlock's JTokenizer PHP Javascript parser and tokenizer library.
时间：2021-03-12 07:20
tacoberu/bnf
Framework for building BNF like parsers.
时间：2020-06-21 17:54
tsukasa/php-tokenizer
Polyfill for php extension Tokenizer
时间：2018-09-28 09:19
robinthehood/tokenizer
With Tokenizer you can easily convert a string to a stream or array of tokens.
时间：2017-11-08 13:32
dbeurive/lexer
This project implements a simple lexer.
时间：2016-11-23 21:28
ltd-beget/sphinx-configuration-tokenizer
tokenize sphinx configuration and that's all, folks.
时间：2016-03-20 02:14
td7650/superclosure
Serialize Closure objects, including their context and binding
时间：2015-09-14 09:08
soloproyectos-php/text-tokenizer
A library to split a string into smaller tokens. This library is part of the SoloProyectos PHP API.
时间：2015-06-28 18:41
masnathan/sql-query-formatter
A very lightweight PHP class that reformats unreadable and computer-generated SQL query statements to human-friendly, readable text.
时间：2015-05-28 09:58