funivan/php-tokenizer
Wrapper around token_get_all. Easy to extract and modify php code.
时间：2015-05-18 08:33
sastrawi/tokenizer
PHP library that allows you to tokenize Bahasa Indonesia.
时间：2014-12-03 13:29
teepluss/wordbreaker
Word breaker is Thai wording separator for using with fulltext software.
时间：2014-11-21 11:16
hippophp/hippo
Hippo is an open-source tool that helps PHP programmers adhere to certain a given convention.
时间：2014-11-11 21:14
amsterdamstandard/tokenizer
Tokenizer api wrapper for PHP
时间：2014-10-24 15:27
ride/lib-tokenizer
Tokenizer library of the Ride framework.
时间：2014-02-21 13:50
hybridlogic/classifier
A Naive Bayesian classification library for PHP with support for different tokenizers to optimize string classification.
时间：2013-01-12 12:44
robo47/php-manipulator
Manipulation of php code, automated refactoring based on phps tokenizer
时间：2012-03-10 15:40
ze/tokenizer-gpt3
PHP package for Byte Pair Encoding (BPE) used by GPT-3.
时间：未知
jeremeamia/functionparser
Function parser for PHP functions, methods, and closures
时间：未知
ltd-beget/dns-zone-tokenizer
tokenize dns zone files and that's all, folks.
时间：未知