codechap/context-trimmer
A tokenizer-agnostic text preprocessor to trim context for LLMs.
时间：2025-02-03 08:05
attla/token
Turn everything into a unique encrypted JWT.
时间：2024-11-22 00:15
ae8/tokenizer
A simple PHP library for token-based encryption.
时间：2024-07-23 04:06
taufik-nurrohman/minify
Reduce CSS, HTML, JavaScript, JSON, PHP, and XML code size on the server side.
时间：2024-02-19 11:16
phpfacile/string-tokenizer
Library to parse a string (especially to extract text and keywords identified by a begin and end delimiter and to substitute keywords by values)
时间：2024-02-14 11:00
brunocfalcao/laravel-tokenizer
Laravel tokenizer - Token usage for web apps (create, burn, check, etc)
时间：2023-12-23 18:01
juanchosl/tokenizer
A small collection of encoder/decoder Token for authentication
时间：2023-09-27 19:11
jared/php-tokenizer
This package provides a simple standalone regular expressions powered tokenizer.
时间：2023-09-13 20:41
crazzy501/gpt3-tokenizer
PHP package for Byte Pair Encoding (BPE) used by GPT-3.
时间：2023-07-17 12:33
cxrxexo/tiktoken
PHP version of tiktoken. PHP 7.4+ required.
时间：2023-06-24 03:23
nocika/gpt3-tokenizer
PHP package for Byte Pair Encoding (BPE) used by GPT-3.
时间：2023-04-20 15:46
everstu/gpt3-tokenizer
PHP package for Byte Pair Encoding (BPE) used by GPT-3.
时间：2023-04-12 03:07