搜索关键词:tokenizer-x,共找到 95 个结果
排序方式:
当前按 更新时间 降序 排列

yaroslavpopovic/laravel-text-chunker

Flexible, strategy-based text chunking for Laravel — fork of droath/laravel-text-chunker with Laravel 13 support.

版本:v2.0.0 下载:5 Stars:0 点击:11

时间:2026-05-10 07:12

akankov/html-ast

nikic/php-parser for HTML — an immutable HTML5 AST with positions, trivia, visitors, and a fidelity printer

版本:v0.0.1 下载:0 Stars:0 点击:11

时间:2026-05-06 17:34

zen0x7/tokenizer

PHP SDK for Service Framework authentication and token generation.

版本:1.0.2 下载:22 Stars:0 点击:8

时间:2026-04-27 07:44

globus-studio/php-obfuscator

A token-based PHP source code obfuscator with full support for PHP 8.1 through 8.5.

版本:v1.0.0 下载:6 Stars:18 点击:11

时间:2026-04-26 23:47

juniora/tokenizer-x

TokenizerX calculates required tokens for given prompt

版本:v1.0.3 下载:1 Stars:0 点击:11

时间:2026-04-11 09:54

alto/code-highlight

A high-performance, semantic syntax highlighter for PHP 8.4+ with zero dependencies. Features context-aware parsing, language embedding, and compatibility with Highlight.js and Prism themes.

版本:未知版本 下载:9 Stars:1 点击:10

时间:2026-04-06 03:14

frolaxhq/laravel-llm-tokenkit

Token estimation, cost calculation & context-window utilities for LLM-powered Laravel apps

版本:v1.0.1 下载:120 Stars:1 点击:9

时间:2026-04-01 03:35

jawitold/fqcn-extractor

A lightweight PHP utility to extract the Fully Qualified Class Name (FQCN) from a PHP source file using the built-in tokenizer.

版本:1.0.3 下载:1 Stars:0 点击:4

时间:2026-03-31 11:18

super-kernel/tokenizer

The tokenizer component for super-kernel.

版本:v1.0.0 下载:45 Stars:0 点击:6

时间:2026-03-25 05:18

onstage2426/fuzor

Dependency-free full-text search for PHP. BM25 ranking, fuzzy and boolean modes, search-as-you-type prefix matching, stopword filtering and Snowball stemming for 62 languages, snippet extraction and result highlighting — one SQLite file, zero infrastructure.

版本:3.4.0 下载:12 Stars:1 点击:6

时间:2026-03-21 13:20

codechap/yii3-context-trimmer

Tokenizer-agnostic text preprocessor for trimming and optimising content for LLM context windows.

版本:1.0.0 下载:6 Stars:0 点击:6

时间:2026-03-13 01:10

legacyphpdoctor/yethee_tiktoken-php-7-4

PHP version of tiktoken

版本:未知版本 下载:0 Stars:0 点击:5

时间:2026-02-15 23:52

semji/gpt-3-tokenizer-php

PHP Text Tokenizer for GPT models

版本:v2.0.0 下载:125.04k Stars:4 点击:8

时间:2026-01-04 19:10

phplrt/lexer-contracts

A set of phplrt lexer abstractions

版本:3.7.5 下载:159.75k Stars:1 点击:6

时间:2026-01-04 19:04

phplrt/lexer

The phplrt lexer library that can be used for scanners implementation using PCRE

版本:3.7.5 下载:148.39k Stars:3 点击:6

时间:2026-01-04 19:04

承接程序开发

PHP开发

VUE

Vue开发

前端开发

小程序开发

公众号开发

系统定制

数据库设计

云部署

网站建设

安全加固