Token
Definición
A token is the fundamental unit of text that large language models process. In English, one token is roughly 3/4 of a word (100 tokens ≈ 75 words). LLM providers charge based on token consumption: input tokens (your prompt and context) plus output tokens (the model's response). Understanding tokens is essential for managing AI costs and staying within model context windows.
Token Tracking in JieGou
JieGou tracks input and output tokens for every recipe run and workflow execution. This data feeds into per-recipe, per-workflow, and per-department cost dashboards. With BYOK, tokens are billed directly to your provider account at their standard rates.
Context Windows
Each LLM has a maximum context window — the total number of tokens it can process in one request (prompt + response). Claude supports up to 200K tokens, GPT-4 up to 128K. JieGou's RAG system is designed to stay within these limits by retrieving only the most relevant document chunks.
Términos relacionados
Recetas de IA
Conozca qué son las recetas de IA y cómo funcionan en JieGou. Las recetas son bloques de construcción de IA reutilizables de una sola operación con entradas y salidas estructuradas.
BYOK (Bring Your Own Key)
Conozca qué significa BYOK para la automatización con IA. Bring Your Own Key le permite conectar sus propias claves API de LLM a JieGou para control total de costos y privacidad de datos.
Large Language Model (LLM)
A large language model (LLM) is an AI system trained on text data that can understand and generate human language, powering tasks like writing, analysis, and reasoning.
Más información
Véalo en acción
Comience a construir automatización con IA usando recetas y flujos de trabajo hoy mismo.