Token
定义
A token is the fundamental unit of text that large language models process. In English, one token is roughly 3/4 of a word (100 tokens ≈ 75 words). LLM providers charge based on token consumption: input tokens (your prompt and context) plus output tokens (the model's response). Understanding tokens is essential for managing AI costs and staying within model context windows.
Token Tracking in JieGou
JieGou tracks input and output tokens for every recipe run and workflow execution. This data feeds into per-recipe, per-workflow, and per-department cost dashboards. With BYOK, tokens are billed directly to your provider account at their standard rates.
Context Windows
Each LLM has a maximum context window — the total number of tokens it can process in one request (prompt + response). Claude supports up to 200K tokens, GPT-4 up to 128K. JieGou's RAG system is designed to stay within these limits by retrieving only the most relevant document chunks.
相关术语
AI 配方
了解什么是 AI 配方以及它们如何在 JieGou 中运作。配方是可重复使用的单一操作 AI 建构模组，具有结构化的输入和输出。
BYOK（自带金钥）
了解 BYOK 对 AI 自动化的意义。自带金钥让您将自己的 LLM API 金钥连接到 JieGou，实现完全的成本控制和资料隐私。
Large Language Model (LLM)
A large language model (LLM) is an AI system trained on text data that can understand and generate human language, powering tasks like writing, analysis, and reasoning.