Knowledge Chunk Splitter

Upload documents or paste text, and the AI splits the content into knowledge blocks by chapter, paragraph, or concept, showing the result in JSONL format and producing a downloadable JSONL file.

The knowledge chunk splitter uses the same AI splitting method as the knowledge base import to divide your content into complete knowledge blocks. You can paste text directly into the input box, or upload txt, docx, xlsx, pptx, or pdf files — the system first extracts the plain text from each file before processing. After you press send, the screen streams the splitting progress: the AI first scans the whole document to build a chapter structure map, then splits by priority — by chapter when the text has chapters, by paragraph when it has no chapters, and by concept when it has neither chapters nor paragraphs — so that each block presents one complete chapter, paragraph, or concept, and automatically generates search keywords that include the book title and chapter names. When splitting is done, the screen shows all knowledge blocks in JSONL format identical to the downloadable file, and a JSONL file is generated with a download link. Each line is one knowledge block record with output (the original text of the block), keyword, remark (x/y, marking which part of the content it is out of the total), and vector (the block content encoded into an embedding by an AI vector model, ready for vector search) fields. The resulting JSONL file can be imported into a knowledge base directly with the knowledge base's Import JSON feature, or used for RAG retrieval and fine-tuning data preparation. Long content is analyzed window by window, so please wait for the stream to finish. Maximum total upload size per request: 256MB (all files and message content combined). Accepted document formats: pdf, docx, xlsx, pptx, txt, csv (file content is provided to the model as extracted text). Accepted image formats: gif, jpeg, jpg, png, webp. Animated GIF images are analyzed using only the first frame. Maximum number of images: 600. When uploading more than 20 images, each side must be at most 2,000 pixels. Maximum size per image: 10MB (base64-encoded). Maximum total image size per message: 20MB (text and history share the same request size limit; uploads close to the limit may still be rejected). Image dimensions: 200 to 8,000 pixels per side. Output content formats: Text Maximum input per run: about 5,000,000 tokens. File output format: JSONL (importable into the knowledge base). This module does not support continuous conversations. AI can make mistakes. Please verify important information.