Interface TextSplitterTokenSplitterNodeParameters

Source
interface TextSplitterTokenSplitterNodeParameters {
    chunkOverlap?: number;
    chunkSize?: number;
}

Properties§

Source§

readonly chunkOverlap?: number

Number of tokens shared between consecutive chunks to preserve context

Source§

readonly chunkSize?: number

Maximum number of tokens per chunk Default: 1000