Retrieve One Row from a Table, Not the Whole Table: Row-Level Chunks for RAG

A technique for RAG systems that indexes tables at the row level instead of treating an entire table as one chunk, so a targeted question like 'what is the cap for vehicle theft?' returns only the matching row plus its column headers rather than the whole table. The serialize_table_rows function parses markdown-pipe table lines emitted by parsers like Docling, folds multi-row headers, and serializes each body row as 'column: value' pairs for keyword or embedding search. A dispatcher decides whether to route a question to the row-level index (targeted lookup), widen back to the whole table (synthesis queries where most rows match), or stitch a few rows together (mixed queries). Worked examples on an insurance guarantees table and Table 1 of the Attention Is All You Need paper show 4-40x reductions in context size for targeted lookups.

Nguồn: https://towardsdatascience.com/retrieve-one-row-from-a-table-not-the-whole-table-row-level-chunks-for-rag. 8 Sync News chỉ tóm tắt và dẫn link; bản quyền nội dung thuộc tác giả và nguồn gốc.