feat(dataset): 知识库级 pdfParseConfig 文档解析开关(#68624) - #7721
Merged
c121914yu merged 3 commits intoSep 14, 2026
Merged
Conversation
|
|
|
✅ Build and publish successful - Preview fastgpt Image: 🕒 Time: 2026-09-14 19:40:23 (UTC+8) |
ohowandanliao
force-pushed
the
feat/68624/backend-p2t-switches
branch
from
September 12, 2026 04:00
ac52dd8 to
d102ee4
Compare
ctlaltlaltc
previously approved these changes
Sep 12, 2026
ohowandanliao
force-pushed
the
feat/68624/backend-p2t-switches
branch
2 times, most recently
from
September 13, 2026 15:49
72ec228 to
8771da9
Compare
ohowandanliao
force-pushed
the
feat/68624/backend-p2t-switches
branch
from
September 14, 2026 01:51
8771da9 to
bfbb346
Compare
c121914yu
reviewed
Sep 14, 2026
ohowandanliao
force-pushed
the
feat/68624/backend-p2t-switches
branch
from
September 14, 2026 09:13
9752e18 to
26c4ad5
Compare
c121914yu
previously approved these changes
Sep 14, 2026
|
✅ Docs preview deployed 🔗 👀 Click here to visit preview 🕒 Time: 2026-09-14 19:36:53 (UTC+8) |
上游同步 0d3630a..12cf1fc。按 review 意见将定制解析配置与上游原有链路 区分开, 命名与熊涛 labring#7715/labring#7706 的 sangfor 体系对齐: - 数据集字段 pdfParseConfig 改名 sangforFileParseConfig, schema/类型/函数同步 - 补全(getDatasetIultmzhFileParseConfig)与表单协议(appendIultmzhFileParseFields) 收拢 thirdProvider/sangfor/parseConfig.ts, 通用解析链仅保留单行委托 - 移除无引用 DefaultPdfParseConfig, 测试迁移 thirdProvider 测试文件 Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
ohowandanliao
force-pushed
the
feat/68624/backend-p2t-switches
branch
from
September 14, 2026 10:56
26c4ad5 to
037de00
Compare
ctlaltlaltc
approved these changes
Sep 14, 2026
c121914yu
approved these changes
Sep 14, 2026
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
3 participants
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
需求背景
68624 黄逸轩
知识库级文档解析开关：知识库可配置四个解析开关（保留页眉页脚 /
保留附录 / 图片识别 / 图表转表格），在外部解析服务（p2t）解析 PDF
时逐项生效。
主要改动
pdfParseConfig数据集级配置：zod + mongo 双schema，create / createWithFiles / update 三个入口支持，update
为整体替换语义，未设置的字段由读取层按固定默认值补全
字符串，服务端自行 str→bool），与内网 develop-1.5.0
的下发方式对齐
指纹，避免同文件不同开关共享缓存；未传配置保持旧 key
格式，兼容存量缓存
provider（feat: add third-party sangfor parsing #7715）同步透传四开关，保证两条解析路径行为一致
验证情况
附录即时生效，图表转表格依赖 MinerU VLM
输出，结果以折叠表格呈现）；sangfor 链路 E2E 通过
备注
pdf 接管），此为上游既有语义，本 MR 仅保证该路径下开关不丢失