Repository navigation
Commit d3be873
committed
fix(gateway): AI网关中低危修复——熔断器语义/探活超时/JWKS安全/Key冷却/重试策略/错误脱敏/Redis重连/限流原子化
- GW-M1: 熔断器 CLOSED 成功重置失败计数(分散失败不再误熔断);仅 HALF_OPEN 允许恢复(冷却期不可绕过)
- GW-M2: 健康探活独立 10s 超时(原最长 900s)+ 冷却期内探活成功不恢复
- GW-M3: JWKS 共享 AsyncClient 连接池 + asyncio.Lock 防击穿 + 网络失败 fail-closed(不再返回过期缓存)
- GW-M4: KeyPool 全冷却返回 None(不再打必失败的冷却 Key);429 时自动标记当前 Key 冷却(熔断联动接线)
- GW-M5: with_retry_and_timeout 仅重试可重试错误,401/400/429/内容审核直接上抛(消除 9 连发重试风暴)
- GW-M6: 上游错误脱敏——响应仅返回通用文案与结构化字段,不再透传 provider 内部信息
- GW-M7: Redis 惰性重连——连接失效后下次操作自动恢复,限流/缓存不再静默失效至重启
- GW-M8: chunked 编码请求体流式计数限流(无 Content-Length 时逐块累计超限 413)
- GW-M9: Prompt 防护移除 >1000 字符跳过 + 数组全量检测(长文注入不再绕过)
- GW-M10: AI 响应缓存键前缀 user_id,杜绝跨用户隐私内容交叉泄漏
- GW-M11: 匿名用户按 IP 分桶限流,防止共享配额被污染
- GW-M12: 限流 Lua 脚本原子化(INCR+超限自动回滚),消除计数竞态与负数
- GW-M13: balance 共享 HTTP 客户端 + asyncio.Lock 防缓存击穿
- GW-M14: Key 轮换加 asyncio.Lock + 旧客户端 aclose 释放连接池
- GW-M15: 转写请求 base64 max_length + 参数范围校验;ASR confidence 不再硬编码 0.9(无数据源时返回 0.0)
- GW-L1: 删除无调用者的 semantic_cache 死代码
- GW-L2: text_dedup 长度预过滤降低 O(n²) 实际开销
- GW-L3: _FEATURE_CONTEXT 成功路径 try/finally 重置
- GW-L5: 虚拟 Key 随机熵 64 位 → 128 位
测试: python -m pytest tests/ -q → 193 passed1 parent 8e78b6f commit d3be873
19 files changed
Lines changed: 297 additions & 285 deletions
File tree
- server/ai-gateway
- cache
- config
- middleware
- providers
- routers
- utils
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
62 | 62 | | |
63 | 63 | | |
64 | 64 | | |
| 65 | + | |
| 66 | + | |
65 | 67 | | |
66 | 68 | | |
67 | 69 | | |
68 | 70 | | |
69 | 71 | | |
70 | 72 | | |
| 73 | + | |
| 74 | + | |
71 | 75 | | |
72 | 76 | | |
73 | 77 | | |
| |||
76 | 80 | | |
77 | 81 | | |
78 | 82 | | |
| 83 | + | |
| 84 | + | |
79 | 85 | | |
80 | 86 | | |
81 | 87 | | |
| |||
86 | 92 | | |
87 | 93 | | |
88 | 94 | | |
| 95 | + | |
89 | 96 | | |
90 | 97 | | |
91 | 98 | | |
| |||
102 | 109 | | |
103 | 110 | | |
104 | 111 | | |
| 112 | + | |
| 113 | + | |
105 | 114 | | |
106 | 115 | | |
107 | 116 | | |
| |||
112 | 121 | | |
113 | 122 | | |
114 | 123 | | |
| 124 | + | |
115 | 125 | | |
116 | 126 | | |
| 127 | + | |
| 128 | + | |
| 129 | + | |
| 130 | + | |
| 131 | + | |
| 132 | + | |
| 133 | + | |
| 134 | + | |
| 135 | + | |
| 136 | + | |
| 137 | + | |
117 | 138 | | |
118 | 139 | | |
119 | 140 | | |
| |||
This file was deleted.
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
197 | 197 | | |
198 | 198 | | |
199 | 199 | | |
200 | | - | |
| 200 | + | |
| 201 | + | |
| 202 | + | |
| 203 | + | |
| 204 | + | |
| 205 | + | |
201 | 206 | | |
202 | 207 | | |
203 | 208 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
60 | 60 | | |
61 | 61 | | |
62 | 62 | | |
63 | | - | |
| 63 | + | |
64 | 64 | | |
65 | 65 | | |
66 | 66 | | |
| |||
73 | 73 | | |
74 | 74 | | |
75 | 75 | | |
76 | | - | |
| 76 | + | |
| 77 | + | |
77 | 78 | | |
78 | 79 | | |
79 | 80 | | |
80 | 81 | | |
81 | | - | |
| 82 | + | |
82 | 83 | | |
83 | 84 | | |
84 | 85 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
214 | 214 | | |
215 | 215 | | |
216 | 216 | | |
| 217 | + | |
| 218 | + | |
| 219 | + | |
| 220 | + | |
| 221 | + | |
| 222 | + | |
217 | 223 | | |
218 | 224 | | |
219 | 225 | | |
220 | | - | |
221 | | - | |
| 226 | + | |
| 227 | + | |
222 | 228 | | |
223 | 229 | | |
224 | 230 | | |
225 | 231 | | |
| 232 | + | |
| 233 | + | |
| 234 | + | |
| 235 | + | |
| 236 | + | |
| 237 | + | |
| 238 | + | |
| 239 | + | |
| 240 | + | |
226 | 241 | | |
227 | 242 | | |
228 | 243 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
119 | 119 | | |
120 | 120 | | |
121 | 121 | | |
| 122 | + | |
| 123 | + | |
| 124 | + | |
| 125 | + | |
| 126 | + | |
| 127 | + | |
| 128 | + | |
| 129 | + | |
| 130 | + | |
| 131 | + | |
| 132 | + | |
122 | 133 | | |
123 | 134 | | |
124 | 135 | | |
| |||
136 | 147 | | |
137 | 148 | | |
138 | 149 | | |
139 | | - | |
| 150 | + | |
| 151 | + | |
| 152 | + | |
140 | 153 | | |
141 | 154 | | |
142 | 155 | | |
143 | 156 | | |
144 | 157 | | |
145 | | - | |
146 | | - | |
147 | | - | |
148 | | - | |
149 | | - | |
150 | | - | |
151 | | - | |
152 | | - | |
153 | | - | |
154 | | - | |
155 | | - | |
156 | | - | |
| 158 | + | |
| 159 | + | |
| 160 | + | |
| 161 | + | |
157 | 162 | | |
158 | | - | |
| 163 | + | |
| 164 | + | |
| 165 | + | |
| 166 | + | |
| 167 | + | |
| 168 | + | |
| 169 | + | |
| 170 | + | |
| 171 | + | |
| 172 | + | |
159 | 173 | | |
160 | 174 | | |
161 | 175 | | |
| |||
0 commit comments