Repository navigation
Commit fbda999
authored
perf(synth): shard near-duplicate signing across the resolver pool (#609)
* probe: shard near-duplicate signing across the resolver pool
* probe: store signed shingle arrays and build Sets only for pair bodies
* fix(graph): fall back to in-process signing when the nearDup signer fails
Review of #609: a rejected pool/worker signing task left the stale
bodies unsigned and the pairs stale. Catch the rejection and run the
same in-process loop the no-pool path uses, logging under
SYNTH_TIMINGS. The new test forces a rejecting signer and asserts the
rows and pairs match the in-process result.
* fix(graph): reset the near-duplicate ran flag for each full index
Review of #609: the post-synthesis hook set the instance field true and
a later indexAll on the same CodeGraph instance skipped the fallback
even when the hook did not run (no refs, no pool, resolver skipped).
Reset it at the start of each full index.1 parent 723df83 commit fbda999
7 files changed
Lines changed: 204 additions & 21 deletions
File tree
- __tests__
- src
- graph
- resolution
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
11 | 11 | | |
12 | 12 | | |
13 | 13 | | |
14 | | - | |
| 14 | + | |
15 | 15 | | |
16 | 16 | | |
17 | 17 | | |
| |||
173 | 173 | | |
174 | 174 | | |
175 | 175 | | |
176 | | - | |
| 176 | + | |
177 | 177 | | |
178 | 178 | | |
179 | 179 | | |
180 | 180 | | |
181 | 181 | | |
182 | 182 | | |
183 | 183 | | |
184 | | - | |
| 184 | + | |
| 185 | + | |
| 186 | + | |
| 187 | + | |
| 188 | + | |
| 189 | + | |
| 190 | + | |
| 191 | + | |
| 192 | + | |
| 193 | + | |
| 194 | + | |
| 195 | + | |
| 196 | + | |
| 197 | + | |
| 198 | + | |
| 199 | + | |
| 200 | + | |
| 201 | + | |
| 202 | + | |
| 203 | + | |
| 204 | + | |
| 205 | + | |
| 206 | + | |
| 207 | + | |
| 208 | + | |
185 | 209 | | |
186 | 210 | | |
187 | 211 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
58 | 58 | | |
59 | 59 | | |
60 | 60 | | |
61 | | - | |
| 61 | + | |
62 | 62 | | |
63 | 63 | | |
64 | 64 | | |
| |||
189 | 189 | | |
190 | 190 | | |
191 | 191 | | |
| 192 | + | |
| 193 | + | |
192 | 194 | | |
193 | 195 | | |
194 | 196 | | |
| |||
655 | 657 | | |
656 | 658 | | |
657 | 659 | | |
| 660 | + | |
| 661 | + | |
| 662 | + | |
| 663 | + | |
658 | 664 | | |
659 | 665 | | |
660 | 666 | | |
| |||
827 | 833 | | |
828 | 834 | | |
829 | 835 | | |
830 | | - | |
| 836 | + | |
| 837 | + | |
831 | 838 | | |
832 | 839 | | |
833 | 840 | | |
| |||
850 | 857 | | |
851 | 858 | | |
852 | 859 | | |
853 | | - | |
| 860 | + | |
854 | 861 | | |
855 | 862 | | |
856 | 863 | | |
| |||
1859 | 1866 | | |
1860 | 1867 | | |
1861 | 1868 | | |
1862 | | - | |
| 1869 | + | |
1863 | 1870 | | |
1864 | 1871 | | |
1865 | 1872 | | |
| |||
2255 | 2262 | | |
2256 | 2263 | | |
2257 | 2264 | | |
2258 | | - | |
| 2265 | + | |
2259 | 2266 | | |
2260 | 2267 | | |
2261 | 2268 | | |
2262 | 2269 | | |
2263 | 2270 | | |
2264 | | - | |
| 2271 | + | |
2265 | 2272 | | |
2266 | 2273 | | |
2267 | 2274 | | |
2268 | 2275 | | |
2269 | 2276 | | |
2270 | 2277 | | |
2271 | 2278 | | |
| 2279 | + | |
2272 | 2280 | | |
2273 | 2281 | | |
2274 | 2282 | | |
| |||
2288 | 2296 | | |
2289 | 2297 | | |
2290 | 2298 | | |
2291 | | - | |
| 2299 | + | |
| 2300 | + | |
| 2301 | + | |
2292 | 2302 | | |
2293 | 2303 | | |
2294 | 2304 | | |
| 2305 | + | |
| 2306 | + | |
| 2307 | + | |
| 2308 | + | |
| 2309 | + | |
| 2310 | + | |
| 2311 | + | |
| 2312 | + | |
| 2313 | + | |
| 2314 | + | |
2295 | 2315 | | |
2296 | 2316 | | |
2297 | 2317 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
128 | 128 | | |
129 | 129 | | |
130 | 130 | | |
| 131 | + | |
| 132 | + | |
| 133 | + | |
| 134 | + | |
| 135 | + | |
| 136 | + | |
| 137 | + | |
| 138 | + | |
| 139 | + | |
| 140 | + | |
| 141 | + | |
| 142 | + | |
| 143 | + | |
| 144 | + | |
| 145 | + | |
| 146 | + | |
| 147 | + | |
| 148 | + | |
| 149 | + | |
| 150 | + | |
131 | 151 | | |
132 | 152 | | |
133 | 153 | | |
134 | 154 | | |
| 155 | + | |
| 156 | + | |
135 | 157 | | |
136 | 158 | | |
137 | 159 | | |
| |||
152 | 174 | | |
153 | 175 | | |
154 | 176 | | |
155 | | - | |
| 177 | + | |
156 | 178 | | |
157 | 179 | | |
158 | 180 | | |
| |||
172 | 194 | | |
173 | 195 | | |
174 | 196 | | |
175 | | - | |
176 | | - | |
177 | | - | |
178 | | - | |
179 | | - | |
180 | | - | |
181 | | - | |
182 | | - | |
| 197 | + | |
| 198 | + | |
| 199 | + | |
| 200 | + | |
| 201 | + | |
| 202 | + | |
| 203 | + | |
| 204 | + | |
| 205 | + | |
| 206 | + | |
| 207 | + | |
| 208 | + | |
| 209 | + | |
| 210 | + | |
| 211 | + | |
| 212 | + | |
| 213 | + | |
| 214 | + | |
| 215 | + | |
| 216 | + | |
| 217 | + | |
| 218 | + | |
| 219 | + | |
| 220 | + | |
| 221 | + | |
| 222 | + | |
| 223 | + | |
| 224 | + | |
| 225 | + | |
| 226 | + | |
| 227 | + | |
| 228 | + | |
| 229 | + | |
| 230 | + | |
| 231 | + | |
| 232 | + | |
| 233 | + | |
| 234 | + | |
| 235 | + | |
| 236 | + | |
| 237 | + | |
183 | 238 | | |
184 | 239 | | |
185 | 240 | | |
| |||
229 | 284 | | |
230 | 285 | | |
231 | 286 | | |
232 | | - | |
| 287 | + | |
233 | 288 | | |
234 | 289 | | |
235 | 290 | | |
| |||
271 | 326 | | |
272 | 327 | | |
273 | 328 | | |
274 | | - | |
| 329 | + | |
| 330 | + | |
275 | 331 | | |
276 | 332 | | |
277 | 333 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
2280 | 2280 | | |
2281 | 2281 | | |
2282 | 2282 | | |
| 2283 | + | |
| 2284 | + | |
| 2285 | + | |
2283 | 2286 | | |
2284 | 2287 | | |
2285 | 2288 | | |
| |||
3051 | 3054 | | |
3052 | 3055 | | |
3053 | 3056 | | |
| 3057 | + | |
| 3058 | + | |
| 3059 | + | |
| 3060 | + | |
| 3061 | + | |
| 3062 | + | |
| 3063 | + | |
| 3064 | + | |
| 3065 | + | |
| 3066 | + | |
| 3067 | + | |
| 3068 | + | |
3054 | 3069 | | |
3055 | 3070 | | |
3056 | 3071 | | |
| |||
0 commit comments