paulononato/backstage
1
0
Fork 0
Code Issues Pull Requests Actions 37 Packages Projects Releases Wiki Activity

Merge pull request #18062 from backstage/freben/hack-stitch-queue

Browse Source 
introduce the concept of deferred stitching
This commit is contained in:
Patrik Oldsberg
2023-10-24 12:21:12 +02:00
committed by GitHub
parent 664e86f7f9 2bc82320e2
commit 0e6b506b3a
20 changed files with 1170 additions and 73 deletions
Download Patch File Download Diff File Expand all files Collapse all files
.changeset/loud-ghosts-deny.md
+16
View File
@@ -0,0 +1,16 @@
---
'@backstage/plugin-catalog-backend': minor
---
Introduce a new optional config parameter `catalog.stitchingStrategy.mode`,
which can have the values `'immediate'` (default) and `'deferred'`. The default
is for stitching to work as it did before this change, which means that it
happens "in-band" (blocking) immediately when each processing task finishes.
When set to `'deferred'`, stitching is instead deferred to happen on a separate
asynchronous worker queue just like processing.
Deferred stitching should make performance smoother when ingesting large amounts
of entities, and reduce p99 processing times and repeated over-stitching of
hot spot entities when fan-out/fan-in in terms of relations is very large. It
does however also come with some performance cost due to the queuing with how
much wall-clock time some types of task take.