diff --git a/.changeset/all-bats-shine.md b/.changeset/all-bats-shine.md
new file mode 100644
index 0000000000..7d9af288c3
--- /dev/null
+++ b/.changeset/all-bats-shine.md
@@ -0,0 +1,5 @@
+---
+'@backstage/cli': patch
+---
+
+Change webpack caching config param to `contenthash` for cli bundler. This fixes an issue with webpack sometimes generating same hash name output files even though the content of a file was different. See more at [https://webpack.js.org/guides/caching/](https://webpack.js.org/guides/caching/).