The issue is that the "Noisy Image" pass added even though it should not.

It seems it is not enough to check for use_denoising on the view layer. When use_denoising is disabled on the scene, it is implicitly disabled on all view layers. This can be seen by the fact that the CYCLES_RENDER_PT_denoising panel is hidden when use_denoising is disabled on the scene.