Why H.264 compression artefacts after scene change last longer than a GOP

I have two cameras connected to the same H.264 encoder.
The cameras point to completely different scenes.