Spring Cloud Gateway application 10x spike in memory allocation
I have a Spring Cloud Gateway application (reactive Netty) that runs in several GCP GCE VMs. It has an average 500 tps traffic per VM. After several weeks of running smoothly the gc young memory allocated spikes 10x from one minute to the other, randomly, in all VMs in a time span of some hours. Some time after the memory allocation spike (minutes to hours) there’s a severe performance degradation, with the server response times (spring.cloud.gateway.requests) and backend call times (http.client.requests) increasing up to 20x the normal values. CPU usage increases moderately from about 10% up to 25%. Memory usage also increases moderately from 43% up to 54%. An application restart resolves the issue. Same issue has happened twice in 7 months.