I am trying to stream a response from a java server. The response is sent to a Vue client. When the server and client are running on my local Windows machine, it works beautifully. However, when the server and client are running on a Linux server, the server seems to be sending as a stream but the Vue client does not receive the response until the stream is completed. So it gets the response as a batch, not as a stream. I don’t know if there is a configuration issue with the Java server or the Vue client. It’s not a code issue as the exact same code is running on both machines. Please enlighten me.
The server log shows the response streaming like below.
OpenAiController - =====>> Thread Message Delta: approved
OpenAiController - =====>> Thread Message Delta: solely
OpenAiController - =====>> Thread Message Delta: for
OpenAiController - =====>> Thread Message Delta: the
OpenAiController - =====>> Thread Message Delta: treatment
OpenAiController - =====>> Thread Message Delta: of
OpenAiController - =====>> Thread Message Delta: fa
OpenAiController - =====>> Thread Message Delta: ec
OpenAiController - =====>> Thread Message Delta: al
OpenAiController - =====>> Thread Message Delta: oma
OpenAiController - =====>> Thread Message Delta: ,
OpenAiController - =====>> Thread Message Delta: several
OpenAiController - =====>> Thread Message Delta: medications
OpenAiController - =====>> Thread Message Delta: are
OpenAiController - =====>> Thread Message Delta: commonly
OpenAiController - =====>> Thread Message Delta: used
OpenAiController - =====>> Thread Message Delta: to
OpenAiController - =====>> Thread Message Delta: manage
OpenAiController - =====>> Thread Message Delta: the
OpenAiController - =====>> Thread Message Delta: underlying
OpenAiController - =====>> Thread Message Delta: constipation
OpenAiController - =====>> Thread Message Delta: that
OpenAiController - =====>> Thread Message Delta: can
OpenAiController - =====>> Thread Message Delta: lead
However on the client it gets the entire response all at once after everything is finished.