I’m using Gemini 1.5 Pro on Vertex AI to tag attributes about people. I’m using the forced function calling feature to force the model to output JSON in the provided schema. One of the attributes is a biography string. The model fails to generate quotation symbols in this string—where a quote symbol should appear, the string attribute simply ends. It does not cause the JSON output to be invalid, merely that string attribute to stop.

When using the VertexAI API, it works 80% of the time, but every fifth file being processed errors out with Error message: “Internal error encountered.” Status: 500 Error code: 13. It does not seem to be an intermittent failure, rather, specific files fail on the generate_content method.

I can successfully process Microsoft Excel XLSX files via the WebUI on GCP (https://console.cloud.google.com/vertex-ai/generative/multimodal/create/text).