I need to do OCR task on images containing ordinary horizontal text, and, besides this, text with 90 and 270 degree rotation Like this

I use python and PaddleOcr .PaddleOCR can recognize rotated text, but sometimes it doesn’t.And, besides this, this programm sometimes doesn’t recognize rotated text correctly.I tried to solve the problem by this algoritm:

1.Detect all areas with a text

2.If confidence score of the area is high enough paint it over and save the recognition result

3.Rotate image to 90 degree

4.Repeat steps 1-3 until 360 degree rotation

It doesnt work, because, sometimes the confidence score for a rotated text is higher than the confidence score for horizontal text.Is there a better way to recognize rotated text correctly?
(There is only 90 and 270 text rotation in my task; no 30,59 or 269 degree rotation)