I am trying to find a reliable way to determine the similarity between geometric shapes (polygons).

In one of my approaches, I tried to use the cvopen library and the findContours() and matchShapes() methods. However, this is not an ideal way for me, since I can have very similar shapes, but with different point coordinates. And accordingly, two shapes are determined to be completely different. An example is below

I started to explore the issue further, and tried to determine the identity of figures based on the area, perimeter, and comparison of the angles of the figures. But this option is also not entirely optimal, since similar figures can differ in size (and therefore in area and perimeter), and the angles of the figures can be slightly different. An example is below

You may ask: which figures do I consider similar, and which figures are different? In the example below, the figures are categorically not similar to each other, but the first two photos, I will classify as similar figures

I am not asking for a ready-made code for the solution, I am only asking for advice and ideas from you. What other methods can I try to correctly determine the similarity of figures?