I am trying to the robots.txt on my UAT server.
I am able to access the robots.txt locally with localhost:9001/food/robots.txt. However I am not able to access when it is in my UAT server with example-uat.com/food/robots.txt. It shows ‘This page isn’t working. If the problem continues, contact the site owner.
HTTP ERROR 401’ when i try to access it in the UAT server. HTTP error 401 shows authentication error.
MY UAT server is hosted on AWS with elastic container service.
Does anyone know the cause of this?