The only way is to click on the desired page.
That is Home page, about us and etc.
here is the url: https://arthtraininginstitute.com/index.html
import requests
from bs4 import BeautifulSoup
from urllib.parse import urljoin
url="https://arthtraininginstitute.com/"
r=requests.get(url)
soup=BeautifulSoup(r.content,"lxml")
page_link=soup.select('nav-link a')
for links in page_link:
link=urljoin(url,links.get('href'))
r=r.get(link)
soup=BeautifulSoup(r.content,'lxml')
print(r.url)
New contributor
Snehal Roy is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.