I want to extract all the information from a website including from its internal links for the purpose of ceating chatbot for this website . how can i do this ?

I have scrap the main site like https://www.uetmardan.edu.pk/uetm/ but i want to scrap also all of its internal links data

from bs4 import BeautifulSoup
import requests

url =  https://www.uetmardan.edu.pk/uetm/
response.raise_for_status()
soup = BeautifulSoup(response.content, 'html.parser')
data = soup.get_text(separator='n')