I am currently trying to attempting to tokenize large text, however i have a lot of files in the directory that i want to tokenize as this is very time consuming to do 1 by 1.