I want to create Dataframe using text file – customer_{yyyyMMdd}.txt
Text file contains following type of data.
customer_20240716.txt|16-July-2024|TimeStamp
Rohan|235688|....
Akash|356854|....
.
.
.
.
RowCount|2500
For column mapping I will create Schema, but how can we skip first and last row while creating Data frame out of it using Pyspark?
I am using Spark 2.4.8.7
3