While working on a personal ETL (Extract-Transform-Load) project, where weather data from an open-source project (wttr.in) is downloaded and relevant data is extracted and formatted into record fields for a report.

I used the ‘tee’ command in between the pipeline to visualize what the error is and where in the pipeline it is coming from. I narrowed it down to the cut and rev command (with each failing independently – even without the other).

pipeline_code

I tried using the pipeline without the rev command and tried using the cut directly with different delimiting/filter criteria. When I tried using the cut command directly, it would cut out everything else like normal but would fail again when trying to cut out the integer values (temperature readings).

terminal_output