I am using python 3.9 with Spark.

python --version
Python 3.9.0

When I install pandas with

pip install pandas

I got the following error

Collecting pandas
Using cached pandas-2.2.2.tar.gz (4.4 MB)
Installing build dependencies … done
Getting requirements to build wheel … done
Installing backend dependencies … done
Preparing metadata (pyproject.toml) … error
error: subprocess-exited-with-error

× Preparing metadata (pyproject.toml) did not run successfully.
│ exit code: 1
╰─> [12 lines of output]
+ meson setup C:UsersbarbaAppDataLocalTemppip-install-jw566d_gpandas_b36c8476d5fa4a8dbafeeed465827c7c C:UsersbarbaAppDataLocalTemppip-install-jw566d_gpandas_b36c8476d5fa4a8dbafeeed465827c7c.mesonpy-gh0nls41build -Dbuildtype=release -Db_ndebug=if-release -Db_vscrt=md –vsenv –native-file=C:UsersbarbaAppDataLocalTemppip-install-jw566d_gpandas_b36c8476d5fa4a8dbafeeed465827c7c.mesonpy-gh0nls41buildmeson-python-native-file.ini
The Meson build system
Version: 1.2.1
Source dir: C:UsersbarbaAppDataLocalTemppip-install-jw566d_gpandas_b36c8476d5fa4a8dbafeeed465827c7c
Build dir: C:UsersbarbaAppDataLocalTemppip-install-jw566d_gpandas_b36c8476d5fa4a8dbafeeed465827c7c.mesonpy-gh0nls41build
Build type: native build
Project name: pandas
Project version: 2.2.2

  ....meson.build:2:0: ERROR: Compiler cl cannot compile programs.

  A full log can be found at C:UsersbarbaAppDataLocalTemppip-install-jw566d_gpandas_b36c8476d5fa4a8dbafeeed465827c7c.mesonpy-gh0nls41buildmeson-logsmeson-log.txt
  [end of output]

note: This error originates from a subprocess, and is likely not a problem with pip.
error: metadata-generation-failed

× Encountered error while generating package metadata.
╰─> See above for output.

note: This is an issue with the package mentioned above, not pip.
hint: See above for details.