Aug-06-2023, 01:09 AM
My visual Studio Code is integrated with apache spark module. So pyspark module is imported with python codes. But I try to import anaconda pandas and it brings the error
Error:File "/home/joseph/VSCode_Workspace/deep-learn-python/com/aaa/dl/mysql_feat.py", line 5, in <module>
import pandas as pd
File "/home/joseph/spark/python/pyspark/pandas/__init__.py", line 29, in <module>
from pyspark.pandas.missing.general_functions import MissingPandasLikeGeneralFunctions
File "/home/joseph/spark/python/pyspark/pandas/__init__.py", line 34, in <module>
require_minimum_pandas_version()
File "/home/joseph/spark/python/pyspark/sql/pandas/utils.py", line 37, in require_minimum_pandas_version
if LooseVersion(pandas.__version__) < LooseVersion(minimum_pandas_version):
AttributeError: partially initialized module 'pandas' has no attribute '__version__' (most likely due to a circular import)
In the error message, the imported pandas module is pyspark.pandas because the default pandas is pyspark.pandas. Kindly inform me how to import anaconda pandas module.