pyspark - Download, install, configure, use spark packages -
i new spark/pyspark. trying read csv , attempted use spark-csv package keep seeing referenced finding .jar files, downloading, running "spark-submit --jars jarfile pythoncode.py", took forever run , in end after df.show(), displayed headers sans data. compared function wrote, it's slow , doesn't work (i'm sure it's mistake on end). tried use spark-ts package in sort of similar way, cannot run. there pip install spark and/or kind of baby step instructions general spark package installation/usage?
Comments
Post a Comment