Closed utterances-bot closed 3 weeks ago
session.write doesn't seem to be valid. Is there any way to write/send a parquet to the blob with pyspark?
@palani-thangaraj, it is really not valid. Where did you find it in the article?
I guess what you trying to achive is writing to azure blob and write
should be called from DataFrame but not session
. Something like sdf.write
Azure Blob Storage with Pyspark - Blog | luminousmen
Azure Blob Storage is a Microsoft solution for storing objects in the cloud. It is optimized for storing large amounts of data and can be easily accessed by your Python/spark application
https://luminousmen.com/post/azure-blob-storage-with-pyspark