dgadiraju
11/4/2017 - 3:11 PM

write-processed-data-back-to-hdfs-compressed-snappy.scala

write-processed-data-back-to-hdfs-compressed-snappy.scala
content_copyfile_download
sqlContext.setConf("spark.sql.parquet.compression.codec","snappy");
dataFrameResult.write.parquet("/user/cloudera/problem1/result4a-snappy");
sqlResult.write.parquet("/user/cloudera/problem1/result4b-snappy");
comByKeyResult.write.parquet("/user/cloudera/problem1/result4c-snappy");