carlessanagustin
11/22/2016 - 3:34 PM

HADOOP: Fix HDFS under replicated blocks

HADOOP: Fix HDFS under replicated blocks

#!/usr/bin/bash

HDFSUSER=hdfs
URFILES=/tmp/under_replicated_files

sudo -u $HDFSUSER hdfs fsck / | grep 'Under replicated' | awk -F':' '{print $1}' >> $URFILES
sudo -u $HDFSUSER for hdfsfile in `cat $URFILES`; do echo "Fixing $hdfsfile :" ;  hdfs dfs -setrep 3 $hdfsfile; done