Posts

Showing posts from October, 2020

Allocating specific amount of storage to as slave to cluster

Attaching EBS volume to OS First we have to create additional EBS volume and attach it to our OS. This volume has to be partitioned, formatted and at last has to be mounted to a drive. This drive has to mentioned in hdfs-site.xml file. Partitioning the new volume fdisk  /dev/xvdf  Formatting the partition mkfs.ext4  /dev/xvdf1 Mounting the partition on directory mount  /dev/xvdf1  /datanode Configuring hdfds-site.xml file in slave node of hadoop cluster <?xml version="1.0"?> <?xml-stylesheet type="text/xsl" href="configuration.xsl"?> <configuration> <property> <name>dfs.data.dir</name> <value>/datanode</value> </property> </configuration> Here datanode is the directory on which the volume is mounted. Configuring core-site.xml file in slave node of hadoop cluster <?xml version="1.0"?> <?xml-stylesheet type="text/xsl" href="configuration.xsl"?> <configura