Overview
Falcon supports HDFS DR recipe to replicate data from source cluster to destination cluster.
Setup cluster definition.
$FALCON_HOME/bin/falcon entity -submit -type cluster -file /cluster/definition.xml
Update recipes properties
Copy HDFS replication recipe properties, workflow and template file from $FALCON_HOME/data-mirroring/hdfs-replication to the accessible directory path or to the recipe directory path (falcon.recipe.path=<recipe directory path>). "falcon.recipe.path" must be specified in Falcon conf client.properties. Now update the copied recipe properties file with required attributes to replicate data from source cluster to destination cluster for HDFS DR.
Submit HDFS DR recipe
After updating the recipe properties file with required attributes in directory path or in falcon.recipe.path, there are two ways of submitting the HDFS DR recipe:
- 1. Specify Falcon recipe properties file through recipe command line.
$FALCON_HOME/bin/falcon recipe -name hdfs-replication -operation HDFS_REPLICATION
-properties /cluster/hdfs-replication.properties
- 2. Use Falcon recipe path specified in Falcon conf client.properties .
$FALCON_HOME/bin/falcon recipe -name hdfs-replication -operation HDFS_REPLICATION
Note: Recipe properties file, workflow file and template file name must match to the recipe name, it must be unique and in the same directory.