The Hadoop HDFS Transport – allows the user to write to the Hadoop HDFS Filesystem.
Select the Hadoop HDFS Transport from the drop down.
On the Connection tab you can specify:
the Host: the hostname of the Hadoop master server to connect to.
the Port: the port on the Hadoop master server that is open to connect to.
The FileSystem tab allows the user to specify:
the Target directory: the directoty path to be written to, from the root of the HDFS filesystem;
the Target file name: the file name to be utilized; if ‘Append to existing file’ not true, appended with numeric characters to generate unique names.
the Target file extension: the extension to be utilized. Can also be specified as part of the file name.
an action in case the Target file already exists: the user can choose the Create new or Overwrite options