Integration Engine Solutions to Connect Anything to Anything

Log out?

Hadoop HDFS Listener

Within the eiConsole or eiPlatform the Hadoop HDFS Listener is used to pick up files from the Hadoop HDFS file system.

Hadoop HDFS Listener/Adapter in PilotFish Software

Listener (Adapter) Configuration Drop-Down List

Connection Hadoop HDFS Listener Configuration Options

On the Connection tab configuration you should specify the Host of the Hadoop master server to connect to, and the Port on the Hadoop master server that is open to connect to.

Hadoop HDFS Listener/Adapter in PilotFish Software

Hadoop HDFS Listener Connection Configuration Options

FileSystem Hadoop HDFS Listener Configuration Options

The FileSystem tab allows you set:

Hadoop HDFS Listener/Adapter in PilotFish Software

Hadoop HDFS Listener FileSystem Configuration Options

Advanced Hadoop HDFS Listener Configuration Options

The Advanced tab allows you to specify whether or not you should only run the Listener when it is triggered externally, how many elements should be serialized and whether or not to also scan sub-folders.

Also, you can set the following:

Hadoop HDFS Listener/Adapter in PilotFish Software

Hadoop HDFS Listener Advanced Configuration Options

Transaction Logging Hadoop HDFS Listener Configuration Options

The Transaction Logging tab allows you to specify:

Hadoop HDFS Listener/Adapter in PilotFish Software

Hadoop HDFS Listener Transaction Logging Configuration Options

Inactivity Hadoop HDFS Listener Configuration Options

The Inactivity tab allows you to specify:

Hadoop HDFS Listener/Adapter in PilotFish Software

Hadoop HDFS Listener Inactivity Configuration Options

Throttling Hadoop HDFS Listener Configuration Options

The Throttling tab allows you to specify:

Hadoop HDFS Listener/Adapter in PilotFish Software

Hadoop HDFS Listener Throttling Mode

Hadoop HDFS Listener/Adapter in PilotFish Software

Hadoop HDFS Listener Throttling Configuration Options

Post-Process Hadoop HDFS Listener Configuration Options

The Post-Process tab allows you to specify the behavior of the system after a file has been picked up. You can Keep, Delete or Move the file. If you choose to Move a file, the Target Directory becomes required. This allows you to specify the directory to use for the processed files.

Hadoop HDFS Listener/Adapter in PilotFish Software

Hadoop HDFS Listener Post-Process Configuration Options

Scheduling Hadoop HDFS Listener Configuration Options

The Scheduling tab allows you to create a schedule for how often the chosen Listener should be run. You can easily modify the start time or end time.

To modify the scheduled start or end time, choose the three dots next to the corresponding line. You will receive a dialogue box that looks like this:

Hadoop HDFS Listener/Adapter in PilotFish Software

Hadoop HDFS Listener Scheduling Configuration Options

This is a unique website which will require a more modern browser to work! Please upgrade today!