The AWS S3 Listener is used to poll files from the Amazon Simple Storage Service (Amazon S3) . To configure the AWS S3 Listener, select the AWS S3 from the Listener Type drop down menu.
1. On the Basic configuration tab you should specify the Polling interval for how often to scan the Amazon S3 Bucket. This is a container, where Amazon S3 stores data. The Bucket Name configuration item is used to configure the unique name of the bucket you need to access. The Polling Directory is the directory in the bucket to be polled. The File/Folder name restriction is a name of file to be picked up. The File extension restriction allows you to specify the file extensions that you will process. Also you can enable Specify full file path to pick up a particular file, in this case the Path to file/folder is enable. Tokenizers allow you to specify a character after which to split the file into multiple transactions. By default, the eiConsole will treat the entire file as the datastream to be handled as 1 message. However, if each line of the file represents a different record you would enter a value, such as the new line delimiter in this space.
2. Postprocess: This tab allows you to specify the behavior of the system after a file has been picked up. You can Keep, Delete or Move the file. If you choose to Move a file, the Target directory becomes required. This allows you to specify the directory to use for the processed files.
3. On the Advanced tab you can set the maximum number of transactions to process at a time; whether or not sub-folders should be searched for files as well; whether or not reads in all matching files as a single stream; a number of lines to treat as header lines (the header of the first file is included and skipped in all other files).
4. Scheduling: This tab allows you to specify the start times and end times for scheduled execution. Also you can specify days of the week or particular dates to exclude from scheduling. The Time Zone drop-down menu allows to specify the Time Zone that should be used for scheduling; by default, it is set to the Time Zone of the console during initial configuration.
5. Criteria: This tab allows you to specify additional criteria, such as:
Minimum seconds since file modified: minimum number of seconds elapsed since file modified.
Minimum days since file modified: minimum number of days elapsed since file modified.
Maximum days since file modified: maximum number of days elapsed since file modified
6. On the Credentials tab, you can set the necessary credentials for the connection. The user can choose one of three Predefined Types for credential data:
- AWS File – a special file created by the Amazon client where the AWS access key and the AWS secret key are stored. The AWS credentials file by default is located at ~/.aws/credentials on Linux, OS X, or Unix, or at C:\Users\USERNAME \.aws\credentials on Windows. This file can contain multiple named profiles in addition to the default profile. You need to enter the path to this file and a profile name if it differs from the [default]. Keep in mind that the eiConsole will check if AWS File exists on the default path and if it does not, then `AWS File Path` item becomes required for filling.
- Environment – credentials will be read from the Environment Variables– AWS_ACCESS_KEY_ID, AWS_SECRET_ACCESS_KEY. They should be set beforehand.
- Console – you can explicitly specify the credentials. They consist of an access key ID (like AKIAIOSFODNN7EXAMPLE) and a secret access key (like wJalrXUtnFEMI/K7MDENG/bPxRfiCYEXAMPLEKEY).