Amazon Data Pipeline

The Amazon data pipeline service processes and moves data between different AWS compute and storage services, as well as on-premises data sources, at predefined intervals. The use of AWS compute and storage services are widely accepted in the market, and providing connectivity to those services is essential for businesses

Actions

  • reportTaskRunnerHeartbeat: Calls Report Task Runner Heartbeat every 15 minutes to indicate that the task runners are operational.

  • removeTags: Removes tags from the specified pipeline.

  • evaluateExpression: Analyses a string in the context of a specified object.

  • listPipelines: Provides list of all active pipeline identifiers.

  • describePipelines: Returns metadata about one or more pipelines.

  • deactivatePipeline: Deactivates the specified pipeline.

  • reportTaskProgress: Updates the AWS Data Pipeline service regularly about the progress of the calling task runner.

  • setStatus: Updates the status of an array of physical or logical pipeline objects.

  • activatePipeline: Activates the pipeline and initiates the pipeline tasks.

  • putPipelineDefinition: Creates tasks, schedules, and preconditions to control pipeline behavior.

  • createPipeline: Creates a new pipeline.

  • queryObjects: Searches for names of objects that match specified conditions in a pipeline.

  • addTags: Adds or modifies tags for the specified pipeline.

  • setTaskStatus: Notifies AWS Data Pipeline that a task is completed and provides information about the final status.

  • describeObjects: Provides object definitions for a set of pipeline objects.

  • deletePipeline: Deletes a data pipeline.

  • validatePipelineDefinition: Performs validation checks of the pipeline definition and ensures that the pipeline runs without errors.

  • getPipelineDefinition: Returns the pipeline definition that is defined in the Put Pipeline Definition method.

  • pollForTask: Calls PollForTask to receive details about the task that must be performed from AWS Data Pipeline.

Custom Actions

Amazon Data Pipeline connector also lets you create your own custom actions for performing specific tasks. The actions you create look and work exactly like the other actions do.

Learn more about how to create custom actions.