Amazon Data Pipeline

The Amazon Data Pipeline service processes and transfers data between AWS compute and storage services, along with on-premises data sources, at scheduled intervals. Given the widespread adoption of AWS compute and storage services, ensuring that connectivity to these services is essential for businesses.

Actions

  • reportTaskRunnerHeartbeat: Calls Report Task Runner Heartbeat every 15 minutes to indicate that the task runners are operational.

  • removeTags: Removes tags from the specified pipeline.

  • evaluateExpression: Analyses a string in the context of a specified object.

  • listPipelines: Provides a list of all active pipeline identifiers.

  • describePipelines: Returns metadata about one or more pipelines.

  • deactivatePipeline: Deactivates the specified pipeline.

  • reportTaskProgress: Updates the AWS Data Pipeline service regularly about the progress of the calling task runner.

  • setStatus: Updates the status of an array of physical or logical pipeline objects.

  • activatePipeline: Activates the pipeline and initiates the pipeline tasks.

  • putPipelineDefinition: Creates tasks, schedules, and preconditions to control pipeline behavior.

  • createPipeline: Creates a pipeline.

  • queryObjects: Searches for names of objects that match specified conditions in a pipeline.

  • addTags: Adds or modifies tags for the specified pipeline.

  • setTaskStatus: Notifies AWS Data Pipeline that a task is complete and provides the final status information.

  • describeObjects: Provides object definitions for a set of pipeline objects.

  • deletePipeline: Deletes a data pipeline.

  • validatePipelineDefinition: Validates the pipeline definition to ensure that it runs without errors.

  • getPipelineDefinition: Retrieves the pipeline definition that is defined in the Put Pipeline Definition method.

  • pollForTask: Calls PollForTask to receive details about the task that must be performed from AWS Data Pipeline.

Custom Actions

You can use this connector to create your own custom actions for performing specific tasks. The actions that you create look and work exactly like the other actions do.

Learn more about how to create custom actions.