Amazonka.Glue.Types.Workflow

Documentation

data Workflow

A workflow is a collection of multiple dependent Glue jobs and crawlers that are run to complete a complex ETL task. A workflow manages the execution and monitoring of all its jobs and crawlers.

See: newWorkflow smart constructor.

Constructors

Workflow'

Fields

• blueprintDetails :: Maybe BlueprintDetails

  This structure indicates the details of the blueprint that this particular workflow is created from.

• createdOn :: Maybe POSIX

  The date and time when the workflow was created.

• defaultRunProperties :: Maybe (HashMap Text Text)

  A collection of properties to be used as part of each execution of the workflow. The run properties are made available to each job in the workflow. A job can modify the properties for the next jobs in the flow.

• description :: Maybe Text

  A description of the workflow.

• graph :: Maybe WorkflowGraph

  The graph representing all the Glue components that belong to the workflow as nodes and directed connections between them as edges.

• lastModifiedOn :: Maybe POSIX

  The date and time when the workflow was last modified.

• lastRun :: Maybe WorkflowRun

  The information about the last execution of the workflow.

• maxConcurrentRuns :: Maybe Int

  You can use this parameter to prevent unwanted multiple updates to data, to control costs, or in some cases, to prevent exceeding the maximum number of concurrent runs of any of the component jobs. If you leave this parameter blank, there is no limit to the number of concurrent workflow runs.

• name :: Maybe Text

  The name of the workflow.

Instances

FromJSON Workflow

Defined in Amazonka.Glue.Types.Workflow

Methods

parseJSON :: Value -> Parser Workflow

parseJSONList :: Value -> Parser [Workflow]

Generic Workflow

Defined in Amazonka.Glue.Types.Workflow

Associated Types

type Rep Workflow :: Type -> Type

Methods

from :: Workflow -> Rep Workflow x

to :: Rep Workflow x -> Workflow

Read Workflow

Defined in Amazonka.Glue.Types.Workflow

Methods

readsPrec :: Int -> ReadS Workflow

readList :: ReadS [Workflow]

readPrec :: ReadPrec Workflow

readListPrec :: ReadPrec [Workflow]

Show Workflow

Defined in Amazonka.Glue.Types.Workflow

Methods

showsPrec :: Int -> Workflow -> ShowS

show :: Workflow -> String

showList :: [Workflow] -> ShowS

NFData Workflow

Defined in Amazonka.Glue.Types.Workflow

Methods

rnf :: Workflow -> ()

Eq Workflow

Defined in Amazonka.Glue.Types.Workflow

Methods

(==) :: Workflow -> Workflow -> Bool

(/=) :: Workflow -> Workflow -> Bool

Hashable Workflow

Defined in Amazonka.Glue.Types.Workflow

Methods

hashWithSalt :: Int -> Workflow -> Int

hash :: Workflow -> Int

type Rep Workflow

Defined in Amazonka.Glue.Types.Workflow

type Rep Workflow = D1 ('MetaData "Workflow" "Amazonka.Glue.Types.Workflow" "amazonka-glue-2.0-7miPWwBHdfn8N8SvbpLgE0" 'False) (C1 ('MetaCons "Workflow'" 'PrefixI 'True) (((S1 ('MetaSel ('Just "blueprintDetails") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe BlueprintDetails)) :*: S1 ('MetaSel ('Just "createdOn") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe POSIX))) :*: (S1 ('MetaSel ('Just "defaultRunProperties") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe (HashMap Text Text))) :*: S1 ('MetaSel ('Just "description") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Text)))) :*: ((S1 ('MetaSel ('Just "graph") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe WorkflowGraph)) :*: S1 ('MetaSel ('Just "lastModifiedOn") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe POSIX))) :*: (S1 ('MetaSel ('Just "lastRun") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe WorkflowRun)) :*: (S1 ('MetaSel ('Just "maxConcurrentRuns") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Int)) :*: S1 ('MetaSel ('Just "name") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Text)))))))

newWorkflow :: Workflow

Create a value of Workflow with all optional fields omitted.

Use generic-lens or optics to modify other optional fields.

The following record fields are available, with the corresponding lenses provided for backwards compatibility:

$sel:blueprintDetails:Workflow', workflow_blueprintDetails - This structure indicates the details of the blueprint that this particular workflow is created from.

$sel:createdOn:Workflow', workflow_createdOn - The date and time when the workflow was created.

$sel:defaultRunProperties:Workflow', workflow_defaultRunProperties - A collection of properties to be used as part of each execution of the workflow. The run properties are made available to each job in the workflow. A job can modify the properties for the next jobs in the flow.

$sel:description:Workflow', workflow_description - A description of the workflow.

Workflow, workflow_graph - The graph representing all the Glue components that belong to the workflow as nodes and directed connections between them as edges.

$sel:lastModifiedOn:Workflow', workflow_lastModifiedOn - The date and time when the workflow was last modified.

$sel:lastRun:Workflow', workflow_lastRun - The information about the last execution of the workflow.

$sel:maxConcurrentRuns:Workflow', workflow_maxConcurrentRuns - You can use this parameter to prevent unwanted multiple updates to data, to control costs, or in some cases, to prevent exceeding the maximum number of concurrent runs of any of the component jobs. If you leave this parameter blank, there is no limit to the number of concurrent workflow runs.

Workflow, workflow_name - The name of the workflow.

workflow_blueprintDetails :: Lens' Workflow (Maybe BlueprintDetails)

This structure indicates the details of the blueprint that this particular workflow is created from.

workflow_createdOn :: Lens' Workflow (Maybe UTCTime)

The date and time when the workflow was created.

workflow_defaultRunProperties :: Lens' Workflow (Maybe (HashMap Text Text))

A collection of properties to be used as part of each execution of the workflow. The run properties are made available to each job in the workflow. A job can modify the properties for the next jobs in the flow.

workflow_description :: Lens' Workflow (Maybe Text)

A description of the workflow.

workflow_graph :: Lens' Workflow (Maybe WorkflowGraph)

The graph representing all the Glue components that belong to the workflow as nodes and directed connections between them as edges.

workflow_lastModifiedOn :: Lens' Workflow (Maybe UTCTime)

The date and time when the workflow was last modified.

workflow_lastRun :: Lens' Workflow (Maybe WorkflowRun)

The information about the last execution of the workflow.

workflow_maxConcurrentRuns :: Lens' Workflow (Maybe Int)

You can use this parameter to prevent unwanted multiple updates to data, to control costs, or in some cases, to prevent exceeding the maximum number of concurrent runs of any of the component jobs. If you leave this parameter blank, there is no limit to the number of concurrent workflow runs.

workflow_name :: Lens' Workflow (Maybe Text)

The name of the workflow.