Azure HDInsight Job parameters

Azure HDInsight enables you to run an Apache Spark batch job for big data analytics. The following table describes Azure HDInsight job parameters:

Parameter

Description

Connection profile

Defines the name of a connection profile to use to connect to the Azure HDInsight workspace.

Parameters

Defines parameters to be passed on the Apache Spark Application during job execution, in JSON format (name:value pairs).

This JSON must include the file and className elements.

For more information about common parameters, see the discussion of Batch Job using HDInsight Spark in the Azure documentation.

Polling Intervals

(Optional) Defines the number of seconds to wait before verification of the Apache Spark batch job.

Default: 10 seconds

Bring Logs to output

Determines whether logs from Apache Spark are shown in the job output. Valid values are checked or unchecked.

Default: unchecked

Parent Topic

Job types