Azure HDInsight enables you to run an Apache Spark batch job for big data analytics. The following table describes Azure HDInsight job parameters:
Parameter |
Description |
---|---|
Connection profile |
Defines the name of a connection profile to use to connect to the Azure HDInsight workspace. |
Parameters |
Defines parameters to be passed on the Apache Spark Application during job execution, in JSON format (name:value pairs). This JSON must include the file and className elements. For more information about common parameters, see the discussion of Batch Job using HDInsight Spark in the Azure documentation. |
Polling Intervals |
(Optional) Defines the number of seconds to wait before verification of the Apache Spark batch job. Default: 10 seconds |
Bring Logs to output |
Determines whether logs from Apache Spark are shown in the job output. Valid values are checked or unchecked. Default: unchecked |
Parent Topic |