wx-data sparkjob create

Submit engine applications.

Syntax

cpd-cli wx-data sparkjob create \
--engine-id=<engine-id> \
[--conf=<conf>] \
[--instance-id=<instance-id>] \
[--path=<file-path>]

Options

Table 1: Command options
Option Description
--conf Spark application details configuration.
Status
Optional.
Syntax
--conf=<conf>
Input
string
Default value
No default.
--engine-id Spark Engine ID for Spark ingestion or "lite-ingestion" for faster ingestion.
Status
Required.
Syntax
--engine-id=<engine-id>
Input
string
Default value
No default.
--instance-id watsonx.data instance ID for IBM Software Hub or CRN for SaaS.
Status
Optional.
Syntax
--instance-id=<instance-id>
Input
string
Default value
No default.
--path Path of the Spark application file in COS bucket.
Status
Optional.
Syntax
--path=<file-path>
Input
string
Default value
No default.

Examples

cpd-cli wx-data sparkjob create \
--engine-id spark01 \
--conf exampleString \
--instance-id 1735472262311515 \
--path