Troubleshooting
Problem
The DATABRICKS_04 error arises due to a misconfiguration between the job type expected by the Databricks Job Launcher executor in SDC (either a Notebook Job or a Jar Job) and the actual job type on the Databricks side.
Databricks Job Launcher executor currently supports jobs with only one task. If your Databricks job has multiple tasks, it will trigger the DATABRICKS_04 error.
Symptom
Users may encounter the DATABRICKS_04 error message when attempting to run a Databricks job using the Databricks Job Launcher executor in Data Collector.
An example of the error message is as follows:
DATABRICKS_04 - Incorrect job type for job ID: '772703279346580'. Expected: 'Notebook Job', found: 'Jar Job'
Resolving The Problem
To address the DATABRICKS_04 error and facilitate the successful execution of Databricks jobs via the Databricks Job Launcher executor, implement the following corrective measures:
Check the Job ID in the configuration matches the intended Job ID for Databricks execution.
Confirm Job Type:
In Databricks, view "Workflows" and check that the job task is either Jar or Notebook.
In SDC, verify the Databricks Job Launcher has the correct job type.
Fix and Retest:
Correct any job type or Job ID discrepancies.
Rerun the job to solve the "DATABRICKS_04" error.
For additional resources, refer to the links below:
Document Location
Worldwide
Was this topic helpful?
Document Information
Modified date:
15 March 2025
UID
ibm17186113