Development Environments – Spark lab experience

Applies to :

Spark engine

Apache Gluten accelerated Spark engine

VS Code development environment - Spark labs
The VS Code development environment is a Spark-based development environment that enables you to interactively program, debug, submit, and test Spark applications on a Spark cluster running on the Spark engine. It is available as a Visual Studio Code extension and you can install it in your local system to access Spark IDE using Visual Studio Code. It reduces the time for development and increases usability.
Monitoring and debugging Spark applications from Spark labs
Managing Spark labs from user interface
The Spark labs tab in the watsonx.data console lets you monitor and manage labs directly from the console, while lab creation remains available through the VS Code extension. It displays key details for each lab and provides controls to review, filter, and stop labs when needed.

Parent topic: Working with Spark