Release notes for Instana agent bundles
The agent bundle provides the base for other sensors to run.
Agent 1.2.48
Agent 1.2.48 is released on 18 December 2025 with the tag 2025.12.18.0819.
This agent release updates the following bundles:
- agent-jvm-handling 1.0.32: Improves handling of ignored Java processes and JVM attachment.
- agent-ibmi-handler 1.0.3: Adds an API to access AS400 objects from connections.
- agent 1.1.764: Enhances log file discovery for custom log paths.
Features
This release adds the following features:
- The agent UI now discovers and displays logs from custom log paths that are configured in
org.ops4j.pax.logging.cfg. This change improves visibility into application logs stored in nonstandard locations. - The IBM i sensor can now access AS400 objects directly from AS400Connection instances, enabling more efficient integration with IBM i systems.
Fixes
This release includes the following fixes to improve reliability and correctness:
- Previously, the agent incorrectly deleted
hsperfdatafiles for Java processes in the ignore list and generated unnecessary cleanup messages. Now, the agent only stops monitoring these processes without deleting their attach files. - Previously, the agent misidentified transitioning processes as JVMs and send SIGQUIT signals to non-Java processes, which caused them to quit unexpectedly. Now, you can configure the agent to attach only to JVMs with valid attach files by using
INSTANA_JVM_HANDLING_REQUIRE_ATTACH_FILES=true. This option is disabled by default to maintain existing attachment behavior. - Previously, Netty version
4.1.125.Finalcontained the security vulnerability CVE-2025-67735. Now, Netty has been updated to version4.1.129.Finalto address this vulnerability.
Internal updates
These updates contain internal improvements that do not change customer-facing behaviour but ensure long-term stability and readiness for future enhancements:
- thirdparty-netty 4.1.129.Final
- agent-process-handling 1.0.37
- sensor-api 1.2.177
Agent 1.2.47
Agent 1.2.47 is released on 11 December 2025 with the tag 2025.12.11.0930.
This agent release updates the following bundles:
- agent-open-telemetry-grpc 1.1.15: Adds support for a configurable legacy OTLP gRPC port.
- javaagent-loader 1.3.72: Prevents class loading errors during agent upgrades.
- agent-jvm-handling 1.0.31: Improves JVM attachment compatibility.
- agent-process-handling 1.0.36: Enhances process monitoring stability and secret masking.
Features
This release adds the following features:
55680) through an environment variable or the configuration file. This support lets operators control port usage based on deployment needs.
- The legacy port can be controlled with the environment variable
INSTANA_AGENT_OTEL_GRPC_LEGACY_PORT_ENABLED:- Default value:
truefor agent versions earlier than 1.310.0 - Default value:
falsefor agent versions 1.310.0 and later
- Default value:
- As an alternative, you can also enable the legacy port with the
configuration.yamlatcom.instana.plugin.opentelemetry -> grpc -> legacy_port_enabled.
For more information, see Legacy OTLP gRPC port .
Fixes
This release includes the following fixes to improve reliability and correctness:
- Previously, process start times changed during agent restarts, which triggered false service alerts. Now, process start times remain stable across agent updates and restarts.
- Previously, deleting
javaagent-loaderJAR file at runtime causedNoClassDefFoundErrorfailures. Now, the agent pins all loader classes at startup to prevent class-loading errors. - Previously, the agent incorrectly excluded JVMs with custom class loaders such as WebLogic's
LaunchClassLoaderfrom attachment. Now, the agent excludes only JVMs with unsupported SAS custom class loaders. - Previously, the agent exposed environment variables that contained secrets in Containerd container information when you use the CRI client. Now, the agent masks secrets properly in all container configuration locations.
Internal updates
These updates contain internal improvements that do not change customer-facing behaviour but ensure long-term stability and readiness for future enhancements:
- InstanaPCP 1.3.79
- agent 1.1.763
- agent-runtime 1.0.17
- agent-runtime-api 1.0.14
Agent 1.2.46
Agent 1.2.46 is released on 20 November 2025 with the tag 2025.11.20.1809.
This agent release updates the following bundles:
- agent 1.1.762: Improved sensor configuration visibility and validation.
- agent-backend 1.0.10: Enhanced data consistency and backend error visibility.
- agent-jvm-handling 1.0.30: Improved JVM attachment reliability in containerized environments.
- agent-process-handling 1.0.35: Enhanced Windows process monitoring stability.
Features
This release adds the following features:
- The agent now validates OSGi bundle start-levels when creating sensor configurations and provides actionable warnings when sensors fail to start due to mode mismatches. These warnings help operators quickly identify and resolve configuration issues.
- Backend connectivity errors are now logged with throttled warnings for HTTP 402 (Payment Required) and HTTP 404 (Not Found) responses, providing better visibility into endpoint access restrictions and configuration issues.
- JVMs running with custom class loaders are now automatically detected and reported through monitoring events in the agent dashboard, providing clear visibility into why dynamic attachment is not supported for these processes.
Fixes
This release includes the following fixes to improve reliability and correctness:
- Previously, sensor payloads from multiple sources (such as legacy and sidecar sensors for IBM MQ) might overwrite each other when arriving simultaneously, causing data inconsistencies. Now, the agent performs deep merging of JSON payloads to preserve all data from both sources.
- Previously, JVM attachment might fail in Podman containers when the
/tmpdirectory was mounted from the host root file system, causing permission errors with OpenJ9 attach files. Now, the agent automatically retries the attachment without user switching when the initial attempt fails, ensuring successful monitoring in these environments. - Previously, on Windows systems, orphaned
InstanaPCP.exeprocesses might remain to run after agent crashes or forced terminations, preventing new instances from starting on agent restart. Now, the agent detects and terminates leftover processes automatically, restoring Windows monitoring capabilities. - Previously, InstanaPCP metrics collection failed after transitioning to flexible process name handling due to inconsistent instance name formats. Now, the agent uses consistent naming formats for all lookups, restoring accurate metrics collection.
- Previously, the pollRate configuration was only sent after the first reset (10 minutes after sensor start), causing gaps in UI graphs during the initial period. Now,
pollRateis sent immediately on the first sense and then on subsequent resets, ensuring continuous graph visualization. - Previously, InstanaPCP processes on Windows did not shut down properly when the Instana Agent Service stopped, leading to multiple parallel instances on restart. Now, InstanaPCP correctly monitors the agent endpoint and terminates when the agent stops, preventing duplicate processes.
Agent 1.2.45
Agent 1.2.45 is released on 12 November 2025 with the tag 2025.11.12.1424.
This agent release updates the following bundles:
- agent-process-handling 1.0.34: Improved stability of CRI-API based process monitoring.
Fixes
This release includes the following fixes to improve reliability and correctness:
- Previously, CRI-API based process handling (used with CRI-O and containerd) might hang or leave background threads active when command output was not fully consumed. This behavior might affect long-term stability. Now, background tasks and I/O resources are properly cleaned up, which can ensure stable and reliable process monitoring for CRI-O and containerd environments.
Internal updates
These updates contain internal improvements that do not change customer-facing behavior but ensure long-term stability and readiness for future enhancements:
- agent-util 1.0.16
Agent 1.2.44
Agent 1.2.44 is released on 10 November 2025 with the tag 2025.11.10.0933.
This agent release updates the following bundles:
- agent-api 1.2.172: Added support for collecting Podman container details without socket access and fine-grained process execution control.
- agent-socket-server 1.0.9: Added configurable HTTP message size limits on Agent endpoint.
- agent-open-telemetry-grpc 1.1.14: Added configurable gRPC message size limits.
- agent-open-telemetry-http 1.1.15: Added configurable HTTP message size limits.
- agent-process-handling 1.0.33: Enhanced Podman monitoring with socket-less container support and improved environment variable handling.
- instana-podman-sensor 1.0.9: Added support for monitoring Podman containers without socket exposure.
Features
This release adds the following features:
- OpenTelemetry base components are now always started by default, even when OpenTelemetry is not explicitly configured, providing better readiness for telemetry collection.
- Podman containers can now be monitored even when no Podman socket is available or when the socket is reported as missing, enabling monitoring in more restrictive environments.
- Message size limits can now be configured for the Agent endpoint (:42699) by using
INSTANA_AGENT_HTTP_MAX_MESSAGE_SIZE(minimum: 5 MB, maximum: 49.5 MB), allowing better control over resource usage. - gRPC message size limits can now be configured by using
INSTANA_AGENT_OTEL_GRPC_MAX_MESSAGE_SIZEor through config keygrpc.max_message_size(minimum: 5 MB, maximum: 49.5 MB), providing flexibility for large telemetry payloads. - HTTP message size limits can now be configured by using
INSTANA_AGENT_OTEL_HTTP_MAX_MESSAGE_SIZEor through config keyhttp.max_message_size(minimum: 5 MB, maximum: 49.5 MB), enabling handling of larger HTTP-based telemetry data. - Fine-grained control is now available for running processes within the context of other processes (for example, inside containers). You can now control how environment variables are inherited and how user context is applied.
- The Agent Support Task now includes Podman socket detection details in its downloadable results, improving troubleshooting capabilities.
- The Agent now validates potential gateway endpoints inside the Podman process network namespace before applying them, ensuring more reliable network configuration.
Fixes
This release includes the following fixes to improve reliability and correctness:
- Previously, evaluation of performance counters and temporary directories was incorrectly bound to the InstanaPCP state (introduced in 1.0.27), causing these checks to fail when InstanaPCP was not active. Now, temp directories are always evaluated, and performance counters are queried on Windows regardless of InstanaPCP state, ensuring consistent system monitoring.
- Previously, additional information requests for user-context containers in rootless Podman monitoring might fail due to shell output contamination. Now, the Agent uses a user session without a login shell to ensure clean stdout output, enabling reliable data collection from rootless Podman containers.
- Previously, environment variables during
java -versionchecks and JVM attachment might interfere with proper operation. Now, a cleaned-up environment is used for these operations, ensuring more reliable JVM detection and attachment.
Internal updates
These updates contain internal improvements that do not change customer-facing behavior but ensure long-term stability and readiness for future enhancements:
- instana-agent-open-telemetry-base 2.2.5
- instana-agent-otel-sensor-sdk 1.1.18
- instana-agent-open-telemetry-service 1.1.13
- agent-util 1.0.15
- agent-jvm-handling 1.0.29
- agent 1.1.761
- agent-backend 1.0.28
- agent-backend-api 1.0.13
- agent-backend-util 1.0.13
- agent-configuration-integration-vault 1.0.11
- agent-grpc 1.0.13
- agent-grpc-channel-cache 1.0.13
- agent-http 1.0.13
- agent-jaeger-tracer 1.0.13
- agent-memory 1.0.13
- agent-netty-allocator 1.0.13
- agent-netty-allocator-api 1.0.13
- agent-process-handling-api 1.0.13
- agent-self-profiling 1.0.13
- agent-sensor 1.0.13
- agent-socket-server-api 1.0.13
- agent-task-orchestrator 1.0.13
- agent-zipkin-tracer 1.0.13
Agent 1.2.43
Agent 1.2.43 is released on 14 October 2025 with the tag 2025.10.14.1548.
This agent release updates the following bundles:
- agent 1.1.760: Fixed sensor heartbeat conversion timing.
- agent-process-handling 1.0.32: Fixed container detection and namespace handling issues.
Fixes
This release includes the following fixes to improve reliability and correctness:
- Previously, sensors with
pollRate1 had a 10-second gap before heartbeats were converted toNO_CHANGEresults, even though they were expected to provide data every second. This delay caused special heartbeat workarounds to malfunction when sensors lagged. Now, the conversion threshold for pollRate 1 sensors is reduced to 3 seconds, which ensures more timely data processing and correct handling of lagging sensors. - Previously, container ID detection could produce false positives in mixed container runtime environments, particularly when CRI-O containers were incorrectly identified by Containerd detection logic. Now, container detection uses explicit validation checks and runtime-specific patterns (including improved Podman libpod scope detection), ensuring accurate container identification across Docker, Containerd, Podman, and CRI-O environments.
- Previously, the agent could not properly interact with processes inside Podman containers, especially rootless ones, due to user namespace differences. This issues caused permission errors and failed operations when attaching to JVMs inside these containers. Now, the agent intelligently detects namespace relationships and uses appropriate mechanisms to join target namespaces, ensuring reliable JVM attachment and monitoring in Podman environments.
Internal updates
These updates contain internal improvements that do not change customer-facing behavior but ensure long-term stability and readiness for future enhancements:
- agent-internal-api 1.0.18
- agent-jvm-handling 1.0.28
- agent-runtime 1.0.16
- agent-runtime-api 1.0.13
Agent 1.2.42
Agent 1.2.42 is released on 6 October 2025 with the tag 2025.10.06.1207.
This agent release updates the following bundles:
- agent-process-handling 1.0.31: Enhanced Podman POD container detection.
Fixes
This release includes the following fixes to improve reliability and correctness:
- Previously, container ID detection for Podman POD containers was incomplete. Now, detection is enhanced to properly identify POD containers, improving container visibility and monitoring accuracy.
Internal updates
These updates contain internal improvements that do not change customer-facing behavior but ensure long-term stability and readiness for future enhancements:
- sensor-api 1.2.170
Agent 1.2.41
Agent 1.2.41 is released on 1 October 2025 with the tag 2025.10.01.1014.
This agent release updates the following bundles:
- agent 1.1.759: The bundle is updated to fix queue parameter usage in `SensorTicker.sendResultChunk`.
- agent-jvm-handling 1.0.27: The bundle is updated to clean up Java environment variables on external attach to prevent out of memory (OOM) errors.
- agent-process-handling 1.0.30: The following changes are added to this bundle:
- Fix container ID detection to exclude conmon processes in container environments.
- Switch process metric collection to a faster and more resource-efficient method, now enabled by default.
- agent-runtime 1.0.15: The bundle is updated to optimize by checking for `/proc` folder only once at startup.
- agent-task-orchestrator 1.0.7: The bundle is updated to optimize DefaultThreadWatcher with Netty HashedWheelTimer to reduce allocations and GC overhead.
- agent-open-telemetry-http 1.1.14: The bundle is updated to remove unnecessary information log for ignored pid lookup.
Features
This release adds the following features:
-
The `agent-process-handling` bundle now enables a **faster and more resource-efficient process metric collection method** on **Windows systems using InstanaPCP**.
Customers benefit from reduced resource usage and improved responsiveness without needing to configure environment variables.
Fixes
- Previously, queue parameter usage in `SensorTicker.sendResultChunk` was incorrect. This could cause inaccurate handling of queued data. This issue is now fixed, ensuring correct and reliable queue management.
- Previously, Java environment variables were not cleaned up on external attach, which could lead to memory leaks and potential OOM errors. This issue is now fixed by cleaning up these variables properly, improving stability during JVM attachment.
- Previously, container ID detection incorrectly included conmon processes in container environments. This could result in misleading container attribution. This issue is now fixed by excluding conmon processes, ensuring accurate container detection.
- Previously, the agent checked for the `/proc` folder multiple times during startup, adding unnecessary overhead. This issue is now fixed by checking only once, reducing startup time, and improving efficiency.
- Previously, DefaultThreadWatcher had higher memory allocations and GC overhead. This issue is now fixed by using Netty HashedWheelTimer, reducing memory footprint and improving performance under load.
- Previously, unnecessary info logs were generated for ignored pid lookup in the OpenTelemetry HTTP component. This issue is now fixed by removing these logs, resulting in cleaner logs and less noise.
Agent 1.2.40
Agent 1.2.40 is released on 18 September 2025 with the tag 2025.09.18.1913.
This agent release updates the following bundles:
- agent 1.1.758: Added a new option for handling configuration file changes.
- agent-process-handling 1.0.29: The following changes are added to this bundle:
- Reduced memory usage in the process abstraction by optimizing checks for
/procpresence. - Improved process startup time detection on AIX by using SIGAR.
- Reduced memory usage in the process abstraction by optimizing checks for
- agent-runtime 1.0.14: Added detection support for the presence of
/procin Linux paths. - agent-runtime-api 1.0.12: Exposes whether
/procis accessible through its API.
Features
This release adds the following features:
- The
agentbundle introduces a new configuration option to control how configuration file changes are detected. You can enable with the environment variableINSTANA_WATCH_CONFIG_CHANGES_WITH_HASH_POLLER(default:false; set totrueto use hash-based polling instead of inotify). - The
agent-runtimeandagent-runtime-apibundles improve Linux process detection:- The runtime now detects if
/procis present in Linux paths. - The API now exposes this information through the
isProcPresentmethod.
- The runtime now detects if
Fixes
- Previously, the process abstraction consumed more memory when it was checking for
/procpresence. This issue is now fixed by optimizing these checks. - Previously, process startup time detection on AIX was less accurate. This issue is now fixed by using SIGAR for the detection.
Agent 1.2.39
Agent 1.2.39 is released on 17 September 2025 with the tag 2025.09.17.0855.
This agent release updates the following bundles:
- agent-init 1.0.8: Enabled direct memory usage by default on AIX.
- agent 1.1.757: Improved
psprobing, so that parent process information is always available. - agent-jvm-handling 1.0.26: Updated support for JVM attachment inside Podman containers by using
switchUser. - agent-netty-allocator 1.0.2: Improved logging when direct memory is disabled.
- agent-process-handling 1.0.28: Updated support for
switchUserin Podman processes that usensenter. - netty 4.1.125: Updated to resolve a security issue in the HTTP codec.
Features
This release adds the following features:
- The
agent-initbundle enables direct memory usage on AIX systems by default. This can be turned off with the environment variableINSTANA_AIX_NETTY_SET_UNSAFE(default:false; set totrueto disable direct memory).
Fixes
- Previously, the
AgentSupportTaskthat executespsmight omit the parent process ID (PPID) in some cases. This issue is now fixed by probing the availablepsoptions on startup and selecting one that reliably includes the PPID and, when possible, the process tree. - Previously, the
agent-jvm-handlingbundle might not attach to JVMs running inside Podman containers. This issue is now fixed by usingswitchUserduring the attached operation. - Previously, the
agent-netty-allocatorbundle lacked visibility when direct memory was disabled. This issue is now fixed by adding an information-level log to indicate the state. - Previously, the
agent-process-handlingbundle did not correctly applyswitchUserin Podman processes that rely onnsenter. This issue is now fixed by implementingswitchUserwith the--setuidand--setgidso user changes are properly applied during execution. - A vulnerability existed in the
nettybundle’s HTTP codec (CVE-2025-58056). This issue is now fixed by updating to a patched version.
Agent 1.2.38
Agent 1.2.38 is released on 10 September 2025 with the tag 2025.09.10.1939.
This agent release updates the following bundles:
- agent-backend 1.0.8: The following changes are added to this bundle:
- Added support for configuring the backend read timeout.
- Improved connection handling by delaying idle state checks until after TLS is established.
Features
This release adds the following features:
- The
agent-backendbundle now supports configurable backend read timeouts with the environment variableINSTANA_BACKEND_READ_TIMEOUT_SECONDS(default: 10; values below10are ignored).
Fixes
- Previously, connections might reconnect too early during TLS handshakes. This is now prevented by initializing the idle state handler only after the SSL connection is fully established.
Agent 1.2.37
Agent 1.2.37 is released on 10 September 2025 with the tag 2025.09.10.1127.
This agent release updates the following bundles:
- sensor-api 1.2.169: The following improvements were added to process output handling:
- Introduced a builder pattern for creating
OsProcessOutputwith configurable options. - Added configurable queue capacity and batch size in
StreamingOsProcessOutput. - Added a reliable
onClosecallback forStreamingOsProcessOutput.
- Introduced a builder pattern for creating
- agent 1.1.756: Improved logging for network binding operations.
- agent-cri-client 1.0.6: Now captures both
imageIdandimageReffrom container status. - agent-jvm-handling 1.0.25: The following internal refactorings were applied:
- Updated to use
MavenArtifactinstead ofAbstractMavenArtifact. - Now depends on the
AbstractMavenArtifactAPI fromsensor-api. - Removed the obsolete
ByteBuddyToolsJar.java.
- Updated to use
- agent-process-handling 1.0.27: The following enhancements were added:
- Added information-level logging for network interface binding.
- Improved container ID detection for CRI-containerd format.
- Better IP address resolution for Rootless Podman containers.
- Improved process monitoring decision tracking with the
AgentSupportTask. - Reworked Windows service watcher with improved lifecycle management.
- agent-util 1.0.14: The following changes were added:
- Deprecated
AbstractMavenArtifactin favor of the API version. - Added an overload of
getNestedValuereturningnullif path not found. - Introduced a more flexible optional chain builder in
ValueFinder.
- Deprecated
- agent-open-telemetry-service 1.1.12: Optimized the handling of attributes through automatic sorting.
- agent-open-telemetry-grpc 1.1.13: Updated to allow disabling PID lookup with the configuration or environment variable.
- agent-open-telemetry-http 1.1.13: Updated to allow disabling PID lookup with the configuration or environment variable.
Features
This release adds the following features:
- The
sensor-apibundle provides several enhancements to process output handling:- Introduces a builder pattern for
OsProcessOutputwith configurable options. - Adds configurable queue capacity and batch size in
StreamingOsProcessOutput. - Provides a reliable
onClosecallback forStreamingOsProcessOutput.
- Introduces a builder pattern for
- The
agentbundle now logs more details about network binding operations, improving troubleshooting of binding issues. - The
agent-cri-clientbundle now collects bothimageIdandimageRefwhen it inspects container status, and this provides complete image metadata. - The
agent-jvm-handlingbundle is refactored with the following changes:- Migrated from
AbstractMavenArtifactto the newMavenArtifactAPI. - Now uses
AbstractMavenArtifactfromsensor-apiinstead of its own copy. - Removed the obsolete
ByteBuddyToolsJar.javafile.
- Migrated from
- The
agent-process-handlingbundle improves observability and container support:- Logs information during network interface binding.
- Enhances container ID detection for CRI-containerd format.
- Improves IP resolution in Rootless Podman environments.
- Tracks process monitoring decisions more transparently with the
AgentSupportTask. - Provides more reliable lifecycle handling for Windows services.
- The
agent-utilbundle provides several enhancements:- A new overload of
getNestedValuethat returnsnullif a path is not found. - A conditional optional chain builder added to
ValueFinderfor more advanced value resolution logic. - The
AbstractMavenArtifactclass is now deprecated in favor of the API version.
- A new overload of
- The
agent-open-telemetry-servicebundle now sorts attributes automatically by using aTreeMap, which improves performance and consistency of attribute handling. - The
agent-open-telemetry-grpcandagent-open-telemetry-httpbundles now make PID lookup configurable. PID lookup is enabled by default, but it can be disabled with the environment variableINSTANA_AGENT_OTEL_GRPC_PID_LOOKUP(default:true; set tofalseto disable) orINSTANA_AGENT_OTEL_HTTP_PID_LOOKUP(default:true; set tofalseto disable). As an alternative, PID lookup can also be disabled with theconfiguration.yamlat:-
com.instana.plugin.opentelemetry -> grpc -> pid_lookup. -
com.instana.plugin.opentelemetry -> http -> pid_lookup.
-
Agent 1.2.36
Agent 1.2.36 is released on 22 August 2025 with the tag 2025.08.22.0942.
This agent release updates the following bundles:
- agent-process-handling 1.0.26: The bundle is updated to add the missing socket to CRI-API-based process execution within ContainerD containers.
Fixes
- Previously, CRI-API-based process execution inside ContainerD containers failed because a required socket was missing. This issue is now fixed by adding the missing socket.
Agent 1.2.35
Agent 1.2.35 is released on 20 August 2025 with the tag 2025.08.20.1226.
This agent release updates the following bundles:
- sensor-api 1.2.168: The bundle is updated to handle null for sense result as heartbeat.
- agent 1.1.755: The following changes are added to this bundle:
- Internal logic is removed from
DefaultNetworkInterfaceSupportto use theBindAddressProviderinstead of providing the list of bindable interfaces internally. - Annotation based logging is updated to use bundle aware loggers instead of
agent-util.
- Internal logic is removed from
- agent-api 1.0.6: The bundle is updated to add
BindAddressProviderinterface that returns a list of bindable interfaces. - agent-cgroup 1.0.7: The bundle is updated to use bundle aware loggers instead of
agent-util. - agent-cri-client 1.0.5: The bundle is updated to check the default containerD socket
/run/containerd/containerd.sockon startup. - agent-grpc-channel-cache 1.0.3: The bundle is updated to use bundle aware loggers instead of
agent-util. - agent-internal-api 1.0.17: The bundle is updated to extend
ProcessInterestHandlerwith a new method to register an interest for a given interface bound to a process. - agent-jvm-handling 1.0.24: The following changes are added to this bundle:
- Identify
jstart.exeas a potential JVM. - Annotation based logging is updated to use bundle aware loggers instead of
agent-util.
- Identify
- agent-process-handling 1.0.25: The following changes are added to this bundle:
- Foreign PID timeout is extended to 2 seconds.
- A
nflag is added for foreign PID lookup to mitigate resolving DNS entries. - The
criClientis used for containerD when the agent runs in a POD, or if enabled through an environment variable. - Podman host interface detection is improved.
- Multiple new
BindAddressProviderimplementations are added. - Annotation based logging is updated to use bundle aware loggers instead of
agent-util.
- agent-runtime 1.0.13: The bundle is updated to use bundle aware loggers instead of
agent-util. - agent-support-karaf 1.0.1: The bundle is updated to use bundle aware loggers instead of
agent-util. - agent-task-orchestrator 1.0.6: The bundle is updated to use bundle aware loggers instead of
agent-util. - agent-util 1.0.13: The bundle is updated to use bundle aware loggers instead of
agent-util. - agent-open-telemetry-base 2.2.5: The bundle is updated to use
cluster.uidasentityIdif it is present in the attributes list. - agent-open-telemetry-grpc 1.1.12: The following changes are added to this bundle:
- Allow disabling PID lookup through an environment variable.
- Annotation based logging is updated to use bundle aware loggers instead of
agent-util.
- agent-open-telemetry-http 1.1.12: The following changes are added to this bundle:
- Allow disabling PID lookup through an environment variable.
- Annotation based logging is updated to use bundle aware loggers instead of
agent-util.
Features
This release adds the following features:
- The
sensor-apibundle now supports handling null for sense results as heartbeats. - The
agent-apibundle introduces theBindAddressProviderinterface to return a list of bindable interfaces. - The
agent-cri-clientnow checks the default containerD socket/run/containerd/containerd.sockduring startup. - The
agent-internal-apiextends theProcessInterestHandlerwith registration support for interfaces bound to a process. - The
agent-process-handlingbundle extends the foreign PID timeout to 2 seconds and adds thenflag to mitigate DNS resolution issues. - The
agent-process-handlingbundle now supports containerD through the CRI client. You can enable or disable this behavior with the environment variableINSTANA_USE_CONTAINERD_CRI_CLIENT(default:truewhen running in a POD). - The
agent-process-handlingbundle introduces multiple newBindAddressProviderimplementations:-
AgentPublicIpBindAddressProvider: exposes the agent’s public IP as a bindable interface. -
ContainerBridgeBindAddressProvider: exposes container bridge networks as bindable interfaces. -
ProcessInterestBindAddressProvider: exposes process-specific network interests as bindable interfaces.
-
- The
agent-open-telemetry-grpcbundle now allows disabling PID lookup with the environment variableINSTANA_AGENT_OTEL_GRPC_PID_LOOKUP(default istrue, set tofalseto disable). - The
agent-open-telemetry-httpbundle now allows disabling PID lookup with the environment variableINSTANA_AGENT_OTEL_HTTP_PID_LOOKUP(default istrue, set tofalseto disable).
Fixes
- Previously, annotation based logging used the generic
agent-utillogger. This issue is now fixed by updating all affected bundles (agent,agent-cgroup,agent-grpc-channel-cache,agent-jvm-handling,agent-process-handling,agent-runtime,agent-support-karaf,agent-task-orchestrator,agent-util,agent-open-telemetry-grpc,agent-open-telemetry-http) to use bundle aware loggers instead. - Previously, foreign PID lookup would fail due to too short timeouts or DNS resolution. This issue is now fixed by extending the timeout and adding the
nflag to mitigate DNS resolution. - Previously, podman containers would fail to resolve host interfaces. This issue is now fixed by using
host.containers.internalas a reliable host interface target.
Agent 1.2.34
Agent 1.2.34 is released on 4 August 2025 with the tag 2025.08.04.0607.
This agent release updates the following bundles:
- sensor-api 1.2.167: The bundle is updated to allow global access to RSS count in the cgroup data.
- agent 1.1.754: The bundle is updated to improve the handling of Metadata API responses.
- agent-cgroup 1.0.6: The bundle is updated to correctly handle memory cache and RSS calculation for cgroups.
- agent-jvm-handling 1.0.23: The bundle is updated to support Java 25 for tracing.
- agent-process-handling 1.0.23: The following changes are added to this bundle:
- The bundle is updated to support custom RKE2 paths.
- A new service is added to traverse parent process lookups.
- agent-process-handling 1.0.24: The bundle is updated to add loop detection to parent process lookups.
- agent-socket-server 1.0.8: The following changes are added to this bundle:
- Callback to parent channels is added.
- Thread naming is improved for better diagnostics.
- agent-socket-server-api 1.0.5: The bundle is updated to add a callback to parent channels.
- agent-open-telemetry-service 1.1.11: The bundle is updated to reduce Object to String allocation only to debug logging case.
- agent-open-telemetry-http 1.1.11: The following changes are added to this bundle:
- The connection tracking logic is added to the parent handler.
- The PID lookup is added to the parent handler before the channel is initialized.
- The number of maximum channels can be limited.
Features
This release adds the following features:
- The cgroup parser now exposes RSS data with
total_rssforcgroupv1andanonforcgroupv2. - The
agent-jvm-handlingbundle now supports Java 25 tracing with upgradedjavaagent-loader(1.3.71),instrumentation-boot(1.1.32), andinstrumentation-shared(1.0.1467). - A service is added to traverse parent processes. This service is used on various container implementations to identify the type or containerId.
- The OpenTelemetry HTTP component now allows to configure a maximum number of concurrent active channels with the environment variable
INSTANA_AGENT_OTEL_HTTP_MAX_CHANNELS(default value is 1000).
Fixes
- Previously, the parser for the Metadata API did not check for error strings. This issue is now fixed by checking for error responses and limiting allowed strings for the
UniqueIdof the agent. - Previously, the parent process lookup might lead to an
OutOfMemoryerror when the processes did not end with 0. This issue is now fixed by tracking already visited process IDs and stopping when a loop is detected. - Previously, the OpenTelemetry HTTP component caused an
OutOfMemoryerror when too many incoming requests reached the agent. This issue is now fixed by limiting the number of concurrently active channels. In addition, the expensive PID lookup is moved into the parent handler.
Agent 1.2.33
Agent 1.2.33 is released on 11 July 2025 with the tag 2025.07.11.0837.
This agent release updates the following bundles:
- agent-process-handling 1.0.21:
sshdprocess monitoring is fixed after 1.2.32 release.
Fixes
- Previously, the
sshdprocess was only added to the internal list when it ended withsshd, which is not correct for newer RHEL environments. This issue is now fixed by checking how oftensshdoccurs in the executable and allowing when more than 1 occurrence is counted.
Agent 1.2.32
Agent 1.2.32 is released on 9 July 2025 with the tag 2025.07.09.0858.
This agent release updates the following bundles:
- agent 1.1.753: Monitoring issue
pax_url_mvn_leakis added to this bundle. - agent-netty-allocator 1.0.1: The following changes are added to this bundle:
- Per-channel backoff-guarded allocator with shared counters and backoff configuration are added.
- A
DefaultFlowControlManageris added to track per-channel "permits" and pauseautoReadwhen buffer-in-flight count exceeds max concurrency.
- agent-netty-allocator-api 1.0.1: The service is extended with per-channel allocators.
- agent-process-handling 1.0.21:
sshdprocess monitoring is relaxed. - agent-runtime 1.0.12: The bundle is extended to read
doubleconfiguration values. - agent-runtime-api 1.0.11: The bundle is extended to read
doubleconfiguration values. - agent-socket-server 1.0.7: The bundle is extended to use the new flow control manager to limit concurrent reads.
Features
This release adds the following features:
- A service is added to control maximum number of concurrent reads. You can control the concurrency by using the
INSTANA_INGRESS_CONCURRENCYenvironment variable (default value is 4). - You can fine-tune the Netty ingress with the following environment variables:
-
INSTANA_NETTY_INBOUND_FACTOR(default value is 0.6): A value between 0 and 1, controls the percentage of direct memory that can be used for inbound. -
INSTANA_NETTY_OUTBOUND_FACTOR(default value is 0.9): A value between 0 and 1, controls the percentage of direct memory that can be used for outbound, the outbound factor is always more than the inbound factor. -
INSTANA_NETTY_INBOUND_SOFT_FACTOR(default value is 0.8): A value between 0 and 1, controls the percentage of direct memory that is used for a soft-backoff. -
INSTANA_NETTY_SOFT_TIMEOUT_SECONDS(default value is 2): A value between 0 and unlimited, controls the seconds used for the soft-backoff after which memory is always granted. -
INSTANA_NETTY_DIRECT_MEMORY_TIMEOUT_SECONDS(default value is 30): A value between 0 and unlimited, controls the seconds used for the hard-backoff after which an exception is thrown and the current message is dropped.
-
- The service to read configuration values can read values of type
double.
Fixes
- Previously, a leak in the
pax-urlcomponent causedOutOfMemoryerrors. Now, if this issue is detected, Instana displays a monitoring issue pax_url_mvn_leak. You can fix this issue by reinstalling the agent. - Previously, incoming ingress might starve the egress to the backend. This issue is now fixed by limiting the concurrent streams that are read concurrently to 4. In addition, the ingress also handles back-pressure by slowing down incoming data when the egress is not able to offload fast enough.
- Previously, the
sshdprocess was only allowed when it is at the default location/usr/sbin/sshd. This issue is now fixed by relaxing the lookup to check if the process ends withsshd.
Agent 1.2.31
Agent 1.2.31 is released on 30 June 2025 with the tag 2025.06.30.1540.
This agent release updates the following bundles:
- agent-process-handling 1.0.20: An end reason is added for in-container process ID lookup. Also, a retry is added when
/statusfile content is empty. - agent-runtime 1.0.11: The service is now extended to provide Exponential Backoff handlers with an end reason.
- agent-runtime-api 1.0.10: The service is now extended to provide Exponential Backoff handlers with an end reason.
Features
This release adds the following features:
- The service to handle exponential backoff now keeps track of the end reason when it is marked as done.
Fixes
- Previously, a race condition occurred when reading the
/statusfile, which resulted in the failure to read the in-container PID. This issue is now fixed and the agent retries reading the/statusfile when the content is empty. The success and error cases are added to the Collect Support Information.
Agent 1.2.30
Agent 1.2.30 is released on 24 June 2025 with the tag 2025.06.24.0957.
This agent release updates the following bundles:
- agent-jvm-handling 1.0.22: A monitor is added to all known temporary directories on Windows.
- agent-process-handling 1.0.19: A backoff strategy for in-container PIDs is added, and related information is reported in the Collect Support Information on the agent dashboard.
- agent-runtime 1.0.10: A service is implemented to provide Exponential Backoff handlers.
- agent-runtime-api 1.0.9: A service is implemented to provide Exponential Backoff handlers.
Features
This release adds the following features:
- A service is added that allows for exponential backoff.
Fixes
- Previously, when a Java process stopped without a clean shutdown, files that are related to Java sensors accumulated on the user's temporary directories. This issue is now fixed by checking all known temporary directories on Windows for Java sensor files and deleting them if the Java process is stopped.
- Previously, a
NullPointerExceptionerror occurred when comparing the PID with the reported PID in announce messages that are sent by tracers. This issue is now fixed. The agent always checks for null values before comparing. In addition, a backoff strategy is added to lookup the in container PID by using/statusor/schedfiles. The number of tries and the current state of the lookup for in-container PIDs are added to the Collect Support Information.
Agent 1.2.29
Agent 1.2.29 is released on 17 June 2025 with the tag 2025.06.17.1503.
This agent release updates the following bundles:
- sensor-api 1.2.166: The following changes are included in this release:
- A service is added to lookup the default temp directory of the agent.
- A service is added to compress data to be forwarded to the backend.
- Process information is extended with reported PID and process type.
- Direct usage of Sigar is deprecated, and usage is allowed only through helpers.
- agent 1.1.752: A fallback is added to configuration changes with manual checks if
inotifyhandles are exhausted. - agent-cgroup 1.0.5: The lookup speed is enhanced by checking the known type of a process.
- agent-jvm-handling 1.0.21: The following changes are included in this release:
- The lookup speed is enhanced by checking the known type of a process.
-
javaagent‑loaderis updated to version 1.3.70. Log level is now reduced toINFOwhen the permission update for/tmp/.instanafails. Also, the folder lookup is enhanced on J9-based attachments when/tmp/.com_ibm_tools_attachis reachable instead of/proc/<pid>/tmp/.com_ibm_tools_attach.
- agent-process-handling 1.0.18: The following changes are included in this release:
- The lookup speed is enhanced by checking the known type of a process.
- The reported PID is now exposed for container and host processes as seen from the process.
- PID is now validated as part of announce messages from tracers.
- Files can be now copied into folders within rootless Podman containers.
- The direct access to Sigar is now removed. A wait is added for Sigar to block access before the shutdown.
- agent-process-handling-api 1.0.5: The internal service for Process Type is deprecated because it was moved to the sensor API.
- agent-runtime 1.0.9: A service is implemented for files and file access for easier testing.
- agent-runtime-api 1.0.8: A service is implemented for files and file access for easier testing.
Features
This release adds the following features:
- Processes now report their PID as seen from the process. This information can differ between processes that run on on host and in container because the PID namespace is different.
Fixes
- Previously, if
inotifyhandles were exhausted, configuration files were not watched. This issue is now fixed by reading the metadata of the configuration files at regular intervals and updating the configuration if the metadata has changed. - Previously, multiple processes were checked dueing the announcement of tracers. This issue is now fixed by limiting the process list to include only the processes that have the same reported PID.
- Previously, the
javaagent-loaderlogged changes to the/tmp/.instanaalways on WARN level. This issue is now fixed by only logging on WARN if the rights of the folder do not match the expected level. - Previously, the
javaagent-loaderfailed to attach to J9 JVMs when the/proc/<pid>/tmp/.com_ibm_tools_attachwas not reachable. This issue is now fixed by checking if the folder/tmp/.com_ibm_tools_attachis reachable. - Previously, when you copied files into a folder within a rootless Podman container, a file with a random name was created. This issue is now fixed by copying the file into an intermediate folder on
/tmpon the host first and keeping the original name.
Agent 1.2.28
Agent 1.2.28 is released on 4 June 2025 with the tag 2025.06.04.1414.
This agent release updates the following bundles:
- agent 1.1.751: Implemented service to view configuration file changes.
- agent-internal-api 1.0.16: Added service to view configuration file changes.
- agent-process-handling 1.0.16: The following changes are included in this release:
- Cache container metadata by default
- InstanaPCP is updated to 1.3.74: Removes setting
INSTANA_LOG_LEVELenvironment variable - Added ability to ignore non-container cgroups
- Used a known socket for ContainerD information lookup
- Extended selective monitoring to use Kubernetes namespaces
Features
This release adds the following features:
- Selective monitoring now supports Kubernetes namespaces when
NAMESPACES_DETAILS_PATHis present. The Operator sets this environment variable that contains the location to a yaml file.- When the environment variable is set, the agent caches content for each namespace by using the
instana-workload-monitoringlabel. - The following values are evaluated:
<absent>,true,false,apm, andinfra. - If
INSTANA_SELECTIVE_MONITORINGis set toDEFAULTor has an empty value, the agent operates in normal mode. All namespaces withinstana-workload-monitoring=falseare ignored. - If
INSTANA_SELECTIVE_MONITORINGis set toOPT_IN, the agent operates in the selective monitoring mode. The agent monitors only the processes that are in a namespace, which haveinstana-workload-monitoring=true,instana-workload-monitoring=apm, orinstana-workload-monitoring=infra. All processes withinstana-workload-monitoring=falseare ignored.
- When the environment variable is set, the agent caches content for each namespace by using the
- An internal service is added to monitor configuration file changes and notify if there is a change. This service uses the scheduler to reduce the overall thread count.
Fixes
- Previously, only successful container metadata was cached. This issue is now fixed, and also a failure to look up container metadata is cached.
- Previously, cgroups, such as
/init.scopeand/mde, were identified as potential containers. This issue is now fixed after adding a table of known non-container cgroup names. - Previously, ContainerD lookup failed when multiple sockets were present on the host. This issue is now fixed by using the socket that is assigned to the ContainerD process.
Agent 1.2.27
Agent 1.2.27 is released on 22 May 2025 with the tag 2025.05.22.1008.
This agent release updates the following bundles:
- agent 1.1.750: Detects non-UTF-8 characters in the
configuration.yamlfile. - agent-cgroup 1.0.4: Checks for running processes on cgroup data lookup.
- agent-jvm-handling 1.0.20: Ignores db2fmp process.
- agent-process-handling 1.0.15: Prepares Kubernetes labels cache.
- agent-util 1.0.12: Adds helper to detect non UTF-8 characters.
- agent-open-telemetry-grpc 1.1.11: ExecutionPipeline for OTel gRPC traces.
- agent-open-telemetry-http 1.1.10: Optimizes http pipeline.
Features
This release adds the following features:
- Caching Kubernetes labels for the following container types to support selective monitoring: ContainerD, CRI-O, Docker, and Podman
- Counting tasks for OTel gRPC by using the
ExecutionPipeline
Fixes
- Previously, the system might fail reading the
configuration.yamlfile if the file contained non-UTF-8 characters. This issue is now fixed by checking for non-UTF-8 characters. - Previously, the system might display incorrect data while reading cgroup data for container metrics. This issue is now fixed by checking if any process is still active for this cgroup.
- Previously, OTel HTTP connections were cached forever. This issue is now fixed by removing closed connections from the internal cache.
- Previously, OTel HTTP connections might overload the thread pool. This issue is now fixed by only evaluating open connections.
Agent 1.2.26
Agent 1.2.26 is released on 15 May 2025 with the tag 2025.05.15.0358.
This agent release updates the following bundles:
- agent 1.1.749: OpenTelemetry HTTP and gRPC components are enabled through the environment.
- agent-backend 1.0.7: Configurable deflate level for backend communication is added.
- agent-jvm-handling 1.0.19: Timing of log-level synchronization is adjusted.
- agent-runtime 1.0.8: The environment lookup methods for Integer and Boolean is now exposed.
- agent-runtime-api 1.0.7: Matching API methods for environment lookups is added.
- agent-socket-server 1.0.6:
ExecutionPipelineis adopted for connections and HTTP. - agent-task-orchestrator 1.0.5:
ThreadWatcheris introduced for stuck-thread monitoring. - agent-task-orchestrator-api 1.0.2:
ThreadWatcherandExecutionPipelinetask wrappers are added. - agent-util 1.0.11: Nested-config lookup and exception-aware
callableandrunnabletypes are added. - agent-open-telemetry-base 2.2.4: Support for span-links is added.
- agent-open-telemetry-service 1.1.8: Support for span-links is added.
- agent-open-telemetry-grpc 1.1.10:
ExecutionPipelinefor OTel gRPC and configurable port are added. - agent-open-telemetry-http 1.1.9:
ExecutionPipelinefor OTel HTTP and configurable port are added.
Features
This release adds the following features:
- You can now enable OpenTelemetry HTTP and gRPC components by using the
INSTANA_AGENT_OTEL_HTTPandINSTANA_AGENT_OTEL_GRPCenvironment variables (default value is null). - You can now configure default deflate level (0–9) by using
INSTANA_BACKEND_DEFLATE_LEVELvariable (default value is null). - Integer and Boolean settings (with null fallback) are now fetched from the agent environment through the new runtime and runtime-api methods.
- The agent now uses
ExecutionPipelinefor both JVM connections and HTTP endpoint handling in the socket-server. - The new built-in helper
ThreadWatchermonitors stuck threads. (default is 60 s. You can configure this by using the environment variableINSTANA_THREAD_WATCHER_TIMEOUT_SECONDS). - Tasks are now wrapped with pre/post hooks, thread-watching, pool statistics, and task monitoring by using the orchestrator-API interfaces.
- The agent now looks up nested configuration values and returns checked exceptions in
callablesandrunnablesby using the new helpers in theutilbundle. - Span-links support is added for both OpenTelemetry base and service bundles.
- OTel gRPC and HTTP components now support stuck-thread detection and task counting by using
ExecutionPipeline. You can override their default ports either by usingINSTANA_AGENT_OTEL_GRPC_PORTandINSTANA_AGENT_OTEL_HTTP_PORTenvironment variables (default value is null) or by modifying theconfiguration.yamlfile. For more information, see OpenTelemetry configuration
Fixes
- Previously, log-level synchronization with JVMs began immediately, which resulted in race conditions in internal test validation. This issue is now fixed by delaying the log-level sync start by one minute.
Agent 1.2.25
Agent 1.2.25 is released on 06 May 2025 with the tag 2025.05.06.1431.
This agent release adds the following bundles:
- agent-netty-allocator-api 1.0.0: This bundle adds a service to provide a global ByteBuffer allocator that enables a timeout-based lookup.
- agent-netty-allocator 1.0.0: This bundle implements a service to provide a global ByteBuffer allocator that provides a timeout-based lookup.
This agent release updates the following bundles:
- agent-backend 1.0.6: The bundle now uses the global timeout-based allocator to ensure that data is reported to the backend.
- agent-jvm-handling 1.0.18: The following changes are added to this bundle:
-
javaagent‑loaderis updated to version 1.3.69. The in-memory ClassLoader correctly frees up the internal state when it i restarted. Thejavaagent-loaderpreloadsManagementFactoryto prevent startup delays.
-
- agent-socket-server 1.0.5: The following changes are added to this bundle:
- The bundle is updated to use the global allocator for ByteBuffers.
- The bundle now restricts the internal usage of a single ChannelInitializer.
Fixes
- Previously, when you reloaded the in-memory ClassLoader, the stored classes were removed, which resulted in missing definitions after reloading a sensor. This issue is now fixed by preserving the class-holding data structure in a global in-memory representation.
- Previously, when a Spring-Boot Java agent was started, the
javaagent-loaderthread was blocked ifManagementFactorywas not initialized. This issue is now fixed by preloading a defaultManagementFactorybefore starting any sensor agents in thejavaagent-loader. - Previously, when a backend connection was reset, the direct-memory guards were left in an inconsistent, non-thread-safe state, which caused the threads forwarding metrics or traces to hang. This issue is now fixed by introducing the globally shared ByteBuffer allocator with built-in timeouts.
Agent 1.2.24
Agent 1.2.24 is released on 29 April 2025 with the tag 2025.04.29.1622.
This agent release updates the following bundles:
- agent-jvm-handling 1.0.17: The following changes are added to this bundle:
-
javaagent‑loaderis updated updated to version 1.3.68. The in‑memory ClassLoader is now disabled when maximum heap is lesser than the threshold value that you configured and falls back to file‑based attachment. - The agent now suppresses
kill -3call on Windows systems.
-
Features
- You can now configure a minimum heap threshold for the in‑memory classloader by using the
INSTANA_AGENT_LOADER_MIN_IN_MEMORY_HEAP_MEGABYTESenvironment variable (default value is 100 MB), which is enabled by the the upgradedjavaagent‑loader1.3.68. Make sure that you set the environment variable in the target JVM.
Fixes
- Previously, when you used the in‑memory ClassLoader on JVMs with limited heap, OutOfMemory errors occurred. This issue is now fixed by disabling the in‑memory ClassLoader when maximum heap is below the configured threshold (100 MB by default) and falling back to file‑based attachment.
- Previously, the agent issued a Unix-specific command
kill -3, which failed on Windows systems. This issue is now fixed by suppressing thekill -3call on Windows systems.
Agent 1.2.23
Agent 1.2.23 is released on 23 April 2025 with the tag 2025.04.23.1020.
This agent release updates the following bundles:
- agent 1.1.748: The following changes are added to this bundle:
- The sensitive data in the
pstask is now hidden when support information is collected. - The leading slash from the Support Information zip archive is now removed.
- The sensitive data in the
- agent-jvm-handling 1.0.16: The following changes are added to this bundle:
- Support for Java 24 is added for tracing.
- The detection of J9 JVMs with custom Java executables or attach directories is now improved.
- The bundle is updated to suppress Byte Buddy–based attachment on Unix systems if
/tmpis mounted withnoexec.
- agent-process-handling 1.0.14: The bundle now checks containers for null metadata and returns an empty map instead of parsing invalid data.
- agent-runtime-api 1.0.6: The following changes are added to this bundle:
- The bundle is updated to expose a service to load any class at runtime.
- The bundle is updated to expose a service to inspect mount options on Unix-based systems.
- agent-runtime 1.0.7: The following changes are added to this bundle:
- The bundle is updated to implement the “load any class” service.
- The bundle is updated to implement the mount-options inspection service for Unix.
- agent-socket-server-api 1.0.4: The bundle is updated to expose a service to start and stop Netty-based socket servers.
- agent-socket-server 1.0.4: The bundle is updated to implement the Netty socket-server start and stop service.
- agent-task-orchestrator 1.0.4: The Scheduler is now exposed as a prototype so that each consumer gets its own instance, while threads remain shared globally.
- sensor-api 1.2.163: The following changes are added to this bundle:
- A Streaming Process Output helper is added.
- A JVM job-name lookup support is added for IBM i.
- agent-open-telemetry-grpc 1.1.7: The socket-server API service is now used to start and stop the OTel gRPC socket server.
- agent-open-telemetry-http 1.1.6: The socket-server API service is now used to start and stop the OTel HTTP socket server.
- agent-ibmi-handler 1.0.2: The bundle is updated to fetch the full job name on IBM i when only a PID was shown previously.
Features
This release adds the following features:
- The
agent-jvm-handlingbundle now supports Java 24 tracing with upgradedjavaagent-loader(1.3.67),instrumentation-boot(1.1.31), andinstrumentation-shared(1.0.146). - A new runtime service is added to inspect mount options on Unix-based systems.
- A dedicated socket-server API service is now available to start and stop Netty-based socket servers.
- The task-orchestrator’s Scheduler is now provided as a prototype, giving each consumer its own instance while using a shared global thread pool.
- The sensor API now includes a Streaming Process Output helper and JVM job-name lookup on IBM i.
Fixes
This release fixes the following issues:
- Previously, sensitive fields could be exposed in the output of the process-listing (
ps) task and included in support bundles. This issue is now fixed by hiding all sensitive data during support information collection. - Previously, Support Information ZIP archives included a leading slash, which prevented file extraction on Windows. This issue is now fixed by removing the leading slash.
- Previously, determining which JVMs to ignore could enter an infinite loop when following parent-process chains. This issue is now fixed by breaking the circular lookup loop.
- Previously, applications running on J9 JVMs with custom executables or attach directories were not detected correctly. This issue is now fixed by enhancing the J9 detection logic to recognize custom paths.
- Previously, Byte Buddy attachments would fail on Unix hosts with
/tmpmountednoexec, causing tracing setup to break. This issue is now fixed by detectingnoexecon/tmpand falling back to JDK-based attachment. - Previously, if container metadata was null, the agent attempted to parse invalid data and returned errors. This issue is now fixed by checking for null metadata and returning an empty map instead of parsing invalid data.
- Previously, all consumers of the Scheduler shared a single instance, which resulted in new tasks being blocked when one consumer stopped. This issue is now fixed by exposing the Scheduler as a prototype so that each consumer gets its own instance.
- Previously, shutting down the Otel gRPC socket server could hit a race condition that blocked termination indefinitely. This issue is now fixed by using the new socket-server API service to coordinate the shutdown, which ensures a stable, deadlock-free termination.
- Previously, shutting down the Otel HTTP socket server could hit a race condition that blocked termination indefinitely. This issue is now fixed by using the new socket-server API service to coordinate the shutdown, which ensures a stable, deadlock-free termination.
- Previously on IBM i, only the numeric process ID was shown instead of the full job name. This issue is now fixed by fetching and displaying the complete job name.
Agent 1.2.22
Agent 1.2.22 is released on 3 April 2025 with the tag 2025.04.03.1808.
This agent release updates the following bundles:
- agent-cri-client 1.0.4: This bundle is updated to capture and log the exceptions that occur during the activation of the
CriClient. - agent-grpc-channel-cache 1.0.2: This bundle is updated to capture and log the exceptions that occur during the creation of channel caches.
Fixes
This release fixes the following issues:
- Previously, exceptions that occurred during the activation of the
CriClientand channel caches were not captured, which led to unhandled errors during startup. This issue is now fixed by capturing and logging the exceptions during the activation of these components.
Agent 1.2.21
Agent 1.2.21 is released on 2 April 2025 with the tag 2025.04.02.0723.
This agent release adds the following bundles:
- agent-support-karaf 1.0.0: This bundle holds all Karaf-related support collection data. Additionally, this bundle adds the following features:
- A new support task is added to collect bundle tree dependencies.
- A new support task is added to collect bundle header information.
This agent release updates the following bundles:
- agent-cgroup 1.0.3: The following changes are added to this bundle:
- The bundle now waits for the completion of process collection before performing the updates to prevent the CRI-O sensors from stopping.
- Containers and processes are now queried without relying on selective monitoring.
- Memory and CPU data spikes on startup are now reduced by setting negative values to 0 during the startup of cgroup data.
- cgroup detection is started only if the host runs on Linux and the
/procfolder is present. - Memory usage on
CGroupV2is now calculated asfile+anon.
- agent-cri-client 1.0.3: The following changes are added to this bundle:
- A version check is now performed during client initialization to preload the necessary classes.
- The bundle now Includes
io.perfmarkto avoid additional external imports.
- agent-internal-api 1.0.15: An API is added to query
TempDirper process that is required for attachments on Windows. - agent-jvm-handling 1.0.14: The following changes are added to this bundle:
- Attachment on Windows now uses the
TEMPdirectory of each process instead of a global directory when the user is not an administrator or a service account. - You can now control the timeout on JVM connections by using the environment variable
INSTANA_SOCKET_CONNECTION_TIMEOUT. The default value is 45, and the unit is seconds.
- Attachment on Windows now uses the
- agent-open-telemetry-grpc 1.1.6: A retry mechanism is added for port binding failures.
- agent-open-telemetry-http 1.1.5: A retry mechanism is added for port binding failures.
- agent-process-handling 1.0.13: The following changes are added to this bundle:
- InstanaPCP is updated to 1.3.73: Process metrics can now be collected without changing the process name to
processName_pidformat. - Null case for environment variable maps are now handled properly when querying container specific values.
- The ability to wait for the first process collection before updates is added.
- The ability to query processes without selective monitoring is added.
- InstanaPCP is updated to 1.3.73: Process metrics can now be collected without changing the process name to
- agent-process-handling-api 1.0.4: The following changes are added to this bundle:
- The interface to await the first process collection is added.
- The interface to query processes without selective monitoring is added.
- agent-runtime 1.0.6: ReentrantLock is ow used instead of synchronization for map, list, and string interning.
- agent-socket-server 1.0.3: A retry mechanism is added for port binding failures.
Features
This release adds the following features:
- A dedicated support bundle for Karaf-related support collection data is added. The new
agent-support-karafbundle also adds support tasks to collect bundle tree dependencies and header information. - The
agent-jvm-handlingbundle now supports a configurable timeout for JVM connections by using theINSTANA_SOCKET_CONNECTION_TIMEOUTenvironment variable (default value is 45 seconds).
Fixes
This release fixes the following issues:
- Previously, CRI-O Sensors stopped functioning during updates because process collection was delayed. This issue is now fixed by making sure that that process collection is fully completed before proceeding with updates.
- Previously, an exception occurred during an upgrade if CRI-O containers were stopped immediately after startup. This issue is now fixed by performing a version check during client initialization to preload necessary classes.
- Previously, the use of selective monitoring sometimes resulted in incomplete data collection for containers and processes. This issue is now fixed by querying all containers and processes without relying solely on selective monitoring.
- Previously, negative values processed during startup of cgroup data led to spikes in memory and CPU usage. This issue is now fixed by normalizing any negative values to zero.
- Previously, cgroup detection was attempted on non-Linux systems and systems without a proper
/procdirectory, which caused errors. This issue is now fixed by restricting cgroup detection to Linux hosts with a valid/procfolder. - Previously, memory usage for
CGroupV2was calculated inaccurately. This issue is now fixed by correctly calculating memory usage as the sum offileandanonmemory. - Previously, Windows JVM attachments used a single global TEMP directory regardless of user privileges, which caused conflicts and failing attachments. This issue is now fixed by making sure that the attach process uses the
TEMPdirectory of the user. - Previously, there was no mechanism to control the timeout for JVM connections, which sometimes led to connection issues. This issue is now fixed by adding an environment variable that you can use to configure the JVM connection timeout.
- Previously, failures to bind ports for ingress communications did not trigger any retry attempts, leading to connectivity problems. This issue is now fixed by implementing a retry mechanism for port binding failures.
- Previously,
nullvalues in environment variable maps during container-specific queries could lead to errors. This issue is now fixed by adding proper handling for null cases.
Agent 1.2.20
Agent 1.2.20 is released on 14 March 2025 with the tag 2025.03.14.1745.
This agent release updates the following bundles:
- agent 1.1.746: The Log4j2 pattern is now updated on startup.
- agent cgroup 1.0.2: The cgroup data lookup issue is now fixed by using any available process in a container.
- agent process handling 1.0.12: The following updates are added to this bundle:
- PID 1 is now correctly identified as a process on the host instead of a container process.
- A null check is added to resolve the
NullPointerExceptionerror in ContainerD process when the namespace is null. - Additional debug information is provided for process objects when support information is collected.
- agent util 1.0.10: A trace logger is added for annotated methods.
Features
This release adds the following features:
- The agent framework now supports method-based trace logging. Although this feature is available through framework, currently one must annotate individual methods to enable trace logging. The full adoption is planned to be released in the future releases.
- The Log4j2 pattern is now automatically updated on startup to include the method information by using the pattern,
| %replace{%X{method}}{^(.+)$}{$1 | }. - Enhanced debug logging for processes is now available during support information collection. Every process type now provides detailed internal debug data to facilitate troubleshooting and analysis.
Fixes
This release fixes the following issues:
- Previously, PID 1 was misidentified as a container process. This issue is now fixed by correctly identifying PID 1 as a host process.
- Previously, the tracer announce procedure failed on containerized workloads. This issue is now fixed by relaxing the container environment lookup for ContainerD processes and correctly handling PID 1 as a host process.
- Previously, a
NullPointerExceptionerror occurred in ContainerD processes when the namespace was null. This issue is now fixed by adding a null check. - Previously, the cgroup data lookup did not correctly utilize available processes within a container. This issue is now fixed by using any process within the container for cgroup data lookup.
Agent 1.2.19
Agent 1.2.19 is released on 13 March 2025 with the tag 2025.03.13.0809.
This agent release updates the following bundles:
- agent grpc 1.0.17: Additional io.grpc components (
io.grpc.utilandio.grpc.inprocess) are now exported to improve the agent’s communication capabilities. Also, startlevel is lowered to 70. - agent optional API 1.0.8: This bundle is updated to run the configuration steps in a defined order.
- agent 1.1.745: This bundle is updated to read configurations from the agent through environment (by using
agent_env) and file (by usingagent_file) and combine sensor data from multiple sensors that share the same name andentityId. - agent cri client 1.0.2: This bundle is updated for compatibility with the agent grpc 1.0.17 bundle update.
- agent JVM handling 1.0.13: This bundle is updated to evaluate environment variables (
IBM_JAVA_OPTIONS,JAVA_TOOL_OPTIONS, and_JAVA_OPTIONS) when checking J9 JVMs for thecom.ibm.tools.attach.directorystartup parameter and updateattach-toolsto version 1.17.2 to correctly handle handle explicit directory definitions. - agent process handling 1.0.10: The following changes are added to this bundle:
- Selective monitoring is added for container environment variables (supported for Podman, Docker, and CRI-O), which enables the agent to decide if a process should be monitored or ignored.
- The jail toot process handling is restricted to Linux systems.
- Memory footprint for processes is reduced by interning strings, arguments, and environment variables from processes that share the same values.
- The file permission issue that occurred when copying files into a rootless Podman container with strict umask settings is fixed.
- The native
CriClientis enabled, which is controlled by the environment variableINSTANA_USE_CRI_CLIENT.
- agent process handling 1.0.11: This bundle is updated to always use a mutable environment map when executing process calls.
- agent runtime API 1.0.5: Interfaces to intern lists and maps are added.
- agent runtime 1.0.5: Interning of lists and maps is implemented.
- agent util 1.0.9: Two helpers are added to handle and list the file permissions and to
iteratethrough a collection of Optional supplier objects.
Features
This release adds the following features:
- Additional gRPC components are now exported to extend the agent’s communication capabilities.
- The agent configuration steps are run sequentially in a predefined order to improve the configuration process.
- The agent can now replace configurations from both environment variables and files within the agent context.
- Automatically merges sensor data from sources that share the same name and
entityId. - The agent now provides selective monitoring for container environments.
- Activates the internal
CriClientby default, ensuring seamless integration with modern container runtimes.
Fixes
This release fixes the following issues:
- Previously, the JVM attachment process would fail on J9 JVMs when any of the environment variables (
IBM_JAVA_OPTIONS,JAVA_TOOL_OPTIONS, or_JAVA_OPTIONS) defined thecom.ibm.tools.attach.directoryexplicitly. This issue is now fixed by evaluating these environment variables and updating the attach-tools (v1.17.2) to correctly handle an explicit directory definition. - Previously, when the host had a large number of processes with identical arguments and environment variables, the agent would run out of memory. This issue is now fixed by interning strings, arguments, and environment variables, which reduces the memory footprint.
- Previously, a file permission issue occurred when copying files into a rootless Podman container under strict umask settings. This issue is now fixed by applying file permissions to the intermediate file before it is copied.
- Previously, in Red Hat OpenShift Container Platform 4.18 environments where crun is the default container runtime, the agent did not use the internal
CriClientby default. This issue is now fixed by handlingINSTANA_USE_CRI_CLIENTas true if the variable is absent, which ensures compatibility with the new container runtime default. - Previously, a jail root lookup issue on Solaris caused all processes to be incorrectly identified as jail root. This issue is now fixed by restricting jail root process handling to Linux systems only.
Agent 1.2.18
Agent 1.2.18 is released on 27 February 2025 with the tag 2025.02.27.1315.
This agent release updates the following bundles:
- agent 1.1.744:
javaagent-loaderis updated to version 1.3.66. Also,instrumentation‑sharedis updated to version 1.0.145 to add the ability to ignore specific packages during instrumentation. - agent internal API 1.0.14: A new method to query all known process IDs (PID) for process‑based sensors is added.
- agent‑cgroup 1.0.1: The bundle is updated to perform cgroup version checks only on Linux systems.
- agent‑jvm‑handling 1.0.12: The monitoring issue
jvm_tmp_not_availableis updated toagent_tmp_directory_missingwhen/tmpis unavailable. Also, the bundle is updated to support constant monitoring for/tmpavailability for jail root-based JVMs. - agent‑process‑handling 1.0.9: The bundle is updated to add the following changes:
- log level for exceptions during symbolic link checks is lowered to
DEBUG. - event‑based handling mechanism replaces the timer‑based approach to update the iptables of Garden‑based containers.
- The parsing issue that occurred during the normalizing of broken paths on Windows is fixed.
- log level for exceptions during symbolic link checks is lowered to
Features
This agent release adds the following features:
- A new method is added to query all known process IDs (PID) for process‑based sensors. This new method improves the tracking and monitoring of processes.
- The process handling bundle now uses an event‑based update mechanism instead of the previous timer‑based approach to update iptables in Garden-based containers.
Fixes
This release fixes the following issues:
- Previously, the cgroup bundle conducted unnecessary cgroup version checks on non‑Linux systems. This issue is now fixed by limiting the version check to Linux environments.
- Previously, the memory parsing process in the cgroup bundle added wrong limits. This issue is now fixed by adding two new helpers,
parseMemoryDataCgroupV1andparseMemoryDataCgroupV2to read the correct memory files. - Previously, the JVM handling bundle reported a
jvm_tmp_not_availablemonitoring issue when the/tmpdirectory was unavailable for jail root-based JVMs. This issue is now fixed by updating the monitoring issue toagent_tmp_directory_missingand adding support for the continuous monitoring of jail root JVMs. - Previously, the exceptions that were identified in the symbolic link checks on Linux were logged at a high level of detail, which cluttered the logs. This issue is now fixed by reducing the log level to
DEBUG. - Previously, the process handling bundle encountered issues with normalizing broken paths on Windows. This issue is now fixed by enhancing the logic for Windows path normalization.
Agent 1.2.17
Agent 1.2.17 is released on 13 February 2025 with the tag 2025.02.13.1425.
This agent release updates the following bundles:
- agent 1.1.743:
javaagent-loaderis updated to 1.3.65. Also,instrumentation-sharedis updated to 1.0.144 to fix the memory leak in the instrumentation logs. - agent backend 1.0.5: Handling for capabilities endpoint is added.
- agent JVM handling 1.0.11: Support for jail root for JVMs is added. Also, the bundle now supports monitoring
jvm_tmp_not_availablewhen/tmpis not available for a JVM. - agent process handling 1.0.8: Support for jail root for processes is added. Also, the bundle now supports retrieving environment variables for WebSphere on z/OS.
- agent process handling API 1.0.3: The bundle is updated to add support to jail root processes on an internal API level.
- agent util 1.0.8: The bundle is updated to add a new helper for FilePermissions.
- agent grpc 1.0.16: The gRPC server is removed from the bundle.
- agent open telemetry service 1.1.5: The bundle is updated to use
MachineIdto link OpenTelemetry entity with host entity. - agent open telemetry grpc 1.1.5: The gRPC server is added to the bundle.
Features
This agent release adds the following features:
- Support for jail root is added for both JVMs and processes.
- Handling of the capabilities endpoint in the agent backend is enhanced.
- OpenTelemetry integration is improved by linking the host and OpenTelemetry entities by using
MachineId.
Fixes
This release fixes the following issues:
- Previously, instrumentation logs experienced a memory leak. This issue is now fixed by updating
instrumentation-sharedfiles to1.0.144. - Previously, the gRPC server started as part of the
agent grpcbundle even when it was not required. This issue is now fixed by moving the the gRPC server from theagent grpc bundleto theagent open telemetry grpcbundle.
Agent 1.2.16
Agent 1.2.16 is released on 23 January 2025 with the tag 2025.01.23.0950.
This agent release updates the following bundles:
- grpc core 1.0.15: This bundle updates
protobuf-javato version 4.29.3,protobuf-java-utilto version 4.29.3, andproto-common-google-common-protosto version 2.50.1. - agent process handling 1.0.7: This bundle adds the logic to identify the location of
ctron a Tanzu Cluster.
Additionally, the following bundles are updated to maintain compatibility with the updated Protobuf version:
- agent cri client 1.0.1
- agent grpc channel cache 1.0.1
- agent grpc channel cache api 1.0.1
- agent open telemetry base 2.2.2
- agent open telemetry service 1.1.4
- agent open telemetry grpc 1.1.4
- agent open telemetry http 1.1.4
- agent otel sensorsdk api 1.0.3
- otel sensorsdk utils 1.0.1
- otel sensorsdk database 1.0.11
- otel sensorsdk host 1.0.5
- otel sensorsdk llmonitor 1.0.6
- otel sensorsdk dcgm 1.0.1
- otel sensorsdk jvm 1.0.2
- otel sensorsdk k8s 1.0.1
- agent prometheus 1.0.12
Fixes
This release fixes the following issues:
- Previously, the location of
ctron Tanzu Clusters was not identified correctly, which caused issues with container operations. This issue is now fixed by adding the logic to accurately detect thectrlocation in such environments.
Agent 1.2.15
Agent 1.2.15 is released on 15 January 2025 with the tag 2025.01.15.1435.
This agent release adds the following bundles:
- agent cgroup 1.0.0: This bundle parses control group (cgroup) data, which can be used as a service for container metrics.
- agent cri client 1.0.0: This bundle interacts with Container Runtime Interface (CRI )API gRPC endpoints. The interactions include the functionality for listing containers, reading container statuses, retrieving image statuses, and executing commands within a container.
- agent grpc channel cache api 1.0.0: This bundle exposes the access to Unix domain socket endpoints through ManagedChannels.
- agent grpc channel cache 1.0.0: This bundle provides a caching mechanism to access Unix domain sockets through ManagedChannels.
This agent release updates the following bundles:
- agent backend 1.0.4: A null check is added for the
messageIdfield in the JSON data that is received from the backend. - agent JVM handling 1.0.10: A new process,
UnifiedProcess, for JVM attachments is added. - agent process handling api 1.0.2: The method to retrieve a
UnifiedProcessBuilderwith extended capabilities is added. - agent process handling 1.0.6: This bundle is updated to enhance the file permission settings to copy the temporary files in rootless Podman environments. The
podman infocommand is now used to locate Podman sockets for individual users. Also, the following changes are added:- CRI processes are now handled by utilizing the new
UnifiedProcessabstraction, which enables support forCrioProcess. -
CrioUtilis now extended to work withCriClientwhen configured. - The environment variable,
INSTANA_USE_CRI_CLIENT(default: false) to enable theCriClientis added.
- CRI processes are now handled by utilizing the new
- agent util 1.0.7: The bundle is updated to add the following components:
- a helper for exception-throwing functions
- a utility for managing Futures
- a helper for stopping ThreadPools Also,
LinuxProcFileParserfrom the process handling bundle is migrated to this bundle.
- agent 1.1.742: The bundle is updated to improve entity management by keeping entities alive with empty data to prevent them from being marked offline. The handling of empty files is enhanced by returning zero-length byte arrays. Also, the process to add public IP gateway interests is modified to be synchronous instead of asynchronous.
Features
This agent release adds the following features:
- The
UnifiedProcessabstraction is added to offer extended functionalities to manage normal processes and CRI processes. -
CriClientand its associated configurations are added for seamless interaction with CRI API gRPC endpoints. - The
agent cgroupbundle is added to enhance container metric management. - The
agent utilbundle now provides improved resource and thread management.
Fixes
This release fixes the following issues:
- Previously, entities in the backend were marked as offline due to missing data. This issue is now fixed by keeping entities alive with empty data.
- Previously, the agent's handling of empty files caused unexpected behavior. This issue is now fixed by returning a zero-length byte array when empty files are encountered.
- Previously, the asynchronous process for adding public IP gateway interests caused delays. This issue is now fixed by changing the operation to be synchronous.
- Previously, in rootless Podman environments, temporary files that were created with the correct set of permissions were overwritten because of the
umasksettings. This issue is now fixed by explicitly setting the file permissions after the temporary file has been created.
Agent 1.2.14
Agent 1.2.14 is released on 9 January 2025 with the tag 2025.01.09.0618.
This agent release updates the following bundles:
- agent JVM handling 1.0.9: The bundle is updated to improve logging when a JVM connection cannot be used.
- agent process handling 1.0.5: The bundle is updated to fix an issue where wrong sockets were set for ContainerD instances. Also, the agent ignores the control region on z/OS now. Copying files into Podman containers is improved.
- agent socket server 1.0.2: The bundle is updated to fix a race condition for JVM connections.
- agent 1.1.741: The bundle is updated to add a monitoring event when the agent uses an incompatible Java version.
Features
This agent release adds the following features:
- The Instana agent has stopped the support for Java 8. You must use Java 11. When you start newly installed agents with Java 8, the agent now shows a monitoring event. This monitoring event is relevant only if you install or use your own JVM. Containerized or package-based agents already use Java 11.
Fixes
This release fixes the following issues:
- Previously, in rootless Podman environments, copying files to the target container might fail as the agent did not define a permission set for the temporary file. This issue is now fixed, and the temporary files are created with
rwxr-xr-x. - Previously, the agent failed to set any socket information for a ContainerD instance when multiple sockets are present. This issue is now fixed, and the agent sets the correct socket information for a ContainerD instance.
- Previously, the agent had a race condition on JVM connections and kept a connection open even though it was internally already marked as closed. The wrong connection was removed only when the agent was restarted. This issue is now fixed, and the agent correctly closes the broken connection.
Agent 1.2.13
Agent 1.2.13 is released on 21 November 2024 with the tag 2024.11.21.1635.
This agent release updates the following bundles:
- agent internal API 1.0.13: The service
ExtendedContainerProcessis removed. - agent JVM handling 1.0.8: The bundle is updated to run the
dfcommand as required by the user. - agent process handling 1.0.4: The ability to manually set a default timeout for commands is added. Also, the bundle is updated for the
nsentercommand to use the--userflag on the containers that are owned by rootless Podman if the environment variableNSENTER_MODE_ENABLEDis set totrue. - agent process handling API 1.0.0: The bundle is updated to add the
ExtendedContainerProcessinterface, which was previously located in the internal API bundle. - agent sensor 1.0.1: The code quality is improved without any feature changes.
Fixes
This release fixes the following issues:
- Previously, in rootless Podman environments, the
dfcommand failed a check that is used to verify the available size within a container before a JVM attachment. This issue is fixed, and thedfcommand is now run by the user as required. - Previously, during the startup, the agent failed to execute some commands that are necessary to identify if the agent is running on a host that supports various container environments. The failure occurred because the default timeout to run the command was one second, which was not sufficient. This issue is fixed, and you can now control the timeout by using a new environment variable
INSTANA_COMMAND_RUNNER_TIMEOUT_SECONDS=5, which has a default duration of 5 seconds. - Previously, the agent did not include the
--userargument while executing ansentercommand when the environment variableNSENTER_MODE_ENABLED=truewas set. This issue is fixed, and the agent now uses the--userargument when required.
Agent 1.2.12
Agent 1.2.12 is released on 20 November 2024 with the tag 2024.11.20.0856.
This agent release updates the following bundles:
- agent 1.1.740: The
UniqueIdcalculation of the agent is hardened to be more deterministic. - agent backend 1.0.3: The bundle is updated to add a warning log when the agent key is wrong.
- agent jaeger tracing 1.0.1: The code quality is improved without any feature changes.
- agent jvm handling 1.0.7: The bundle is updated to exclude the
LIBPATHon IBM i JVM attachments. - agent util 1.0.6: Trace logging is added.
Fixes
This release fixes the following issues:
- Previously, the
uniqueIdfrom the agent on Linux was not deterministic when the main interface identified by Sigar was avlaninterface. This was because these interfaces are not ordered by the host. This issue is fixed, and thevlaninterfaces are now sorted first if names that start withvlanare identified. - Previously, the
uniqueIdfrom the agent on Windows used theKM-TEST Loopback Adapterinterface. Because this is a loop-back interface, the MAC address was not unique. This issue is fixed, and the agent now ignores theKM-TEST Loopback Adapterinterface when other interfaces are available. - Previously, the agent did not log when the agent key for a backend was wrong. This issue is fixed, and the agent now logs a warning every 10 minutes when it receives a
403error report from the backend, which indicates that the agent key is wrong.
Agent 1.2.11
Agent 1.2.11 is released on 12 November 2024 with the tag 2024.11.12.1259.
This agent release adds the following bundle:
- agent sensor 1.0.0: This bundle combines all the components related to the
AgentDashboardinto a single bundle.
This agent release updates the following bundles:
- agent internal API 1.0.12: All the required services for
AgentSensorare added. - agent 1.1.739: All classes related to
AgentSensorare removed from this bundle. - agent backend 1.0.2: The bundle version is updated without code changes to fix an issue with
1.0.1that delivered incorrect imports. - agent process handling 1.0.3: The bundle is updated to improve username identification by using the
idcommand on the host if the agent is running in a container. Also, Selective Monitoring mode is added to the agent process handling bundle. - agent runtime 1.0.4: The implementation of the
ClockProviderservice is added. - agent runtime API 1.0.4: The
ClockProviderservice is added for better handling of timings. - agent socket server 1.0.1: The bundle version is updated without code changes to fix an issue with
1.0.0that delivered incorrect imports. - agent util 1.0.5: The bundle is updated to import the
Snakeyamlversions 1 to 3.
Features
This agent release adds the following features:
-
The agent now has a Selective Monitoring mode. This mode adds the ability to monitor only the processes that hold specific environment variables.
The agent checks if the process is started with the environment variable
INSTANA_SELECTIVE_MONITORING.-
If
INSTANA_SELECTIVE_MONITORINGis set toDEFAULTor has an empty value, the agent operates in normal mode. All processes withINSTANA_MONITORING=falseandINSTANA_IGNORE=<any value>are ignored. -
If
INSTANA_SELECTIVE_MONITORINGis set toOPT_IN, the agent operates in Selective Monitoring mode. The agent monitors only the processes that haveINSTANA_MONITORING=true,INSTANA_MONITORING=apm, orINSTANA_MONITORING=infra. All processes withINSTANA_MONITORING=falseandINSTANA_IGNORE=<any value>are ignored.
Currently, there is no differentiation between
apmorinframodes. -
Fixes
This release fixes the following issues:
- Previously, the agent always executed the
idcommand in the context of the agent, which could fail if the agent was running in a container. This issue is fixed, and theidcommand is now executed on the host. - Previously, the agent failed to start because of
Snakeyamlimports that required a minimum version of 2. This version was not present in the agents with agent bootstrap version earlier than 1.2.9. This issue is fixed, and the agent util now importsSnakeyamlversions 1 to 3.
Agent 1.2.10
Agent 1.2.10 released on 30 October 2024 with the tag 2024.10.30.0628.
This agent release updates the following bundles:
- agent jvm handling 1.0.5: The bundle is updated to always use the
sucommand on AIX for JVM attachment. - agent process handling 1.0.1: The bundle is updated to improve username identification by using the
idcommand instead of reading the/etc/passwdfile. Also, cache forusernameandpodmansockets is added.
Fixes
This release fixes the following issue:
- Previously, the agent only checked if the
/etc/passwdfile contained a user ID to identify a user. This issue is fixed, and the agent now correctly identifies a user by using theidcommand instead. - Previously, the agent had a fallback setting to use the
sudocommand on AIX for the JVM attachment. However, the fallback was not always possible as thesudocommand is not available on AIX by default. This issue is fixed, and the agent now only uses thesucommand on AIX for the JVM attachment.
Agent 1.2.9
Agent 1.2.9 is released on 14 October 2024 with the tag 2024.10.24.1959.
This agent release adds the following bundles:
- agent process handling API 1.0.0: This bundle adds the
OsProcessUtilProviderservice, which is exposed to other bundles of the agent. - agent process handling 1.0.0: This bundle is responsible for the handling and managing of all process references on the host.
This agent release updates the following bundles:
- agent internal API 1.0.11: The
MutexProviderservice is added, which is exposed to other bundles of the agent. - agent 1.1.738: All the instructions for process handling is removed.
- agent jvm handling 1.0.4: The check for the
/etc/passwdfile to identify usernames in rootless Podman is improved. - agent runtime API 1.0.3: The
HostNamespaceValidatorservice is added, which is exposed to other bundles of the agent. - agent runtime 1.0.3: The bundle is updated to evaluate all available namespaces for the
nsentercommand. - agent util 1.0.4: The
YamlSanitizerandConfigurationUtilhelpers are added, which are exposed to other bundles of the agent.
Features
This agent release adds the following features:
- The agent now has a dedicated bundle to handle all activities that are related to processes. These activities also include the abstraction around containerized processes.
- The agent now collects a validation of the
confiugration.yaml. You can retrieve this data by clicking on the Collect Support Information button on the agent dashboard.
Fixes
This release fixes the following issues:
- Previously, the agent did not check if the
/etc/passwdfile had more characters to evaluate when a user ID was not found in the file. This issue is now fixed, and the agent correctly identifies when the checking of the file is finished. - Previously, the agent did not evaluate all the available namespaces of the host system when executing the
nsetner -acommand. This issue is fixed, and the agent now checks all available namespaces and adds them explicitly to thensentercommand.
Agent 1.2.8
Agent 1.2.8 is released on 15 October 2024 with the tag 2024.10.15.0924.
This agent release updates the following bundles:
- agent 1.1.737: Support for RKE2 is added.
- agent task orchestrator 1.0.3: Debug information for threading is added.
- agent jvm handling 1.0.3: Optimizations to attachments is added.
Features
This agent release adds the following features:
- The agent now collects a thread dump of all agent threads. You can retrieve this data by clicking on the Collect Support Information button on the agent dashboard.
Fixes
This release fixes the following issue:
- Previously, the agent did not use the correct
PATHwhen it was run in a container on RKE2. This issue is now fixed, and the agent correctly identifies when it is run on RKE2. The agent also adds/var/lib/rancher/rke2/binto thePATHif it is missing. - Previously, the agent used a thread from the scheduler during rebooting or resetting. When the agent installed other features at the same time, the agent could get stuck on the reboot or reset. This issue is now fixed, and the agent uses a thread from the main group and finishes the reboot or reset.
- Previously, the agent used the
sucommand to change the user on IBM i when the agent was run as the root userQSECOFR. This attachment failed because IBM i does not supportsu. This issue is now fixed, and the agent uses the customibmi-sudoexecutable to change the user. - Previously, the agent used the
sudocommand to change the user on z/OS as a fallback. This attachment failed because z/OS does not supportsudo. This issue is now fixed, and the agent only uses thesucommand to change the user. - Previously, the agent did not provide details about the threads that are stuck when the scheduler and executor stopped the threads for the agent to stop, restart, or update. This issue is now fixed, and the agent writes a thread dump into the logs when the threads are stopped.
- Previously, the agent attached to JVMs that are part of a
buildahstep. This issue is now fixed, and the agent ignores JVMs that have a parent process with the namebuildah-chroot-exec.
Agent 1.2.7
Agent 1.2.7 is released on 10 October 2024 with the tag 2024.10.10.2225.
This agent release updates the following bundles:
- agent 1.1.736: The PodmanUtil startup issue is fixed.
- agent task orchestrator 1.0.2: Version is updated to clean up the existing tasks.
Fixes
This release fixes the following issue:
- Previously, the agent returned a
NumberFormatExceptionerror in thePodmanUtilservice and failed to start most of the internal services on AIX systems. This error occurred because the UIDs on AIX exceeded the maximum integer range that was specified in the Agent 1.2.6 release. This issue is now fixed, and the agent parses long UIDs and starts up correctly.
Agent 1.2.6
Agent 1.2.6 is released on 9 October 2024 with the tag 2024.10.09.1357.
This agent release updates the following bundles:
- agent 1.1.735: Support for rootless Podman is added.
- agent JVM handling 1.0.2: Support to use FileAccess as part of the JVM attachment is added.
- agent task orchestrator API 1.0.1: Method to track executions with a counter is added.
- agent task orchestrator 1.0.1: A logic to count executions with a counter is added.
- agent backend API 1.0.1: MessageType capabilities are added.
- agent backend 1.0.1: Backend is updated to check for capabilities. Also, the agent now sends
heartbeatdata to the backend only if it supports thepollRatecapability.
Features
This agent release adds the following features:
- The agent now supports rootless Podman to identify if a process is started by the root or a user. To use this feature, make sure that Podman sockets are available for both root and user.
- The agent now provides an abstraction layer to access files for rootless Podman. The abstraction is required because the existing Java Nio-based file access has the same user as the agent and therefore cannot interact with the user file system.
- You can now configure the agent to send less data to the backend from the sensors that collect data at lower granular intervals. For example, process sensors and container sensors. Decreasing the amount of data that is sent to the backend reduces the counted traffic and the computation on the backend.
- The agent now generates lesser number of metrics on the backend to debug traces and logs. This reduces the load on the backend.
Agent 1.2.5
Agent 1.2.5 is released on 23 September 2024 with the tag 2024.09.23.1452.
This agent release updates the following bundles:
- agent 1.1.734: The order of configuration services on agent startup for process and secret handling is now fixed.
Fixes
This release fixes the following issues:
- Previously, the agent marked a process as not running after an update of the agent feature. This was because the configuration service that is used to determine whether a process must be ignored is not ready at startup time. This is now fixed and the agent awaits the configuration service before deciding whether a process is ignored.
Agent 1.2.4
Agent 1.2.4 is released on 18 September 2024 with the tag 2024.09.18.1243.
This agent release updates the following bundles:
- agent 1.1.733: A fix for the docker command is added.
- agent JVM handling 1.0.1: The check for sending the
jvm_instrumentation_shared_absentmonitoring issue is optimized.
Fixes
This release fixes the following issues:
- Previously, the agent failed to run a
docker execcommand with a user switch. This was because the agent added the-uflag aftercontainerId, which is invalid. This issue was noticed in the Agent 1.2.3 release. This issue is now fixed. - Previously, the agent created a
jvm_instrumentation_shared_absentmonitoring issue when a JVM was absent or when the connection to the JVM was already closed. This issue is now fixed and the agent creates thejvm_instrumentation_shared_absentmonitoring issue when the JVM is still active.
Agent 1.2.3
Agent 1.2.3 is released on 16 September 2024 with the tag 2024.09.16.1150.
This agent release adds the following bundles:
- agent JVM handling 1.0.0: This bundle contains the logic to collect and handle JVM attachments.
- agent JVM handling API 1.0.0: This bundle contains callback listeners for the agent when a JVM connection is established or removed.
This agent release updates the following bundles:
- agent 1.1.732: JVM handling from the main bundle is removed. Also, restart requests on the first minute is now ignored.
- agent runtime API 1.0.2:
OperatingSystemProbeto check for the OS on which the agent runs is added. - agent runtime 1.0.2: The implementation of the
OperatingSystemProbeis added. - agent internal API 1.0.10: Interfaces are added for the APIs that are used by the JVM handling and are provided by the agent core bundle .
- agent util 1.0.3:
InstanaStringUtilsthat offers methods to search within a string is added.
Fixes
This release fixes the following issues:
- Previously, the agent became unresponsive if multiple restart requests were raised at the same time. This issue is now fixed and the agent ignores incoming restart requests in the first minute.
- Previously, the agent did not check whether the
instrumentation-sharedfiles exist. If the files were absent, thejava-tracerdid not start and aNoSuchFileExceptionwas added to the logs. This issue is now fixed and the agent checks if theinstrumentation-sharedfile is present. The agent also creates a monitoring issue with the namejvm_instrumentation_shared_absentif theinstrumentation-sharedis absent. - Previously, the agent generated multiple logs when an update occurred while the agent was forwarding logs to the backend. This issue is now fixed and logs are not created when the agent is updated.
Agent 1.2.2
Agent 1.2.2 is released on 5 September 2024 with the tag 2024.09.05.1355.
This agent release updates the following bundles:
- agent 1.1.731: The main agent bundle. Optimizes Inventory handling.
- agent util 1.0.2:
SafeWriterhelper that catches write exceptions is added. Also,<empty-secret-obfuscated-by-instana>is now added when empty secrets are replaced.
Features
This agent release adds the following features:
- The agent now collects the configurations that are shared with a sensor at startup time or as part of a configuration update. You can retrieve this data by clicking on the Collect Support Information button on the agent dashboard.
- The agent now supports JDK-based attachments along with Byte Buddy-based attachments. You can specify to use JDK-based attachments by setting the environment variable
INSTANA_JVM_BYTEBUDDY_ATTACHMENT_ENABLEDasfalse.
Fixes
This release fixes the following issue:
- Previously, the agent created a new string when comparing the inventory as part of the discovery check. This issue is now fixed and new strings are not created anymore.
Agent 1.2.1
Agent 1.2.1 is released on 28 August 2024 with the tag 2024.08.28.1029.
This agent release adds the following bundles:
- agent 1.1.730: The main agent bundle.
- agent config provider 1.0.0: This bundle provides the main configuration of the agent that reflects in the
com.instana.agent.main.config.Agent.cfgfile. - agent secret reader 1.0.0: This bundle provides access to the vault configuration integration to other sensors. This bundle also implements the logic to expose a service through an existing interface, which is present in the sensor API.
This agent release updates the following bundles:
- agent internal API 1.0.9: The
ConfigurationServiceservice is added, which is exposed to other bundles of the agent. - agent optional API 1.0.7: Methods to break the circular dependency is updated.
- agent runtime API 1.0.1: The AgentPID and LinuxPaths services that hold the internal PID of the agent are added.
- agent runtime 1.0.1: The implementation of the AgentPID and LinuxPaths services is added.
- agent util 1.0.1:
OversizedByteArrayhelper is added for cases where the special reader is not available.
Fixes
This release fixes the following issue:
- Previously, the vault configuration integration failed to start and became unusable when the agent bundle was updated after the vault was started. This issue is now fixed, and the vault configuration integration works after an update.
Agent 1.2.0
Agent 1.2.0 is released on 22 August 2024 with the tag 2024.08.22.1426.
Bundle split
This release splits the agent bundle into multiple bundles. The splitting of bundles reduces the duration of agent downtimes during an update and ensures that the components that are not updated are run without interruption. This agent release contains the following bundles:
- agent 1.1.729: The main agent bundle.
- agent backend API 1.0.0: Services required for other agent bundles for backend connection.
- agent backend 1.0.0: The implementation of the backend connection.
- agent backend util 1.0.0: Utility bundle for backend-related components.
- agent internal API 1.0.8: Services required for other bundles that are provided by the agent bundle.
- agent Jaeger tracer 1.0.0: The Jaeger Tracer component.
- agent memory API 1.0.0: Services required for other bundles for memory access.
- agent memory 1.0.0: Implementation of the memory access.
- agent runtime API 1.0.0: Services required for other bundles of the agent that allow access to the runtime-related data.
- agent runtime 1.0.0: Implementation of the runtime-related data.
- agent self profiling 1.0.0: Self-profiling capability of the agent.
- agent socket server API 1.0.0: Services required for other bundles of the agent for the main agent socket server 42699. Mainly holds counter related information.
- agent socket server 1.0.0: The implementation of the main agent socket server that runs on port 42699.
- agent task orchestrator API 1.0.0: Services required for other bundles for task orchestration.
- agent task orchestrator 1.0.0: The implementation for the task orchestration. Holds the Scheduler and Executor services.
- agent util 1.0.0: Helper bundle with static helpers that are not part of any API.
- agent Zipkin tracer 1.0.0: The Zipkin Tracer component.
Features
This agent release adds the following features:
- Java Instrumentation now supports Java 23.
- The agent now supports a special environment variable
INSTANA_BIND_ALL_INTERFACES. If this environment variable is set totrue, the agent binds to all interfaces and announces the interfaces when the agent monitors Java workloads. This feature is required when the container uses Macvlan. - The agent now tracks aborted requests on the 42699 endpoint for internal monitoring.
Fixes
This release fixes the following issues:
- Previously, an internal service of the agent would be absent if a temporary directory on the host was corrupted. Now, the agent catches this exception and the internal service remains intact.
- Previously, the agent would time out on the
java -versioncheck after 5 seconds. This timeout is now increased to 10 seconds.
Agent 1.1.728
Agent 1.1.728 is released on 5 August 2024 with the tag 2024.08.05.1210.
Features
This agent release adds the following feature:
- The agent now runs on AS400/IBM i OS.
Fixes
This release fixes the following issues:
- Previously, the agent showed the agent-bundle version on the
/path. This issue is now fixed, and the agent now displays the agent version. - Previously, the agent ignored connections from JVMs if they were marked as unstable. These markings did not timeout. The timeout for the markings is now fixed, and the potential unstable connections are retried again after 5 minutes of the timeout.
Agent 1.1.727
Agent 1.1.727 is released on 17 July 2024 with the tag 2024.07.17.1321.
Features
This agent release adds the following feature:
- An internal API is added to the host agent that enables the sensors to request for the process environment configuration that is already in discovery.
Fixes
This release fixes the following issue:
- Previously, J9-based JVMs were excluded from the new attachment that was added with Agent 1.1.721 because these JVMs required the
statcommand, which was not available on AIX. This issue is now fixed and the JVMs are included in the new attachment because thestatcommand is replaced with theistatcommand.
Agent 1.1.726
Agent 1.1.726 is released on 02 July 2024 with the tag 2024.07.02.0715.
Fixes
This release fixes the following issues:
- Previously, the Host Agent added a dedicated Thread Pool for discovery requests. An edge case was identified when the Agent was receiving too many discovery requests on startup. In that case, the Host Agent might not handle any other Request and failed to respond to health checks. This overload might lead to restarts on Kubernetes. This issue is now fixed and the Host Agent is no longer restarted.
- On Solaris, the Host Agent checks if the
<java-home>/jvm/jre/lib/sparcv9/jspawnhelperis executable. Now, the Host Agent notifies the user with a Monitoring event. - Previously, the Host Agent showed the command that is used on the
java -versionprocess in an error case. As this command can display secrets, the used command is no longer shown.
Changes
- Previously, Opentelemetry monitoring was deactivated by default. The new default is activated. For more information, see Configuring OpenTelemetry data ingestion.
Agent 1.1.725
Agent 1.1.725 is released on 20 June 2024 with the tag 2024.06.20.1531.
Fixes
This release fixes the following issue:
- Previously, the Host Agent verified incoming data on the connection and closed it if no traffic was observed within 600 seconds. An edge case was identified when the Agent loses connection to the Instana backend every 30 seconds. Closing the connection led to extra load within the JVM. This issue is now fixed and the Host Agent now checks the incoming data at 200, 400, and 600 seconds. If no data reaches the agent for 600 seconds, the connection is marked as unstable and closed.
Agent 1.1.724
Agent 1.1.724 is released on 20 June 2024 with the tag 2024.06.20.1115.
Fixes
This release fixes the following issues:
- Previously, the Host Agent ignored a process after reading the content in
/proc/<pid>/<something>had a timeout. The default timeout was 5 seconds, which got triggered mistakenly in Host Agents running on overloaded hosts. In such cases, the Agent mistakenly ignored the process and did not retry it. This issue is now fixed, and the Host Agent handles potentially broken processes with a staged approach. The Host Agent now supports multiple stages for a process. Successful reading of process data resets the counter. The list of the ignored processes is reset every 10 minutes. - Previously, in some cases within the Host Agent, the flow expected a connection to be removed to run a full reattachment. This reattachment is only possible if the connection is removed and is not added back within a timeout of 20 seconds. This issue is now fixed, and the connection between the Host Agent and JVM is now removed, if the connection is marked as closed.
- Previously, a regression with J9 based JVMs occured that required the
statcommand, which was not available on AIX. This issue is now fixed and now the JVMs that run on AIX are excluded from the new attachment that is added with Agent 1.1.721. The new attachment is enabled again whenstatcommand is replaced withistatcommand.
Agent 1.1.723
Agent 1.1.723 released on 13 June 2024 with the tag 2024.06.13.0459.
Fixes
This release fixes the following issues:
- An environment variable
CONTAINERD_SUPPRESS_DEPRECATION_WARNINGSwith the valuetrueis added to thectr execoperations. This environment variable is to exclude deprecation warnings that might interfere with parsers in the Agent. - The evaluation of a process and the PID that reaches the 42699 port of the Agent is delayed. Computation is completed when the field is requested in code. When you make computation optional, the Agent executes other important tasks.
Agent 1.1.722
Released on 27 May 2024.
Fixes
This release fixes the following issues:
- Process with Arguments on Windows were ignored if they contained characters outside of the UTF-8 area.
- The Javaagent Loader inside a JVM leaks on Exit Hooks for file references of the Agent when the attachment works, but the communication to the Agent failed afterward
- When the agent attaches to a JVM, the Agent places files in
<TMPDIR>/.instanawith read and execute permissions and excludes the write permission for everyone. - The Agent now parses the output of
docker infowhen Docker is available to save the location of the Docker Root Dir. This information is used to correctly identify Docker containerIds.
Agent 1.1.721
Released on 27 May 2024.
Fixes
This release fixes the following issues:
- Better logging when
java -versionfails. The log now contains the command and the output that failed to be parsed. - JVM attachments now always use the
attach-tools-<version>.jar, which is placed in<TMPDIR>/.instanato allow attachments against JREs and 32-bit JVMs on Windows. - The Agent monitors the Metaspace and issues a restart if the available space is under 10 MB for over 30 minutes. This restart reduces the risk of an
OutOfMemoryError:Metaspace.
Agent 1.1.720
Released on 02 May 2024.
Fixes
This release fixes the following issue:
- JVM monitoring: Ignore SAP NetWeaver classes to mitigate class loading issues.
Agent 1.1.719
Released on 02 May 2024.
Fixes
This release fixes the following issues:
- JVM monitoring: Support for Virtual Threads.
- Reduction in Memory by deduplicating Strings on internal tasks.
- Vault is available to other Sensors by an internal Service.