Contribute in GitHub:

Manta Flow Server Administration

Encoding

All property files are encoded in ISO 8859-1 character encoding. Characters that cannot be directly represented in this encoding can be written using Unicode escapes as defined in section 3.3 of The Java™ Language Specification; only a single “u“ character is allowed in an escape sequence.

Logging

The Manta Dataflow Server uses the log4j2 framework for logging. The configuration is available on the page Configurations > Server > Common > Log4J Server in Manta Admin UI. The official documentation for this framework can be found here.

Usage Statistics

The Manta Flow Server collects usage statistics in the inner database. These statistics are captured during user interaction with Manta UI and API.

The collected statistics can be exported using the link <manta-server-url>/usage as an archived CSV file. The export form enables you to set the starting date from which the statistics are exported. The statistics can be cleaned via the URL <manta-server-url>/usage/clean.

The usage statistics CSV file has the following columns.

date — The date and time of the action that is logged
user — The user who performed/triggered the action
action — The code of the action that was performed; the table below contains a complete list of action codes together with descriptions of the actions
params — Additional parameters that are logged; the attributes are represented as a JSON object and are different for each action. The key in the JSON object is always the name of the parameter, and the value is either a value literal or a nested JSON object.

Action source module	Action code	Action description	Params
Manta Flow	^server_start	This action is logged after the start-up of the Manta Flow Server application.	system osName — OS name javaVersion — Java Virtual Machine implementation version javaVnName — Java Virtual Machine implementation name javaRuntimeVersion — Java Virtual Machine implementation version including build ID mainConfig — the content of the < `MANTA_SERVER>/webapps/manta-dataflow-server/WEB-INF/conf/repository.properties` configuration file
Manta Flow Viewer	^{flow_catalog_show}	This action is logged when the user views the main screen of the Manta Flow Viewer application.	N/A
Manta Flow Viewer	^{flow_vis_refView}	This action is logged when the user executes the analysis and visualization of the data lineage in the Manta Flow Viewer application.	refViewTime — the time needed to calculate the data flow in ms refViewSize — number of nodes contained in the data flow refViewError — description of errors that potentially occurred when calculating the data flow initFollowTime — the time needed to calculate the initial dataflow diagram that is visualized initFollowSize — number of nodes contained in the initial dataflow diagram that is visualized isFromPermaLink — flag whether the origin of the request is a permalink scopeMessage — a message describing how the data flow had to be de-scoped, if it is too large to be visualized form — values of all fields of the form whose sending initiated the dataflow request startNodeMap — starting nodes used for the dataflow analyses flowStateGuid — the technical state of the returned dataflow view
Manta Flow Viewer	^{flow_vis_contractionEvent}	This action is logged when the result of a data lineage analysis is too big to be visualized in Manta Flow Viewer and has to be contracted.	message — a message describing how the data flow had to be contracted
Manta Flow Viewer	^{flow_vis_aggEdgesIssue}	This action is logged when the result of a data lineage analysis contains too many aggregate edges to be visualized in Manta Flow Viewer and, as a result, the aggregate edges have to be removed.	N/A
Manta Flow Viewer	^{flow_vis_sourceCode}	This action is logged when the user views the content of any source script in the Manta Flow Viewer application.	node — the node for which the source code is shown resource — resource of the node for which the source code is shown flowStateGuid — the technical state of the returned dataflow view
Manta Flow Viewer	^{flow_vis_permaLink}	This action is logged when the user generates a permalink for a specific data lineage visualization in the Manta Flow Viewer application.	flowStateGuid — the technical state of the returned dataflow view
Manta Flow Viewer	^{flow_vis_exportCsv}	This action is logged when the user exports the result of a data lineage analysis to a CSV. This export can be triggered either from the main screen or from the data lineage visualization screen of the Manta Flow Viewer application.	flowStateGuid — the technical state of the returned dataflow view
Manta Flow Viewer	^{flow_vis_exportPng}	This action is logged when the user exports a specific data lineage diagram to a PNG file. This export can only be triggered from the data lineage visualization screen of the Manta Flow Viewer application.	flowStateGuid — the technical state of the returned dataflow view
Manta Flow Viewer	^{flow_vis_exportDirect}	This action is logged when the user executes the analysis and export of the data lineage directly from the main screen of the Manta Flow Viewer application. (The lineage is not visualized in Manta Flow Viewer in this case.)	The params for this action are the same as for `flow_vis_refView` action.
Manta Flow Merger	^{flow_revision_new}	This action is logged whenever a new (major or minor) revision is created in the Manta Flow Server repository.	revision — the revision number of the newly created revision
Manta Flow Merger	^{flow_revision_commit}	This action is logged whenever an opened (major or minor) revision is committed in the Manta Flow Server repository.	revision — the revision number of the committed revision
Manta Flow Merger	^{flow_revision_rollback}	This action is logged whenever an opened (major or minor) revision is rolled back in the Manta Flow Server repository.	revision — the revision number of the rolled back revision result — result of the rollback operation vertexActionMap — map with operations performed over nodes edgeActionMap — map with operations performed over edges
Manta Flow Merger	^{flow_revision_pruneTo}	This action is logged whenever the content of the Manta Flow Server repository is pruned from the oldest revision to a specific (newer) revision.	perservedRevisionCount — number of revisions that were preserved by the prune operation oldestCommittedRevision — the oldest revision that was preserved by the prune operation latestCommittedRevision — the latest revision that was preserved by the prune operation result — result of the prune operation vertexActionMap — map with operations performed over nodes edgeActionMap — map with operations performed over edges
Manta Flow Merger	^{flow_revision_pruneOldest}	This action is logged whenever the content of the Manta Flow Server repository is pruned and only a specified number of latest revisions is preserved.	The params for this action are the same as for the `flow_revision_pruneOldest` action.
Manta Flow Merger	^{flow_repository_truncate}	This action is logged whenever all the content of the Manta Flow Server repository is truncated.	N/A
Manta Flow Merger	^{flow_repository_content}	This action is logged whenever the Collect Statistics scenario is executed.	layers — number of layer types stored in the Manta Flow Server repository resources — number of resource types stored in the Manta Flow Server repository nodes — number of nodes per type stored in the Manta Flow Server repository edges — number of edges per type stored in the Manta Flow Server repository attributes — number of attributes stored in the Manta Flow Server repository revision — revision number for which the statistics are counted
Manta Flow Merger	^{flow_repository_backLinks}	This action is logged whenever the backlink phase of the repository postprocessing scenario is executed for a specified Manta resource.	revisionInterval — the interval of revisions in which the operation is executed backLinks — number of created backlinks
Manta Flow Merger	^{flow_repository_unification}	This action is logged whenever the unification phase of the repository postprocessing scenario is executed.	resourceName — the name of the resource for which the was operation executed sources — predicates used for identification of sources that should be unified targets — predicates used for identification of targets that should be unified caseInsensitive — flag whether to unify nodes without regard to their case forceMergeSources — flag whether the unification of sources should be done even if there are more targets or no targets at all forceMergeTargets — flag whether targets should be unified even if there are more of them result unifiedObjects — number of unified objects vertexMap — map of counts of unified nodes per node type edgeMap — map of counts of unified edges per edge type time — the time needed for the unification
Manta Flow Merger	^{flow_repository_edgePropagate}	This action is logged whenever the edge propagation phase of the repository postprocessing scenario is executed.	revision — revision in which the edges are propagated
Manta Flow Merger	^{flow_repository_contraction}	This action is logged whenever the contraction phase of the repository postprocessing scenario is executed.	result vertexMap — map of counts of contracted nodes per node type edgeMap — map of counts of contracted edges per edge type
Manta Flow Merger	^{flow_repository_interpolation}	This action is logged whenever the lineage interpolation phase of the repository postprocessing scenario is executed.	result interpolatedEdgeMap — map of counts of interpolated edges per edge type skippedEdgeMap — map of counts of skipped edges per edge type addedTransformationVertexMap — map of counts of new transformation nodes per node type skippedTransformationVertexMap — map of counts of skipped transformation nodes per node type errorTransformationVertexMap — map of counts of failed attempts for the creation of new transformation nodes per node type
Manta Flow Exporter	^{flow_repository_export}	This action is logged whenever an export of the whole Manta Flow Server repository is executed.	revision — the revision in which the export is performed vertices — map of counts of exported nodes per node type edges — map of counts of exported edges per edge type