The analysis process of the data
Four analyzes are provided by the Connectivity Model application that ensures that the required data is made available.
The four analyzes are:
- Load based meter phase analysis
- Voltage based meter phase analysis
- Voltage with SCADA based meter phase analysis
- Lateral transformer phase analysis
Log files and the Analysis result
The log files are created on the Jupyter node under the directory of
/home/<utility>/cm/logs/ once the scripts are run. Each type of analysis and
persistence has its own sub-directory to keep its log file. The image shows the corresponding
sub-directories.
Figure 1. Sample log file directory structure
Each sub-directory name includes two parts: the timestamp and type.
You can check all the analysis results on HDFS: hdfs://user/<utility_id>/cm/<JOB_ID>/data/<type>
The following image shows the directory structure for the utility_id with JOB_ID
of utility_id_sample_job.
Figure 2. The directory structure on HDFS
The format of the analysis result for load, voltage and voltage with SCADA is described in the table:
| Column name | Type | Description |
|---|---|---|
| feeder | String | ID of the feeder |
| meter | String | The ID of the meter |
| analysis_time | Timestamp | The timestamp when the analysis was run. |
| phase | Integer | The phase of the meter |
| confidence | Double | The confidence value |
The format of the analysis result for a lateral transformer phase is described in the
table:
| Column name | Type | Description |
|---|---|---|
| feeder | String | ID of the feeder. |
| lateral | String | ID of the lateral. |
| transformer | String | ID of the transformer |
| analysis_time | Timestamp | The timestamp when the analysis was run. |
| lateral_phase | Integer | The phase of the lateral. |
| transformer_phase | Integer | The phase of the transformer. |
| phase_match | Boolean | If the phase is matched or not. |