CSV file names and data are for different time zones

The following examples show how to configure Predictive Insights when the time stamps in the file names and data represent different time zones.

Example 1: Time zone shown in CSV file names but not in data

In this example:
  • the time stamp for the CSV source files is in EST as shown in the file name
  • the time stamps for the data within the file are known to be in GMT but the time zone is not shown.
File name:

CPULOAD_2013-07-17-00-00EST_2013-07-17-00-15EST.csv

Data:

EndTime,Resource,In_TotalBytes,Out_TotalBytes
2013-07-17-05-00,"ethernet-csv785.tut.com_GigabitEtherenet2", 3263768830,9545496800
Configuration in Predictive Insights:

To configure Predictive Insights for the time stamps used in the example:

When you add the file system data source in the Mediation tool, set the following fields:

  • In the Name Pattern field, enter : ([a-zA-Z]\w*)_(\d{4}-\d{2}-\d{2}-\d{2}-\d{2}\w{3})_(\d{4}-\d{2}-\d{2}-\d{2}-\d{2}\w{3}).*\.csv
  • In the Time Format field, enter: yyyy-MM-dd-HH-mmz. The z at the end of the field indicates that the last 3 characters of the file name are a time zone identifier
  • In the Time Zone field, set the time zone to Europe/London - Greenwich Mean Time. When the time stamps in the file name and data represent different time zones and the time zone is specified in only one of the time stamps, you set this field to the time zone that is not specified in the time stamp. In this example, the time stamps in the data are in GMT but the time zone is not specified in the time stamp, so you set the timezone to GMT.

Example 2: Time zone shown in data but not in CSV file names

In this example,
  • the time stamp in the file name is known to represent EST but the time zone information is not shown in the file name.
  • the time stamp in the data is in GMT and time zone is included in the time stamp

File name:

CPULOAD_2015-07-17-00-00_2015-07-17-00-15.csv

Data:

EndTime,Resource,In_TotalBytes,Out_TotalBytes
2013-07-17-05-00+0000,"ethernet-csv785.tut.com_GigabitEtherenet2",3263768830,9545496800

Configuration in Predictive Insights:

To configure Predictive Insights for this example, do the following:

In the Mediation tool's File System Details tab, do the following:

  • In the Name Pattern field, enter: ([a-zA-Z]\w*)_(\d{4}-\d{2}-\d{2}-\d{2}-\d{2})_(\d{4}-\d{2}-\d{2}-\d{2}-\d{2}).*\.csv

  • In the Time Format field, enter: yyyy-MM-dd-HH-mm.

  • In the Time Zone field, set the time zone to America/New_York - Eastern Standard Time. When the time stamps in the file name and data represent different time zones and the time zone is specified in only one of the time stamps, you set this field to the time zone that is not specified in the time stamp. In this example, the time zone in the file name is not specified but is known to represent EST, so you set the timezone to America/New_York - Eastern Standard Time.
In the Mediation tool's Model Properties tab, do the following:
  • In the Model Objects pane, expand the metric group and click Timestamp.
  • In the Model Object Properties pane, enter the following value in the Time Format field: yyyy-MM-dd-HH-mmZ. The Z at the end of the field indicates that the time stamps in the data end with the time zone specified in the RFC 822 4-digit format.

Example 3: Time zone shown in both the CSV file name and data

In this example,
  • the time stamp in the file name shows the EST time zone.
  • the time stamp in the data shows the GMT time zone

File name:

CPULOAD_2013-07-17-00-00EST_2013-07-17-00-15EST.csv

Data:

EndTime,Resource,In_TotalBytes,Out_TotalBytes
2013-07-17-05-00GMT,"ethernet-csv785.tut.com_GigabitEtherenet2",3263768830,9545496800

Configuration in Predictive Insights:

To configure Predictive Insights for this example, do the following:

In the Mediation tool's File System Details tab, do the following:

  • In the Name Pattern field, enter: ([a-zA-Z]\w*)_(\d{4}-\d{2}-\d{2}-\d{2}-\d{2}\w{3})_(\d{4}-\d{2}-\d{2}-\d{2}-\d{2}\w{3}).*\.csv

  • In the Time Format, field enter: yyyy-MM-dd-HH-mmz. The z at the end of the field indicates that the last 3 characters of the file name are a time zone identifier

  • In the Time Zone field, set the time zone to America/New_York - Eastern Standard Time. When different time zones are explicitly shown in the file name and data, set the time zone to that shown in the file name.
In the Mediation tool's Model Properties tab, do the following:
  • In the Model Objects pane, expand the metric group and click Timestamp.
  • In the Model Object Properties pane, enter the following value in the Time Format field: yyyy-MM-dd-HH-mmz. The z at the end of the field indicates that the time stamps in the data end with the time zone specified in the General time zone format.