STFC Hartree Centre & Emerging Technology at IEEE Vehicular Technology Conference

Share this post:

Supported by the Hartree Centre’s Innovation Return on Research programme – Emerging Technology and colleagues from the STFC Hartree Centre have been working to contextualise the driving environment, fusing multiple data sources together to allow vehicles to make intelligent decisions. This work was recently presented at the IEEE VTS Vehicular Technology Conference in Porto, Portugal alongside other driver assistance technologies.

The paper outlines a data fusion approach, utilising an agile ontology modelling framework called Controlled English (CE) – developed by Emerging Technology in our recent NIS-ITA research programme. CE provides the capability to unify the information space of the driving environment, by specifying domain models, facts and rules using a restricted subset of natural language. For example, in this project we have represented Paxion’s Mental Workload and Driving model in CE to allow a machine (or in this case a vehicle) to evaluate the model and answer questions in a similar manner to a human. As Paxion outlines, driver performance is affected by cognitive load, which is affected by scene complexity and different scenes contain different features such as road type, road curvature and traffic flow.

To enable a vehicle to reason and make decisions in a similar manner to a human, we apply data sources to the CE model and use the Hudson capability for querying a CE Store. Using publically available Open Street Map (OSM) data for the UK, we have extracted various static road features, including roundabouts, traffic signals, pedestrian crossings, inclines and declines, road type and road curvature. These features are modelled in CE and therefore allow high level natural language questions to be asked, such as “Show me all the roundabouts and curvy roads in Winchester”, “Show me areas of high cognitive load between Hursley and Winchester” and “Which features in Winchester are likely to lead to poor driving performance?”


Here you can see residential roads and road segments with high curvature have been extracted for the city of Winchester as these are features of a highly complex scene that (because of Paxion’s model) we can infer to represent features of high cognitive load and therefore features likely to lead to poor driving performance.


We have also extracted dynamic features of the road network, by applying deep learning techniques to on-board vehicle dash cam’s and Road Side Units (RSU’s) to detect traffic flow and the presence of moving or stationary vehicles surrounding the test vehicle.



Contextualising the driving environment by fusing together multiple data sets as well as representing theoretical models of the driving environment allows us to build an intelligent decision making system for vehicles.


Our paper is due to be published on IEEE Xplore in the coming months.

More Innovation stories

Fully automatic method for robust age progression

In Emerging Technology, we are constantly working on new research projects around security and biometrics. Since late last year, I spent some time researching age progression related problems using biometrics. One of the interesting problems with age progression was to create age progressed images with occlusions and in different age gaps for face subjects of […]

Continue reading

IBM Emerging Technologies UK wins TechConnect 2016

This year IBM Emerging Technologies UK submitted 10 out of 86 entries for TechConnect. TechConnect is a Europe wide internal IBM annual competition for individuals showcasing their work to senior technical leaders and decision makers. This years winning entry, “Showcasing our academic research”, was one of the entries from the UK Emerging Technology Team. It is a web application […]

Continue reading

BBC Make It Digital – Showing off our research

The BBC Make It Digital tour is all about digital creativity and aims to inform and inspire people around the UK, both children and adults alike. When the tour visited Cardiff as part of the Harbour Festival I was delighted that Cardiff University would be showcasing “SHERLOCK”, a new kind of digital assistant that is […]

Continue reading