Defence & Intelligence

What’s Data Curation got to do with Defence?

Defence organisations are increasingly challenged by data.  Sensors become more complex and the Internet of Things together with social media brings an ever-increasing volume, variety and veracity of data, which must be processed at speed to derive the insights needed to maintain information superiority.

We describe data curation as integrating data, enriching it by aligning with other data, reclassifying the results and projecting this forward.

An example of curation in action is the analysis of spatio-temporal data shown in Figure 1 where four independent data sources are fused into a unified searchable big data store of pre-processed physical data. This is then made available on the cloud for industry specific analyses, supporting complex queries such as “find areas with a specific soil type, surface temperatures between 5 & 15 degrees Centigrade with easy access to transport hubs”.

Curation

Figure 1 – Analysing Spatio-temporal Data

One could argue that defence & intelligence organisations have been doing this for some time for example in tactical picture generation, track correlation and target identification – so what’s changed?

Now all industries have a common goal to make the most of data, so commercial research & development is focused on the curation challenge. These investments can be directly leveraged by the military in making the most use of the available data.

Intelligence analysts often spend some 80% of their time finding and organizing the data needed to complete their request for intelligence. This will get worse as ever increasingly capable sensors – such as NATO’s Allied Ground Surveillance system shown in Figure 2 come on line.   But this time can be minimized by effective data curation.

AGS2_large

Figure 2 – NATO Allied Ground Surveillance (AGS)  [Credits: NAGSMA.NATO.INT]

Curation can make the most of unreliable data sources, such as social media transactions. As an ever-increasing proportion of available data is of low veracity, military organisations cannot afford to ignore this if they want to maintain the quality of their intelligence product. Effective curation – through correlation with highly reliable data sources (a passport database for example) – will enable organisations to make the most use of this growing & freely available resource.

New technologies are emerging that are ideally suited to spotting patterns in massive amounts of data. Our work on Brain Inspired Computing (see this previous blog post) brings massive scale, low power, real time neural networks to assist with the curation challenge.


I’m very interested in a discussion on this topic.  Please leave me a comment, send me an e-mail or get in touch!

Director - Blockchain | National Security - CTO Team Europe

More stories

Does Taking the Long View Help?

Traditionally, U.S. federal agency plans last the length of a four-year presidential election cycle. But many challenges facing government are on a much longer cycle – such as building Defense weapon systems, adapting to climate change, and creating energy independence. In 1996, Congress mandated the Defense Department to conduct a “quadrennial defense review” (QDR) of […]

Continue reading

Defense Offsets – Obligation or Opportunity?

The Global Offsets and Countertrade Association (GOCA) conference just concluded in Montreal.  You may ask, “What is an offset and why is it important?”   Defense offset agreements are arrangements in which the seller of a product or service agrees to provide benefits such as buying local products or services from a country as an inducement […]

Continue reading

Predictive Maintenance – or, “Spend less, do more”

As a former submarine commanding officer and later as the US Navy admiral responsible for all submarine engineering, maintenance and certifications, I can assure you that I was a firm believer in making sure equipment worked correctly.  There was no margin for error, and the goal was always to make sure that the number of […]

Continue reading