Internet of Things

Storm in a log file: A one-man weather station

Share this post:

On February 7, 2009, scorching temperatures baked southeastern Australia, while a strong, northerly wind shaped a head-high swell rolling into the southern coast. The surf was excellent and I was thankful to cool off in the Southern Ocean waters near Melbourne, Victoria, but it was a different story inland, where more than 400 bushfires raged. “Black Saturday” as it came to be known, killed 173 people, and injured 414 – the worst bushfire disaster in Australia’s history. It also happened at the tail end of a 13-year drought and multiple El Niños. The drought severely strained water resources, decimated livestock, changed agricultural practices permanently, and demanded a plan for a weather-resilient nation. It steeled my resolve to complete my PhD in atmospheric science.

Storm in a Log File

I’ve also been developing a one-man show called “Storm in a Log File” (working title). At its essence, the show is a description of what happens inside a weather model, presented with the ubiquitous log file. I hope to describe the poetry of simulating real life, the elegance of merging one reality with another to create an expanded reflection of the present, and the truth that emerges from models, within models, within models. Watch this space…

While I became interested in atmospheric science because I wanted to predict the best time to surf (and I knew math and physics powered the “crystal ball” to make those predictions), today I work as an atmospheric scientist because I love the challenge of building systems that predict weather and water, helping people make the right decisions for the right reasons – even in places where you can’t surf.

I split my time between IBM Research with The Jefferson Project, The Weather Company with its Forecasting Sciences group, and as a Fellow at Science Sandbox @ New Lab in the Brooklyn Navy Yard, where I’m working on a project called Weather for the People.

World’s Smartest Lake

Over the last few years, our team at IBM Research, along with scientists at RPI, have been helping transform Lake George in upstate New York into “The World’s Smartest Lake” as part of The Jefferson Project. Fresh water environments, like Lake George, are facing unprecedented threats worldwide – from agricultural runoff and urban development, to road salt in winter. To help protect one of America’s most famous lakes, we’re building a new model for environmental monitoring and prediction, a blueprint to preserve other fresh water bodies – including rivers, estuaries and wetlands – around the globe. To do this, we use a suite of numerical models to simulate the physical environment at Lake George.

For my part, I lead the weather and land surface modeling for The Jefferson Project. This means my experimental weather forecasts, which run at a hyper-local resolution on a supercomputer (the horizontal resolution of each grid box is around 0.2 miles), must interact seamlessly with other numerical models for soil processes, hydrology, lake hydrodynamics, and lake chemistry and biology. This model stack is connected to an intelligent sensor network across the lake that provides critical observations for data assimilation and model calibration, along with predictions to help set the observation sampling strategy, ensuring we produce the most realistic predictions of changes to the lake, possible.

Weather for the People

While the Jefferson Project often has me out on a boat or platform in the middle of Lake George, my Weather for the People project has me on the island of Manhattan, and sometimes on rooftops all across New York City, installing DIY weather stations.

As a Fellow of Science Sandbox @ New Lab, the Weather for the People project’s goal is to reveal the beauty, and complexity of weather. If we want a society that can not only survive, but flourish through severe events like floods and droughts – and minimize the impacts of another “Black Saturday” – we need a society that understands how we generate weather information.

Towards this end, I’m installing weather stations around New York City, including at the Vice Media Headquarters in Brooklyn and on the roof of Ace Hotel (which has a stunning view of The Empire State Building). The weather stations are integrated into The Weather Company’s IoT platform via The Weather Underground, and I’m streaming this data live to a custom, but currently private website for the project, including time lapse videos from each location. It’s like a portal into NYC weather, where the winds are always changing.

Much of the work I do, be it for institutional projects like the Jefferson Project, or DIY projects like Weather for the People, relies on data from NOAA and NASA. Their foundational capabilities, including data, models and basic research, enable our research and operations to be cutting edge and globally competitive.

If you’d like to learn more about Weather for the People and the Science Sandbox @ New Lab Fellowship, you can visit my website for the Science Sandbox. For information on buying or building DIY weather stations, and installing and connecting them to Weather Underground’s Personal Weather Station network, visit Wunderground Weather Station.

Campbell Watson surfing at NLand Surf Park in Austin, TX (Image: Katharina Poblotzki)

Campbell Watson surfing at NLand Surf Park in Austin, TX. Read about his experience in Motherboard. (Image: Katharina Poblotzki)

More Internet of Things stories

We’ve moved! The IBM Research blog has a new home

In an effort better integrate the IBM Research blog with the IBM Research web experience, we have migrated to a new landing page:

Continue reading

Pushing the boundaries of human-AI interaction at IUI 2021

At the 2021 virtual edition of the ACM International Conference on Intelligent User Interfaces (IUI), researchers at IBM will present five full papers, two workshop papers, and two demos.

Continue reading

From HPC Consortium’s success to National Strategic Computing Reserve

Founded in March 2020 just as the pandemic’s wave was starting to wash over the world, the Consortium has brought together 43 members with supercomputing resources. Private and public enterprises, academia, government and technology companies, many of whom are typically rivals. “It is simply unprecedented,” said Dario Gil, Senior Vice President and Director of IBM Research, one of the founding organizations. “The outcomes we’ve achieved, the lessons we’ve learned, and the next steps we have to pursue are all the result of the collective efforts of these Consortium’s community.” The next step? Creating the National Strategic Computing Reserve to help the world be better prepared for future global emergencies.

Continue reading