I’ve been invited to do a short talk at a UK Trade and Industry event for investors in heat networks, giving an overview of innovation in the sector. This gives me an excuse to do some research and summarise it in this post – and also an opportunity to ask readers what I’ve missed.
Archive for the ‘machine learning’ Category
where’s the innovation in the district heat market?
Posted in Big Data, DECC, district heating, energy, engineering, machine learning, tagged SBRI on August 25, 2015| 1 Comment »
when it comes to data, make mine medium
Posted in machine learning, tagged Big Data, medium data on June 22, 2015| 1 Comment »
In the previous post, I gave some of the reasons why I hate Big Data. In this post, I’d like to talk about Big Data’s modest and more human cousin: medium data.
I’m sure someone out there has already coined the term and it’s acquired a particular definition in the argot of IT consultants. But at the time of writing it’s not yet in general use, so I’ll take the opportunity to appropriate the term “medium data” and tell you what it means to me.
why I hate Big Data
Posted in machine learning, tagged Big Data, DECC on June 15, 2015| 2 Comments »
There’s a lot of noise about Big Data, with much of it in the energy space. The rise of the Internet of Things, self-learning thermostats, the success of O-Power – all are linked to the generation and automated processing of massive datasets.
The hype machine promises that Big Data will solve all sorts of problems and make the world a better place.
But hype or no hype, personally I hate Big Data.
I can hear the sharp intake of breath at Guru’s PR company, who’ve done a great job getting press coverage for “Big Data” work that we’ve done for the Department for Energy and Climate Change. Bear with me guys, I’ll explain in this post.
First, a clarification of terms: there’s a tendency to refer to any large dataset as Big Data, even when it isn’t. If you’re not sure what Big Data is, here’s a nice background piece by Tim Harford, the FT’s undercover economist.
So what’s wrong with Big Data? Here are some examples: