Many of us trust our gut feeling implicitly.
We have all been there when something didn’t feel right but done it anyway. There was nothing obvious to suggest that it was a bad idea. Yet, when it turns out to be a disaster we wonder why we didn’t listen to that gentle little voice: “don’t do it.”
It seems that our gut feel is some magical force, but actually, it is an accumulation of thousands of tiny past moments, all informing our current situation. You could say that gut feel is a personification of Big Data – you can’t always explain it, but you sense that there is great wisdom to be gained from listening to it.
This understanding is crucial to any data scientist seeking to influence their colleagues. They might view the data as being cold and clinical, preferring to rely on their own intuition, but in actual fact, their intuition is based on their own internal data. The difference is that Big Data can reference infinitely more external data than a human mind could ever process. If we see the capabilities of Big Data, its powers of intuition are far greater than any human.
We simply have to use it in …