Big Data ≧ Data + Questions + Algorithmic Knowledge + Commitment + Collaboration – Part II

Many big data activities fail on establishing necessary preconditions for success. For companies the main challenge in applying big data is to ask the right questions. In science the main challenges are the access to data and the collaboration across disciplines.

Read Part I of this article

In search for skills and sharing
Having enough data and proper questions is good, and for many companies it is good enough, but not for all and sure not for more advanced scientific research. In many situations applicants of big data need deep algorithmic knowledge, lots of practical knowhow, and advanced tools. At least, they should understand how they can use techniques from data science to work with data of mixed quality, how they can eliminate bias from data, and how they can focus on the relevant dimensions in high dimensional data spaces. They should know in which cases under which conditions there are tools and experts to help them with these and other challenges. I.e., they should be clearly aware of the potential (and the limitations) of the contemporary algorithmic machinery and include it into their projects whenever needed, possibly through external contributors.

Because the wide range of necessary expertise, in practical settings applied data science often relies on the results of many people/teams. For good reason it is preferably performed jointly by a multidisciplinary team (of teams) combining many different competencies and cultures. This brings us to the potentially biggest challenge of big data, the dramatically growing importance of cross-disciplinary collaboration. In the above example of big data in healthcare research the team (of teams) may include more than half a dozen disciplines from clinical specialists to pure mathematicians. Clinical doctors may thus end up counting Brownian motion paths – or at least they will have to judge on the relevance of the results of such a counting. In such settings, it is critical that the cross-disciplinary collaboration works.

Cross-disciplinary collaboration is always tough. There is ample evidence that collaboration fails if it relies on interfaces. Instead it is necessary that the flow of results among the various disciplinary experts/teams is nurtured by domains of shared knowledge. One very basic technique to establish these domains is to exploit a series of boundary objects.

Anything goes: coaches and change
All the above does not sound like good times for consultants. Managers have to ask their questions themselves, advanced mathematics is needed, and experts have to establish/build domains of shared knowledge – what are then consultants good for?? Well they are needed – urgently needed – as coaches for individuals in big data ventures and as life cycle managers for the boundary objects. Some of them may even ascend to team (of teams) coaches if they are willing to take responsibility for the outcome of big data ventures. We do need team coaches that combine an integrative understanding of many disciplines in renaissance style with contemporary high performance leadership qualities as we know them from sports teams, or music ensembles, respectively.

Beyond buzzwords and sales speeches big data is big mess that needs artistic inspiration. It is like going down the bullshit creek without a paddle in order to compose a piece of music. This image does not make sense to you? Well, the same holds for many big data ventures – but in some of them the image does make sense. When big data becomes a tool to save a human life, the discussion about hype or not loses its meaning. It then becomes clear that we need both(!) knowledge and knowhow and that an excellent scientific education is very helpful for orientation purposes.

Big data truly is anything goes in the sense of Paul Feyerabend. That means, that projects have to fit their methods to the case and probably adapt during runtime. Of course, scientifically speaking, that is forbidden in many disciplines – and it is exactly this “crime” against scientific rules which provides the true thrill of big data projects. The greatest of them courageously leave established disciplinary grounds to discover new land. However, if they move too far away from known grounds, they may also drown in the sea of their own, data generated fictions. The list of childish confessions of faith in data science is already a long one indeed.

There all kinds of big data projects pursuing very different tasks – from very trivial to absolutely impossible ones. But for the more challenging of them, the inequality in the title holds: Big Data ≧ Data + Questions + Algorithmic Knowledge + Commitment + Collaboration. Thereby “≧” should be read as “is more than just”, the difference being a great idea, good luck, and further ingredients (like a broad scientific education). Great ideas and luck cannot be enforced. The better you know a domain, the more likely is that you understand meaning and relevance of a new idea (and thus can exploit it), but the less likely is that you have one that is really new. So a proper mix of expertise and talents and a true commitment to collaboration remain the bottom line of big success with big data.

AUTOR/AUTORIN: Reinhard Riedl

Prof. Dr. Reinhard Riedl ist Dozent am Institut Digital Technology Management der BFH Wirtschaft. Er engagiert sich in vielen Organisationen und ist u.a. Vizepräsident des Schweizer E-Government Symposium sowie Mitglied des Steuerungsausschuss von TA-Swiss. Zudem ist er u.a. Vorstandsmitglied von, Praevenire - Verein zur Optimierung der solidarischen Gesundheitsversorgung (Österreich) und

PDF erstellen

Ähnliche Beiträge

Es wurden leider keine ähnlichen Beiträge gefunden.

3 Kommentare
  1. TopBoosterSEO
    TopBoosterSEO sagte:

    I have to state some thanks to you for bailing me out of this challenge. After scouting through the entire internet and sounding concepts which were maybe not powerful, I was considering my entire life was done. Living lacking the responses to the problems you have sorted out as a result of one’s article material is an essential event, as well as the kind that would have poorly ruined my entire job if I hadn’t encountered your blog. Much of your knowledge and kindness in controlling almost everything was precious. I am unsure what I might have performed if I had not encountered this type of matter like this. I could at this time anticipate my future. Thanks for your own time therefore much for your expert and effect focused help. I will not think twice to suggest your website to any individual who needs guidance about this subject. International Family Law

  2. zaid sarfaraz
    zaid sarfaraz sagte:

    Good website! I truly love how it is simple on my eyes and the data are well written. I am wondering how I could be notified whenever a new post has been made. I’ve subscribed to your RSS which must do the trick! Have a nice day! buy spotify plays

    SARAFARAZ sagte:

    I dont think Ive read anything like this before. So good to find somebody with some original thoughts on this subject. thank for starting this up. This website is something that is needed on the web, someone with a little originality. Good job for bringing something new to the internet! spotify reseller panel


Dein Kommentar

An Diskussion beteiligen?
Hinterlasse uns Deinen Kommentar!

Schreiben Sie einen Kommentar

Ihre E-Mail-Adresse wird nicht veröffentlicht. Erforderliche Felder sind mit * markiert