• bigdata79SOURCE

    24th Mar `
    The past few years have witnessed the rise of Big Data to almost epic proportions. Along with Big Data, we also saw the rise of Data Science and saw the Data Scientist’s job become one of the most coveted profiles in 2015. Businesses continue to invest in Big Data and Big Data products, modernize data platforms and help employees derive more value from data. That being said it is also true that most Big Data projects today cost too much and take too long to get completed and are not quite delivering ROI.

    Dr. David Johnston, Lead Data Scientist, ThoughtWorks blames this inability to deliver to the lack of critical insights that stem from “insufficient attention given to data science skills and overemphasis on infrastructure”. He quite rightly says, that while the companies have the right set of tools, they lack the ideas and the skill or talent to use those tools optimally. He highlights that more than the tools and the technology it is the lack of talent and their inexperience that keeps data science teams from exploiting their full potential by integrating data science into complete software applications. Here’s a look at what should be done to resolve this problem:

    Focus on agile

    Agile is important. Building iteratively and only what is required at the time save costs and enables flexibility. Big Data products too need to enable agility and have to move away from being “inflexible systems suited only for scaling up systems whose idea development is nearly completed”.

    Big data is important but so is small data

    Since the focus is on a scalable environment, you need to learn to extract small amounts of valuable information from larger data sets by compression, sampling, employing variable selection etc. to understand the kind of scaling that may be required in the future. By working on small data initially, data scientists can assess what kind of technology they will require and only then make a technology investment.

    Get the right talent – if you don’t have it hire it

    Many companies still expect less experienced data analysts or software developers to do the job of a data scientist. Since data has become too large and too complex, companies need expert data scientists who can create and use advanced data algorithms to add value to a Big Data platform. Naturally I believe that in the absence of a qualified data science team, it makes sense to get a high-level data science consultant on board to develop high-level strategies around data for a positive business impact and to help your team understand how to become more efficient and effective.

    The true and complete potential of Big Data can only be realized when companies put in as much effort into hiring data scientists ( as permanent employees or consultants) and treat them as an equally important investment as they do in the Big Data infrastructure. After all, it is the data scientist who will ensure that your data initiatives get off on the right foot.

    Originally appeared on Linkedin.

    – See more at: http://bigdata-madesimple.com/the-big-data-bang-why-data-science-and-big-data-need-to-become-best-buddies/#sthash.AtJErYA4.dpuf

     
     

    No comments

    Be the first one to leave a comment.

    Post a Comment


     

     

    Latest Posts

    2017 Update on obstetrics

    These experts discuss the practical clinical implications of new society recommendations for antenatal steroid administration, low-dose aspirin for preeclampsia prevention,... Read more →

    Latest Video

     
     

    LATEST POSTS

    Glaucoma gene therapy on positive trajectory using CRISPR-Cas9

    SOURCE May 02, 2016 Seattle—Results from a series of preclinical studies are providing proof of principle that gene targeting using…

    Mark Bertolini: The new definition of Quality in Healthcare is Convenience

      “… in studying the healthcare system we know one thing: the cheapest place to provide care is in the…

    Gentle Bot: 3D printing a robot with feelings

      3D printing is enabling strong advances in the field of soft robotics. New research from Cornell University has created robotic hands…

    Multiregional brain on a chip

     SOURCE (Nanowerk News) Harvard University researchers have developed a multiregional brain-on-a-chip that models the connectivity between three distinct regions of…

    2017 Update on obstetrics

    These experts discuss the practical clinical implications of new society recommendations for antenatal steroid administration, low-dose aspirin for preeclampsia prevention,…

    Stem cells grow cartilage to fix hips

    A 3D scaffold has been molded into the precise shape of a hip joint. The scaffold is covered with cartilage…

    Tool predicts if prostate cancer will return after surgery

    SOURCE A tool that analyzes the expression patterns of four genes might help doctors predict if prostate cancer will reoccur…

    New way of imaging eyes could spot glaucoma sooner

    SOURCE A new imaging technique has given researchers the first look at individual cells at the back of the eye…