Top 20 Big Data jobs and their responsibilities
September 9, 2014
Big Data is spending much excitement in the IT job market worldwide and according to Gartner, by 2015, 4.4 million IT jobs globally will be created to support big data, generating 1.9 million IT jobs in the United States alone. Check out our list of top 20 Big Data jobs and their responsibilities.
Chief Data Officer
a. Work with executives, data owners, and data stewards to achieve data accuracy and process requirement goals for all internal and external customers and create data management strategies.
b. Spearhead the data management activities performed by the EIM program, the business data stewards, and data service providers.
c. Establish data policies, standards, organization, and enforcement of EIM concepts as established by the organization.
d. Oversee the monitoring of data quality efforts within the organization and provides a central authority for the resolution on data management issues that cannot be resolved by the data governance council.
e. Establish data vendor management strategy and provide oversight to support implementation by the EIM program and coordinates with the IT organization through the CIO/CTO.
f. Lead the creation of program business definitions and data management goals and principles for execution by the EIM program.
g. Responsible for enterprise information/data management budget and data-related systems initiatives. @SOURCE
a. Coordinate with customers and staff and provide support to all data analysis.
b. Perform data analysis on all results and prepare presentations for clients.
c. Perform audit on data and resolve business related issues for customer base.
d. Coordinate with engineering and product management team and ensure accuracy on all deliverables and prepare summaries.
e. Perform data analysis and facilitate in delivery to all end users.
f. Supervise all client issues and coordinate with managers and supervisors and facilitate in deliverables.
g. Monitor and organize all client invoices and perform all timely assessment for all payment issues.
h. Administer all data for customer invoices and provide company metrics.
i. Monitor and resolve all customer invoice data issues and coordinate with various vendors and manage all previous balance.
j. Organize all consumption anomalies and determine defects for data and prepare appropriate resolutions.
k. Supervise process management tools and ensure compliance to all cycle guidelines.
l. Maintain and document library of invoices and resolve all issues in same.
m. Perform internal audit and prepare all invoices and determine quality improvement processes. @SOURCE
Big Data Visualizer
a. Provide value-add analysis to Business through use of visualization software to guide analysis, drawing implications from analysis, and synthesizing into clear communications.
b. Understand how data flows within various systems to provide input on requirements for databases to ensure data is organized properly for reporting/analytics.
c. Work closely with Data Quality teams to ensure data integrity & completeness.
d. Develop business requirements to drive functional specifications for reporting applications.
e. Work with business and cross-functional teams to thoroughly document reporting processes and systems.
f. The acquisition, management, and documentation of data (including geo-spatial data).
g. Work with clients / client service teams to plan and carry out data analyses.
h. Participate in proposal writing, client deliverables and research papers.
i. Create visualizations from data / GIS data analysis for inclusion in proposals, reports, papers and multi-media projects. @SOURCE
Big Data Solutions Architect
a. Guide the full lifecycle of a Hadoop solution, including requirements analysis, platform selection, technical architecture design, application design and development, testing, and deployment.
b. Provide technical and managerial leadership in a team that designs and develops path breaking large-scale cluster data processing systems.
c. Help Xtremeinsights customers develop strategies that maximize the value of their data.
d. Help Xtremeinsights establish thought leadership in the big data space by contributing white-papers, technical commentary to the community. @SOURCE
Big Data Engineer
a. Gather and process raw data at scale (including writing scripts, web scraping, calling APIs, write SQL queries, etc.).
b. Work closely with our engineering team to integrate your amazing innovations and algorithms into our production systems.
c. Process unstructured data into a form suitable for analysis – and then do the analysis.
d. Support business decisions with ad hoc analysis as needed. @SOURCE
Big Data Researcher
a. Extract data from a variety of relational databases, manipulate, explore data using quantitative, statistical and visualization tools
b. Inform the selection of appropriate modeling techniques to ensure that predictive models are developed using rigorous statistical processes
c. Establish and maintain effective processes for validating and updating predictive models
d. Analyze, model, and forecast health service utilization patterns/ trends and create capability to model outcomes of what-if scenarios for novel health care delivery models
e. Collaborate with internal business, analytics and data strategy partners to improve efficiency and increase applicability of predictive models into the core software products
f. Help manage the innovation cycle of conducting analyses, generating insights, advocating for integration of new concepts into existing client tools, helping to translate ad-hoc analyses into scalable software solutions. @SOURCE
Data warehouse manager
a. Develop and implement information management strategies.
b. Coordinate and manage information management solutions.
c. Scope, plan, and prioritize multiple projects.
d. Manage all aspects of the warehouses such as data sourcing, migration, quality, design, and implementation. @SOURCE
a. Design database, data models, ETL processes, data warehouse applications and business intelligence (BI) reports through the use of best practices and tools, including SQL, SSIS, SSRS and OLAP.
b. Deliver high quality (DA) related outcomes including ETL processes, data warehouse designs and data system enhancements in accordance with existing standards and guidelines.
c. Resolve routine (DA) related issues with business analysts and technology teams by providing advice on data warehousing methods and approaches.
d. Analyze (DA) related business needs, works with project staff to make decisions and recommendations on the future of (DA) developments. @SOURCE
a. Improve the effectiveness of the database tools and services
b. Ensure all the data complies with legal regulations
c. Make sure the information is protected and backed-up
d. Regular reporting to the teams you work with
e. Monitor database performance
f. Improve the technology used
g. Build new databases
h. Monitor data entry procedures
i. Troubleshooting @SOURCE
Business intelligence analyst
a. Disseminate information regarding tools, reports, or metadata enhancements.
b. Conduct or coordinate tests to ensure that intelligence is consistent with defined needs.
c. Identify or monitor current and potential customers, using business intelligence tools.
d. Synthesize current business intelligence or trend data to support recommendations for action.
e. Maintain or update business intelligence tools, databases, dashboards, systems, or methods.
f. Manage timely flow of business intelligence information to users. @SOURCE
Data warehouse analyst
a. Understand the business users’ requirements for information and communicate them to the rest of the data warehouse team
b. Lead and conduct interviewing task
c. Lead interview documentation
d. Assist DW data analyst in analyzing existing reports and identifying iteration metrics
e. Lead preparation of data warehouse requirements document
f. Assist data analyst in mapping task
g. Analyze existing reports
h. Lead the identification and documentation of business metrics
i. Determine systems of record with the assistance of appropriate source system experts
j. Help identify potential sources of data for the data warehouse
k. Oversee testing of data acquisition processes and their implementation into production
l. Act as consultant to the ETL and front-end programmers @SOURCE
a. Develop best practices for standard naming conventions and coding practices to ensure consistency of data models.
b. Recommend opportunities for reuse of data models in new environments.
c. Perform reverse engineering of physical data models from databases and SQL scripts.
d. Evaluate data models and physical databases for variances and discrepancies.
e. Validate business data objects for accuracy and completeness.
f. Analyze data-related system integration challenges and propose appropriate solutions.
g. Develop data models according to company standards.
h. Guide System Analysts, Engineers, Programmers and others on project limitations and capabilities, performance requirements and interfaces.
i. Review modifications to existing software to improve efficiency and performance. @SOURCE
a. Design, develop and implement database systems based on customer requirements.
b. Optimize database systems for performance efficiency.
c. Prepare design specifications and functional documentations for assigned database projects.
d. Perform space management and capacity planning for database systems.
e. Develop database tables and dictionaries
f. Participate in database design and architecture to support application development projects.
g. Perform data back-up and archival on regular basis.
h. Test databases and perform bug fixes.
i. Troubleshoot database related issues in a timely fashion.
j. Develop security procedures to protect databases from unauthorized usage.
k. Evaluate existing database and recommend improvements for performance efficiency.
l. Develop best practices for database design and development activities @SOURCE
a. Develop all portal layout and maintain functionality of all site.
b. Supervise content for all pages and provide assistance to all personnel and external organizations.
c. Integrate new technology system into portal and coordinate with web administrator.
d. Maintain status for all portal projects and assist to resolve all issues for new and existing channels and automate all processes.
e. Perform tests on all configuration and upgrade processes and achieve all ITS objectives and maintain knowledge on new technology for all portal environment.
f. Determine all long term objectives for site and recommend enhancements to all content according to guideline.
g. Maintain an efficient portal documentation system and assist in installation of all Web Center Interaction systems.
h. Analyze all system upgrade and applications and ensure compliance to all program requirements and design all solutions for new portal and assist to resolve all production issues.
i. Monitor and analyze all system metrics and maintain optimal performance for all portals.
j. Coordinate with administrators and community members to implement all operational activities and determine all web server configurations.
k. Manage and configure all custom portal applications.
l. Maintain knowledge of all portal marketplace and continuous changes in industries.
m. Provide support to all business operations and ensure optimization of all profits. @SOURCE
a. Select right hardware and software
b. Manage data security and privacy
c. Manage Data Integrity
d. Data backup
e. Database recovery
f. Tune database performance
g. Improve query processing performance @SOURCE
Chief Data Analyst
a. Develop new analytical projects as part of the Foundation’s overall research programmer
b. Provide technical input into the development of research projects led by other members of the team
c. Collect, prepare and link large survey datasets for analysis
d. Conduct statistical analysis using Excel, SPSS and/or STATA and using advanced techniques when appropriate.
e. Build the Foundation’s growing network of policy experts, relevant stakeholders and academics @SOURCE
Business System Analyst
a. Determine operational objectives by studying business functions; gathering information; evaluating output requirements and formats.
b. Design new computer programs by analyzing requirements; constructing workflow charts and diagrams; studying system capabilities; writing specifications.
c. Improve systems by studying current practices; designing modifications.
d. Recommend controls by identifying problems; writing improved procedures.
e. Define project requirements by identifying project milestones, phases, and elements; forming project team; establishing project budget. @SOURCE
Data mining analyst
a. Perform statistical analysis to prioritize which accounts should be worked in order to maximize success
b. Identify areas for improvement, communicating action plans to supervisor or client
c. Perform strategic data analysis and research to support business needs
d. Identify opportunities to improve productivity via sophisticated statistical modeling
e. Explore data to identify opportunities to improve business results
f. Develop understanding of business processes, goals and strategy in order to provide analysis and interpretation to management
g. Gain understanding of business needs and necessary analysis where appropriate through internal discussion. @SOURCE
a. Define Big Data strategy, including designing multi-phased implementation roadmaps
b. Work independently, or as part of a team, to design and develop Big Data solutions
c. Data wrangling of heterogeneous data and explore and discover new insights
d. Lead analysis, architecture, design, and development of data warehouse and business intelligence solutions
e. Mentor junior team members
f. Assist business development teams with pre-sales activities and RFPs
g. Help estimate and plan projects @SOURCE
Business Data Analyst
a. Work closely with key business stakeholders, analysts and senior management to understand their business strategy and questions, identify research needs, help design experiments and make recommendations based on results.
b. Influence decisions through the development and application of customer segmentation derived from multiple sources both quantitative and qualitative.
c. Align stakeholders and analysts on a prioritized view of how to use research and analytics to support business initiatives and strategy (analytics roadmaps)
d. Drives complex analytics projects requiring multiple-team collaboration among analysts or stakeholders from beginning to end
e. Effectively manage multiple on-going projects, ensuring objectives and timelines are met. Identify short and long term trade-offs and balance the needs of all stakeholders.
f. Lead and participate in business discussions, providing an informed point of view and advocating for change when needed.
g. Drives discussion of key metrics with interpretation, hypothesizes and proposes actions
h. Partners with business stakeholders in framing and prioritizing business questions considering both short and long potential impact, interprets findings, quantifies opportunities, and proposes actions with a point of view Partner with data experts to execute analyses.
i. Proactively bring new business opportunities to the attention of business leaders.
j. Mentors analysts and stakeholders on subject matter knowledge and processes to ensure that they are repeatable, sustainable and scalable.
k. Collaborate with many teams across Intuit at all levels. @SOURCE