Big Data jobs and careers

As the use of data in business gets more and more prevalent the ability to quickly and effectively produce data algorithms that can analyse large complex datasets is crucial. In order to do this, the right data infrastructure needs to be in place.

Why consider a career in Big Data?

Data Engineers build databases, data warehouses and data lakes to service the needs of the Data Analysts and Data Scientists in their businesses. This area is fast growing and Data Engineers are in massive demand as so many companies race to unlock the value in their data.

Typical role titles include

Data Engineer
Big Data Engineer
Data Developer
BI Engineer
BI Developer
Business Intelligence Developer
Business Intelligence Engineer
Big Data Developer
Hadoop Developer
Data factory Developer
Hadoop Engineer
Data Availability Engineer
Data Science Engineer
Big Data Software Engineer
Platform Engineer
Data Warehouse Engineer
DWH Engineer
DWH Programmer
DWH Developer
Datawarehouse Developer
Datawarehouse Engineer
Datawarehouse Programmer
SQL Server Engineer
Data Infrastructure Engineer
Data Infrastructure Programmer
Data Infrastructure Developer
Data Analytics Engineer
Big Data Architect
Hadoop Architect
Hadoop Specialist
Big Data Specialist
Big Data Lead
Head of Big Data
Data Architecture specialist
Head of Data Architecture

Career progression example

Junior Data Engineer
Data Engineer
Senior Data Engineer
Lead Data Engineer
Head of Data Engineering
Data Architect

Salary Benchmarks

At an entry level, junior/graduate Data Engineering professionals on average will be earning between £30k-£35k. At the mid-level you’d be looking to earn £50k-£60k and seniors would be looking to earn £70k+.

Is it right for me? The skills it takes…

The skills needed can be split into 3 categories; programming skills, data science understanding and problem-solving.

Programming skills: Java | Python | Golang | Cython | Software Design – A background in APIs e.g. web APIs and static/dynamic libraries | ML Libraries – e.g. TensorFlow, CNTK, MLib, Spark, Kafka, Kinesis, Redshift.

 What qualifications does it take?

A BSc, Masters (MSc) or Doctorate (PhD) in a maths, physics, statistics, artificial intelligence (AI), software engineering, engineering or computer science field with technical skills in programming. Demonstrable experience working with large data sets or alternatively candidates will work in Business Intelligence and then do online courses /self-learning/ get trained up on Big Data Engineering and Architecture and can move into these roles through this route.

Our Data, Insight & Analytics recruitment team

  • Principal Recruiter

    Data Platform & Architecture

    View profile

    Scott Rogers

  • Senior Recruiter

    Data, Insight & Analytics

    View profile

    Tegan Fenn

  • Recruiter

    Data Engineering, BI & MLOps

    View profile

    Izzy Martin

  • Head of Data

    Insight & Analytics

    View profile

    Alex Cosgrove

JOB
SEARCH

Our latest Data, Insight & Analytics jobs

We connect ambitious organisations with their greatest assets, equally ambitious talent.

Senior Data Analyst

  • London
  • Contract
  • 550-650 Per Day

Full details

6 Month Contract, Inside IR35

Join an insurtech, scale-up company with a fantastic culture and great branding.

Sit under the Head of Analytics.

Full details

11th Apr

Data Protection Manager

Purpose Driven

  • Edinburgh
  • Permanent
  • 35,000 - 41,000

Full details

Non for profit supporting children and young people

Work for a company with an amazing cause.

Manage the data protection function and a junior DPO.

Full details

08th Apr

Data Analyst

Purpose Driven

  • Edinburgh
  • Permanent
  • 35,000 - 41,000

Full details

Non for profit supporting children and young people

Work for a company with an amazing cause.

Grow your career in a caring, supportive environment.

Full details

08th Apr

LOAD MORE JOBS

Salary guides:

  • -
    Data, Insight and Analytics Day Rate Guide

    Average salaries and day rates typically received for Data, Insight and Analytics roles.

  • -
    Data, Insight and Analytics Salary Guide

    Average salaries and day rates typically received for Data, Insight and Analytics roles.

  • -
    Data, Insight and Analytics Within Data Engineering & Development

    Average salaries and day rates for roles within data engineering & development.

  • -
    Data, Insight and Analytics within Data Science

    Average salaries and day rates typically received for Data, Insight and Analytics roles within Data Science.

COMMUNITIES

MotherBoard is a Business Charter, Community and Event Series driving tangible change for mums working in the tech industry. GreenTechSW is a community that provides expert insight and thought provoking discussion on how technology can improve our physical environment and battle the massive, urgent issue of climate change. Tech Ethics Bristol is passionate about building a fair and equal society, where technology is a catalyst for positive change.

PURPOSE