Creating teams. Shaping futures.

We connect ambitious organisations with their greatest assets,
equally ambitious talent.

Big Data jobs and careers

As the use of data in business gets more and more prevalent the ability to quickly and effectively produce data algorithms that can analyse large complex datasets is crucial. In order to do this, the right data infrastructure needs to be in place.

Why consider a career in Big Data?
Data Engineers build databases, data warehouses and data lakes to service the needs of the Data Analysts and Data Scientists in their businesses. This area is fast growing and Data Engineers are in massive demand as so many companies race to unlock the value in their data.
 
Typical role titles include
Data Engineer
Big Data Engineer
Data Developer
BI Engineer
BI Developer
Business Intelligence Developer
Business Intelligence Engineer
Big Data Developer
Hadoop Developer
Data factory Developer
Hadoop Engineer
Data Availability Engineer
Data Science Engineer
Big Data Software Engineer
Platform Engineer
Data Warehouse Engineer
DWH Engineer
DWH Programmer
DWH Developer
Datawarehouse Developer
Datawarehouse Engineer
Datawarehouse Programmer
SQL Server Engineer
Data Infrastructure Engineer
Data Infrastructure Programmer
Data Infrastructure Developer
Data Analytics Engineer
Big Data Architect
Hadoop Architect
Hadoop Specialist
Big Data Specialist
Big Data Lead
Head of Big Data
Data Architecture specialist
Head of Data Architecture
 
Career progression example
Junior Data Engineer
Data Engineer
Senior Data Engineer
Lead Data Engineer
Head of Data Engineering
Data Architect
 
Salary Benchmarks
At an entry level, junior/graduate Data Engineering professionals on average will be earning between £30k-£35k. At the mid-level you’d be looking to earn £50k-£60k and seniors would be looking to earn £70k+.
 
Is it right for me? The skills it takes...
The skills needed can be split into 3 categories; programming skills, data science understanding and problem-solving.
 
Programming skills: Java | Python | Golang | Cython | Software Design - A background in APIs e.g. web APIs and static/dynamic libraries | ML Libraries - e.g. TensorFlow, CNTK, MLib, Spark, Kafka, Kinesis, Redshift.
 
 What qualifications does it take?
A BSc, Masters (MSc) or Doctorate (PhD) in a maths, physics, statistics, artificial intelligence (AI), software engineering, engineering or computer science field with technical skills in programming. Demonstrable experience working with large data sets or alternatively candidates will work in Business Intelligence and then do online courses /self-learning/ get trained up on Big Data Engineering and Architecture and can move into these roles through this route.

 

Our Data recruitment team

Our latest Data jobs

Search all jobs
 
  • 27th Oct

    Data Engineer

    — Technology Firm

    Location:
    Bristol/Remote
    Type:
    Salary:
    Up to £55k
    Join one of Bristol's leading technology firms.  Renowned engineering culture. Great package, remote working, flexi-time. This client is building a new team as they continue to progress their technological capabilities. They are a data-driven organisation, it guides their strategic decision-making and service/product development. As a result, they need a Data Engineer to support the integration of various systems. What you'll be doing As the Data Engineer, you will support the integration of client source systems using streaming technologies. This role requires a range of data engineering activities including; prototyping, ETL pipelines, real-time streaming and more.  What experience you'll need to apply Minimum of 1 years' experience in data or software engineering Solid ETL pipelining experience Scala/Java/Python development experience Experience with Airflow/Dataflow/Kinesis/Kafka etc. What you'll get in return for your experience A base salary of up to £55,000 with excellent bonuses and benefits package including remote working. The expectation is 1 -day p/week in the office post-covid measures.  What's next? Please get in touch with Scott with an up to date CV today. Don't hesitate to email/call to discuss the job in further detail.
  • 21st Oct

    Lead BI Analyst

    — 12 month FTC

    Location:
    Cardiff/Remote
    Type:
    Salary:
    £40000 - £50000
    Create novel ways of visualising data.  Develop solutions with software and data engineers.  Shape visualisation and analytical techniques  We have a unique requirement for Lead BI Analyst to join an exciting established business in Cardiff for 12 months. We are looking for visualisation experts to create new ways of visualising data and increase services offered. What you’ll be doing As a visualisation specialist, you will be required to engineer bespoke visualisations tools and enhance current methods for clients. You will need to be passionate, intuitive and have the ability to model, map and graphically represent data in diverse ways. What you’ll need to apply Degree in computer science, software engineering, physics or similar  Technical skills with SQL as well as a visualization tool like; Power BI, Looker or Tableau (with Tableau being preferred). Experience working in a cloud based big data environment like Azure would be ideal.  Communication skills are vital with this role as you will be championing visualizations across the business and deal with a range of stakeholders at all levels.  Passionate about technology and analysis  What you’ll get in return for your experience The salary on this one is up to £50K for the right candidate and is likely to become a permanent role at the end of the fixed term. There are a range of great benefits and culture including remote working, plenty of opportunities to train and upskill, socials and more. This role is currently remote but depending on relaxations on the current Covid-19 restrictions you will be required to meet the team in Cardiff at least once a month. What’s next? Please get in touch with Adam with an up-to-date CV today. Don’t hesitate to email/call to discuss the finer details.  
  • 20th Oct

    Senior Data Engineer

    — Financial Services

    Location:
    London/Remote
    Type:
    Salary:
    Up to £75k
    Work with modern Big Data and Cloud technologies. Collaborate with Data Scientists and Architects. Hands-on management opportunities. A Senior Data Engineer is required to support a large migration and new platform development, with the vision to move all data and new products across in the coming years. What you'll be doing You will be influential in supporting the integration of several data sources, requiring you to work with a combination of on-prem, Cloud and Big Data technologies. As a result, you'll collaborate with other data engineers and data teams to ensure that the data is integrated and accessible.  This role requires a range of data engineering activities including; prototyping, pipelining, warehousing, automation and more. What you'll need to apply Minimum of 2 years' experience Data Lake experience essential (any) Cloud experience (any) Python/Java/Scala/R SQL What you'll get in return for your experience Base salary of up to £75k plus bonus and benefits including accelerating your management and mentoring experience. The position is fully remote for now with the expectation of 1-day minimum in the office p/week post-COVID measures.  What's next? Please get in touch with an up-to-date CV today, don't hesitate to call/email to discuss the role in more detail. 
  • 9th Oct

    Senior Big Data Engineer

    — FinTech Firm

    Location:
    Newport
    Type:
    Salary:
    Up to £70k
    Work on a variety of Big Data and Cloud technologies. Work in a team of Big Data engineers alongside other data engineering teams Design BI solutions, develop architecture and enable ML. This client is integrating a new service via the cloud as they move towards a single customer view. They are a data-driven firm, it guides their strategic decision-making and service/product development. As a result, they require a Senior Big Data Engineer to join the team of data engineers to enable this build. What you'll be doing As a Senior Big Data Engineer, you will be influential in building a modern, scalable, cloud-based Big Data infrastructure. You will support the design, roll-out and execution of the data strategy across multiple products and collaborate with other data teams to ensure that the data is integrated and accessible.  This role requires a range of data engineering activities including; prototype development, pipelining, architecture, process automation, data strategy and more. What experience you'll need to apply Python/Scala/Java or similar Solid ETL experience Cloud Data platform experience (AWS, GCP, Azure or Similar) Experience of using either Spark, Hadoop, Flink, HDFS, Kinesis  Messaging broker platform experience such as Kafka//MQ’s/Airflow desirable Desire and ability to learn emerging technologies What you'll get in return for your experience A base salary of up to £70k plus bonus and benefits. What's next? Please get in touch with Scott with an up-to-date CV today. Don't hesitate to call/email to discuss the job in further detail.
  • 9th Oct

    Senior Big Data Engineer

    — FinTech Firm

    Location:
    London
    Type:
    Salary:
    Up to £70k
    Work on a variety of Big Data and Cloud technologies. Work in a team of Big Data engineers alongside other data engineering teams Design BI solutions, develop architecture and enable ML. This client is integrating a new service via the cloud as they move towards a single customer view. They are a data-driven firm, it guides their strategic decision-making and service/product development. As a result, they require a Senior Big Data Engineer to join the team of data engineers to enable this build. What you'll be doing As a Senior Big Data Engineer, you will be influential in building a modern, scalable, cloud-based Big Data infrastructure. You will support the design, roll-out and execution of the data strategy across multiple products and collaborate with other data teams to ensure that the data is integrated and accessible.  This role requires a range of data engineering activities including; prototype development, pipelining, architecture, process automation, data strategy and more. What experience you'll need to apply Python/Scala/Java or similar Solid ETL experience Cloud Data platform experience (AWS, GCP, Azure or Similar) Experience of using either Spark, Hadoop, Flink, HDFS, Kinesis  Messaging broker platform experience such as Kafka//MQ’s/Airflow desirable Desire and ability to learn emerging technologies What you'll get in return for your experience A base salary of up to £70k plus bonus and benefits. What's next? Please get in touch with Scott with an up-to-date CV today. Don't hesitate to call/email to discuss the job in further detail.
  • 2nd Oct

    Data Engineer (Python)

    — Consultancy

    Location:
    Remote/Bristol
    Type:
    Salary:
    Up to £450 p/day
    Remote. Up to £450 p/day. Python. 3-month part-time contract opportunity for a Data Engineer, likely to extend with additional client projects. What you'll be doing Significant ETL and automation work using Python. What you'll need to apply Python SQL Solid ETL experience What's next Please apply with your most up-to-date CV and I will be in touch to discuss further.
  • 17th Sep

    Data Engineering Lead

    — Technology Firm

    Location:
    Bristol/Remote
    Type:
    Salary:
    Up to £90k
    Join one of Bristol's leading technology firms.  Renowned engineering culture. Great package, remote working, flexi-time. This client is building a new team as they continue to progress their technological capabilities. They are a data-driven organisation, it guides their strategic decision-making and service/product development. As a result, they need a Data Engineering Lead to support the integration of various systems. What you'll be doing As the Data Engineering Lead, you will be influential in supporting the integration of several systems, requiring you to work with a combination of serverless technologies. You will support the design, roll-out and execution of the data services across various business units. As a result, you'll collaborate with other engineering and data teams to ensure that the data is integrated and accessible.  This role requires a range of data engineering activities including; prototyping, ETL pipelines, architecture, process automation and more.  What experience you'll need to apply Minimum of 5 years' experience in data or software engineering Solid ETL pipelining experience Scala/Java/Python development experience Streaming experience e.g. Airflow, Dataflow, Kinesis, Kafka etc Cloud experience (AWS, GCP, Azure or similar) What you'll get in return for your experience A base salary of up to £90,000 with excellent bonuses and benefits package including remote working. What's next? Please get in touch with Scott with an up to date CV today. Don't hesitate to email/call to discuss the job in further detail.
 Data

Data case studies

Candidate Experience

Alistair Rogers, Data Scientist

  • Alistair is an experienced Data Scientist with working with clients across government, healthcare and banking sectors.
  • While successfully working in London as a Data Scientist for one of the Big Four professional service companies, he was planning to move to Bristol and approached us to get an understanding of the local market, especially opportunities and skills in demand within Data in the South West well ahead of the move.
  • We advised on opportunities and businesses in and around Bristol as well as in-demand skill sets so he could gather relevant exposure in advance.
  • Once ready to make the move, we were able to match Alistair perfectly with an open opportunity. Equipping him with tips and advice, we guided him through the interview process and negotiated the salary that was in line with his expectations. Alistair started as a Data Scientist with OnCorps, a start-up FinTech firm. 

"Alex and ADLIB were fantastic to work with and absolutely made the daunting experience of finding a job in a new city a lot easier! They take the time to understand the fields that they are recruiting for and even go to developer meetups to learn more about the areas that they recruit in. Would definitely recommend working with Alex and ADLIB."  

Alistair Rogers, Data Scientist

LV=

Establishing a Data Science function

  • LV= are one of the UK’s largest personal insurers who announced earlier this year that they were partnering with the University of Bristol to establish a team of Data Scientists and Engineers with the aim of making advancements in the field of Data Science by sharing knowledge, skills and opportunities. 
  • We initially worked with Venura as a candidate, finding him the role at LV=. He soon needed another two sets of hands, planning on growing his team to 3.
  • To help him with this, we worked with him to truly understand his style of working and management, gathering a detailed brief that outlined the ideal candidates. 
  • By tapping into existing candidate pools and relationships, we were able to suggest a range of suitable candidates with a wide range of experience and that had the vital mix of  technical and soft skills needed, to be working alongside University of Bristol as a team.
  • This resulted in Venura/ LV= making two great Data Engineer hires.

“From finding me my current role to helping place two fantastic hires, ADLIB has been a pivotal role in the development of our team here at Bristol. The guys are easy to work with, friendly and most importantly inspire trust. I look forward to working with them in the future.”

Dr. Venura Perera, Data Science Manager at LV=

ADLIB Blog

Local, knowledgeable and authentic.

A wealth of wisdom here, showcasing and featuring thought-leaders, career journeys, tips and expert advice.

Read the latest articles here

Guides and Surveys

Day Rate & Salary benchmarks, tips to retain top talent & skill-sets in demand.

View and download
image

Tech, Data, Engineering, Science, Sustainability, eCom, Marketing or Design jobs directly to your inbox.

Tailor your alerts
image

Looking to recruit Tech, Data, Engineering, Science, Sustainability, eCom, Marketing or Design talent?

Contact us