Creating teams. Shaping futures.

We connect ambitious organisations with their greatest assets,
equally ambitious talent.

Big Data jobs and careers

As the use of data in business gets more and more prevalent the ability to quickly and effectively produce data algorithms that can analyse large complex datasets is crucial. In order to do this, the right data infrastructure needs to be in place.

Why consider a career in Big Data?
Data Engineers build databases, data warehouses and data lakes to service the needs of the Data Analysts and Data Scientists in their businesses. This area is fast growing and Data Engineers are in massive demand as so many companies race to unlock the value in their data.
 
Typical role titles include
Data Engineer
Big Data Engineer
Data Developer
BI Engineer
BI Developer
Business Intelligence Developer
Business Intelligence Engineer
Big Data Developer
Hadoop Developer
Data factory Developer
Hadoop Engineer
Data Availability Engineer
Data Science Engineer
Big Data Software Engineer
Platform Engineer
Data Warehouse Engineer
DWH Engineer
DWH Programmer
DWH Developer
Datawarehouse Developer
Datawarehouse Engineer
Datawarehouse Programmer
SQL Server Engineer
Data Infrastructure Engineer
Data Infrastructure Programmer
Data Infrastructure Developer
Data Analytics Engineer
Big Data Architect
Hadoop Architect
Hadoop Specialist
Big Data Specialist
Big Data Lead
Head of Big Data
Data Architecture specialist
Head of Data Architecture
 
Career progression example
Junior Data Engineer
Data Engineer
Senior Data Engineer
Lead Data Engineer
Head of Data Engineering
Data Architect
 
Salary Benchmarks
At an entry level, junior/graduate Data Engineering professionals on average will be earning between £30k-£35k. At the mid-level you’d be looking to earn £50k-£60k and seniors would be looking to earn £70k+.
 
Is it right for me? The skills it takes...
The skills needed can be split into 3 categories; programming skills, data science understanding and problem-solving.
 
Programming skills: Java | Python | Golang | Cython | Software Design - A background in APIs e.g. web APIs and static/dynamic libraries | ML Libraries - e.g. TensorFlow, CNTK, MLib, Spark, Kafka, Kinesis, Redshift.
 
 What qualifications does it take?
A BSc, Masters (MSc) or Doctorate (PhD) in a maths, physics, statistics, artificial intelligence (AI), software engineering, engineering or computer science field with technical skills in programming. Demonstrable experience working with large data sets or alternatively candidates will work in Business Intelligence and then do online courses /self-learning/ get trained up on Big Data Engineering and Architecture and can move into these roles through this route.

 

Our Data recruitment team

Our latest Data jobs

Search all jobs
 
  • 14th Jan

    Senior Data Engineer

    — E-commerce Business

    Location:
    London
    Type:
    Salary:
    Up to £85k
    Real-time streaming & ML deployment. Multi-Cloud environment. Collaborate with Software Engineers and Data Scientists. An exciting opportunity to join a fast-paced, creative e-commerce company based in London. Over the last 12 months, the company has been working hard on progressing their tech platform and customer experience and are now looking to take the business to the next level. With over 12 million website visitors per month, and their current product offering doubling this year, this is a great time to join.  What you’ll be doing  This role will sit in the software engineering/tech team and will be accountable for ensuring that data and can be used effectively by the data scientists/ML team and to support the wider business.  As such, you will design, build and manage the platform, underpinning real-time streaming and ML. This is a senior role, so you also be responsible for supporting more junior team members, upskilling and working with your peers to make decisions.   What skills you’ll need 5 years' experience as a Data/Software Engineer Python   Solid ETL DevOps experience SDLC ML Deployment desirable What you’ll get in return for your talents A base salary of up to £85,000 plus up to 15% bonus and many other benefits and perks  What’s next?  Please apply with your up-to-date CV today, don't hesitate to call/email to discuss the finer details.
  • 12th Jan

    Lead Data Engineer

    — Green Tech Firm

    Location:
    London/Remote
    Type:
    Salary:
    Up to £95k
    Join one of the UK's leading green technology firms.  Renowned engineering culture. Great package, remote working, flexi-time. This client is building a new team as they continue to progress their technological capabilities. They are a data-driven organisation, it guides their strategic decision-making and service/product development. As a result, they need a Lead Data Engineer to support the integration of various systems. What you'll be doing As the Lead Data Engineer, you will be influential in supporting the integration of several systems, requiring you to work with a combination of serverless technologies. You will support the design, roll-out and execution of the data services across various business units. As a result, you'll collaborate with other engineering and data teams to ensure that the data is integrated and accessible.  This role requires a range of data engineering activities including; prototyping, architecture, real-time streaming, ETL pipelines, process automation and more.  What experience you'll need to apply Minimum of 5 years' experience in data or software engineering Solid ETL pipelining experience Scala/Java/Python development experience Streaming experience e.g. Airflow, Dataflow, Kinesis, Kafka etc Cloud experience (AWS, GCP, Azure or similar) What you'll get in return for your experience A base salary of up to £95,000 with excellent bonuses and benefits package including remote working. What's next? Please get in touch with Scott with an up to date CV today. Don't hesitate to email/call to discuss the job in further detail.
  • 11th Jan

    Senior Data Engineer

    — Python, full-stack software engineering, GraphQL

    Location:
    London
    Type:
    Salary:
    Up to £80,000
    Fast-paced, creative e-commerce business Latest tech stack  Exciting tech transformations  An exciting opportunity to join a fast-paced, creative e-commerce/ marketplace company based in London. Over the last 12 months, the company has been working hard on progressing their tech platform and customer experience and are now looking to take the business to the next level. With over 12 million website visitors per month, and their current product offering doubling this year, this is a great time to join.  The company is using cutting-edge technology including React, Next JS, GraphQL, AWS ECS, Lambdas, Java and there a number of super exciting projects in the pipeline. They are a nurturing business that focus on learning, development, agile working, and team/ individual autonomy.  What skills you’ll need Full-stack software development experience Extensive experience with Python   SQL proficiency Experience using Cloud DevOps tools like AWS, GCP with CloudFormation and/or Terraform A solid understanding of database systems Great communication skills  What you’ll be doing  Data is at the center of this fast-paced business and using data well allows them to better understand their customer trends. This role will sit in the software engineering/ tech team. This team is accountable for ensuring that data flows and can be used effectively by the data scientists/ machine learning team.  As a Senior Data Engineer, you will design, build, and run innovative solutions using market-leading data platform technologies.  This is a senior role, so you also be responsible for supporting more junior team members, upskilling and working with your peers to make decisions.   You will be passionate, creative and have a great interest in the latest technologies.  What you’ll get in return for your talents A fantastic salary, great holiday allowance, up to 10-15% bonus and many other benefits and perks  What’s next?  Please apply with your up to date CV and Sophie will be in touch   
  • 4th Jan

    Data Developer

    — Tech Start-up

    Location:
    Cirencester
    Type:
    Salary:
    Up to £55k
    Join an international Tech start-up.  On-prem and multi-Cloud ecosystem Gain/progress skills with Cloud technologies, NoSQL DBs and Scala An experienced Data Developer is required to join a growing Tech start-up due to market expansion and the growth of its Data Team. What you'll be doing You will migrate on-prem DBs to the cloud, automate processes and perform upgrades to the system. The role will be 70% coding and 30% production.  Given the projects that are underway, there are lots of opportunities to progress to a modern cloud/data engineer within the organisation.  What you'll need to apply Proven experience as a Developer (3 years' experience plus preferred)  Well-versed with SQL scripting Experience with AWS/Azure preferred but not essential Experience with stored procedures, tables & joins, performance tuning Python or Scala desirable What you'll get in return for your experience A base salary of up to £55k DOE plus benefits. The position is fully remote for now but you will be expected to be in the office 2 days p/week in the future. What's next Please get in touch with Scott with an up-to-date CV today. 
  • 22nd Dec

    Data Architect

    — Green Tech Firm

    Location:
    London/Remote
    Type:
    Salary:
    Up to £95k
    Join one of the UK's leading green technology firms.  Renowned engineering culture. Great package, remote working, flexi-time. This client is building a new team as they continue to progress their technological capabilities. They are a data-driven organisation, it guides their strategic decision-making and service/product development. As a result, they need a hands-on Data Architect to support the integration of various systems. What you'll be doing As the Data Architect, you will be influential in supporting the integration of several systems, requiring you to work with a combination of serverless technologies. You will support the design, roll-out and execution of the data services across various business units. As a result, you'll collaborate with other engineering and data teams to ensure that the data is integrated and accessible.  This role requires a range of data engineering activities including; prototyping, architecture, real-time streaming, ETL pipelines, process automation and more.  What experience you'll need to apply Minimum of 5 years' experience in data or software engineering Solid ETL pipelining experience Scala/Java/Python development experience Streaming experience e.g. Airflow, Dataflow, Kinesis, Kafka etc Cloud experience (AWS, GCP, Azure or similar) What you'll get in return for your experience A base salary of up to £95,000 with excellent bonuses and benefits package including remote working. What's next? Please get in touch with Scott with an up to date CV today. Don't hesitate to email/call to discuss the job in further detail.
 Data

Data case studies

Candidate Experience

Alistair Rogers, Data Scientist

  • Alistair is an experienced Data Scientist with working with clients across government, healthcare and banking sectors.
  • While successfully working in London as a Data Scientist for one of the Big Four professional service companies, he was planning to move to Bristol and approached us to get an understanding of the local market, especially opportunities and skills in demand within Data in the South West well ahead of the move.
  • We advised on opportunities and businesses in and around Bristol as well as in-demand skill sets so he could gather relevant exposure in advance.
  • Once ready to make the move, we were able to match Alistair perfectly with an open opportunity. Equipping him with tips and advice, we guided him through the interview process and negotiated the salary that was in line with his expectations. Alistair started as a Data Scientist with OnCorps, a start-up FinTech firm. 

"Alex and ADLIB were fantastic to work with and absolutely made the daunting experience of finding a job in a new city a lot easier! They take the time to understand the fields that they are recruiting for and even go to developer meetups to learn more about the areas that they recruit in. Would definitely recommend working with Alex and ADLIB."  

Alistair Rogers, Data Scientist

LV=

Establishing a Data Science function

  • LV= are one of the UK’s largest personal insurers who announced earlier this year that they were partnering with the University of Bristol to establish a team of Data Scientists and Engineers with the aim of making advancements in the field of Data Science by sharing knowledge, skills and opportunities. 
  • We initially worked with Venura as a candidate, finding him the role at LV=. He soon needed another two sets of hands, planning on growing his team to 3.
  • To help him with this, we worked with him to truly understand his style of working and management, gathering a detailed brief that outlined the ideal candidates. 
  • By tapping into existing candidate pools and relationships, we were able to suggest a range of suitable candidates with a wide range of experience and that had the vital mix of  technical and soft skills needed, to be working alongside University of Bristol as a team.
  • This resulted in Venura/ LV= making two great Data Engineer hires.

“From finding me my current role to helping place two fantastic hires, ADLIB has been a pivotal role in the development of our team here at Bristol. The guys are easy to work with, friendly and most importantly inspire trust. I look forward to working with them in the future.”

Dr. Venura Perera, Data Science Manager at LV=

ADLIB Blog

Local, knowledgeable and authentic.

A wealth of wisdom here, showcasing and featuring thought-leaders, career journeys, tips and expert advice.

Read the latest articles here

Guides and Surveys

Day Rate & Salary benchmarks, tips to retain top talent & skill-sets in demand.

View and download
image

Tech, Data, Engineering, Science, Sustainability, eCom, Marketing or Design jobs directly to your inbox.

Tailor your alerts
image

Looking to recruit Tech, Data, Engineering, Science, Sustainability, eCom, Marketing or Design talent?

Contact us