Data Engineering jobs and careers
As the use of data in business gets more and more prevalent, the ability to quickly and effectively produce data algorithms that can analyse large complex datasets is crucial. In order to do this, the right data infrastructure needs to be in place.
Why consider a career as a Data Engineer?
Data Engineers build databases, data warehouses and data lakes to service the needs of the Data Analysts and Data Scientists in their businesses. This area is fast growing and Data Engineers are in massive demand as so many companies race to unlock the value in their data.
Typical role titles include
Big Data Engineer
Business Intelligence Developer
Business Intelligence Engineer
Big Data Developer
Data factory Developer
Data Availability Engineer
Data Science Engineer
Big Data Software Engineer
Data Warehouse Engineer
SQL Server Engineer
Data Infrastructure Engineer
Data Infrastructure Programmer
Data Infrastructure Developer
Data Analytics Engineer
Big Data Architect
Big Data Specialist
Big Data Lead
Head of Big Data
Career progression example
Junior Data Engineer
Senior Data Engineer
Lead Data Engineer
Head of Data Engineering
At an entry level, junior / graduate Data Engineering professionals on average will be earning between £30k-£35k. At the mid-level you’d be looking to earn £50k-£60k and seniors would be looking to earn £70k+.
Is it right for me? The skills it takes...
Programming skills: Java | Python | Golang | Cython | Software Design - A background in APIs e.g. web APIs and static/dynamic libraries | ML Libraries - e.g. TensorFlow, CNTK, MLib, Spark, Kafka, Kinesis and Redshift.
What qualifications does it take?
A BSc, Masters (MSc) or Doctorate (PhD) in a maths, physics, statistics, artificial intelligence (AI), software engineering, engineering or computer science field with technical skills in programming. In addition, demonstrable experience working with large data sets.
Our Data recruitment team
Our latest Data jobsSearch all jobs
— Green Tech CompanyLocation:Bristol/remote, UKSalary:Circa £100kGreen tech platform using AWS and Azure. Build cutting-edge IoT products. Redefine the Cloud and Data infrastructure. An IoT green tech company are looking for a Principal Data Engineer who can build the Cloud infrastructure on AWS to support a number of initiatives. What you will be doing As the Principal Data Engineer, you will build infrastructure to support deep-dive analytics and proper structures to deploy ML pipelines. Currently, the Cloud team manages most of the data and now they want someone who’s going to take it to the next level in these areas: Redefining the architecture and the bones of the system to move towards event-driven Provisioning the datalake and new DWH that is being built Source systems integration Automate,automate and automate some more Establish the framework and ML infrastructure environment This position will be the SME for Data in the organistion, so the scope is yours to define where you want to take it. This role will have the opportunity to grow into a management position and to build a team around you. Alternatively, if you prefer to continue down the tech influencer route, you can. What you'll need to apply Experience provisioning data lakes, databases and services on AWS Python or Scala development experience Data modelling and database design experience Experience with CI/CD Experience in requirements gathering and translation into technical specifications What you'll get in return for your experience A base salary of circa £100k DOE plus benefits including the ability to work with the tech you want, for a company that is making a real sustainable impact. The role is offered hybrid in Bristol or remote with monthly trips to the office for candidates further afield. What's next Please get in touch with Scott with an up-to-date CV, don't hesitate to call/email to discuss the finer details.
— Financial ServicesLocation:Salisbury/remote, UKSalary:Up to £100kBe influential in the direction of the organisation. Collaborate with the CDO and Head of Data Science. Backed data strategy and investment from new CDO. A specialist financial service institution is looking for a Head of Data Engineering & Architecture to scale the data platform and the data platform team.What you'll be doingAs the Head of Data Engineering, you will build and manage a team of talented cloud data engineers to enhance the data platform as part of the new data strategy. There are a number of sources that need to be integrated into the platform which you require you to lead on the architecture of said sources.Data governance will be the backbone of the platform so that effective data science and business intelligence activities can be carried out. Therefore, you will liaise with other heads of departments and teams to ensure that the platform is fit for purpose as it scales. What you'll need to apply Experience with SQL and NoSQL databases Comfortable hands-on with either Python, Java or Scala Confident leading data engineers and setting standards Excellent understanding of business use cases for analytics and how to provide the data Excellent stakeholder management and influencing skills What you'll get in return for your experienceA base salary of up to £100k plus & benefits. The data team will triple in size over the next 12 months so this is a great chance to be a key part of enabling the business to become fully data-driven.The role is offered largely remote with the expectation to go into the office 1 or 2 days p/month depending on requirements. The role can be offered fully remote to UK-based candidates too.What's next Please apply with an up-to-date CV today. Don't hesitate to call/email to discuss the finer details.
— Green Tech PlatformLocation:Remote, UKSalary:Up to £60kGreat opportunity for a BI Developer to progress to a modern Cloud Data Engineer. Tech-first clean energy start-up. Fully remote with occasional trips to Gloucester. I’m helping an energy start-up to find a Data Engineer to join a small but growing team in Gloucester (or remotely). Their solution utilises AI software which allows energy trading between homes to save people up to 70% on their bills. With an ambitious technology roadmap in place and plans to grow the development team further, this role plays an integral part in scaling their data platform and introducing new and emerging tech. What you’ll be doing Joining a team of 4 Developers and reporting to the Tech Director, you’ll be instrumental in the delivery of their development pipeline by designing, documenting, building, maintaining, and improving their data models, and the reporting suite in their data warehouse, all hosted in AWS. What experience you’ll need Solid SQL and Python essential Data modelling Ability to develop dashboards e.g Power BI, Tableau or similar Understanding of CI/CD Sound knowledge of AWS and its ecosystem (Athena, Glue, S3, Lambda)/similar Cloud services What you’ll get in return for your talents This role is just about fully remote, though you’ll need to be happy coming to their Gloucester office monthly for strategic meetings. You’re entitled to 28 days holiday ( bank hols), flexi-time for those who need it, a healthy pension scheme, support on upskilling in the areas you’re not as confident with and time for R&D. There’s on-site parking when you’re in the office and a cycle to work scheme. More importantly, you’ll be working for a start-up that are saving a lot of money for people across the UK, acting as pioneers for the green tech revolution. What’s next? Like the sounds of this one? Get in touch with Scott to find out more.
— Real Estate CompanyLocation:Remote, UK, UKSalary:35,000 - 45,000Fully Remote role. Amazing career progression. Great training and work life balance. This is an amazing opportunity for someone who wants to grow their career throughout data. With doors open as a data scientist, data engineer or SME in their data team, this role offers a fantastic opportunity for someone to progress their career as they see fit, by joining this team in their time of need. They’ll help you drive your career and develop the skills you want, to be the best you can be! What you’ll be doing This is a small, tight knit company who are looking for someone that thrives in a smaller environment and is looking to get away from your typical corporate by doing something different. You’ll be sitting within the engineering team as an analyst looking at everything around data quality, data procedure and more. With the opportunity to grow into a data engineer or a data scientist in a few years, you’ll be coming in as the go-to person around analytics initially. You’ll be dealing with anything and everything around reporting and analytics for the company. Your main role would consist of producing visualisations and reports for the company; you’ll be working across building reports in Tableau and presentations where needed. What experience you’ll need to apply Several years experience working within a data role Experience with SQL Strong knowledge of Google Analytics and Google Data Studio Experience with Tableau or PowerBI Bonus for experience with Metabase and Snowflake Confident working in a small team Strong communication and presentation skills What you’ll get in return for your experience A salary of up to £45,000 for the right person. What’s next? Please contact Tegan with an up-to-date CV today!
— FTSE 100 Investment Management & Fintech leaderLocation:Bristol or remote, UKSalary:A competitive package in-line with market rateExcellent opportunity to join the market-leading retail investment management & platform business. Build a modern, event-driven Cloud data platform with machine learning at its core. Play a leading role in shaping the future state of the organisation and establishing a modern data engineering team This leading Investment Management firm are investing heavily in data & technology and are building out a senior data leadership function to take them to the next stage in their data maturity. What you’ll be doing You will work in a leadership data role, being responsible for the design and build of the data platform and the management of the data engineering teams. This is a brand new, real-time, event-driven data platform that will fuel the next generation of client experience, leveraging unique client behavioural data sets to create new and disruptive business models. You will work closely with the CDO, Head of Data Architecture, Head of Data Delivery and other data leaders & owners in the business to take them on a journey to full data maturity. You will interact with senior stakeholders and Directors across the business. This is an excellent opportunity to have a real impact on a FTSE 100 leader and make a material difference to their data journey. What experience you’ll need to apply - Experience as a Head of Data Engineering or Engineering Manager - Experience delivering greenfield Cloud data platforms - Experience engineering real-time event-driven systems - Experience supporting ML pipelines in production - Excellent Director level stakeholder management and influencing skills What you’ll get in return for your experience A competitive package in line with market rate with excellent bonus potential, share options, pension & benefits. The position is offered remote or hybrid. What’s next? Please get in touch with Scott with an up-to-date CV today. Don’t hesitate to call/email to discuss the finer details
— Fintech with FTSE100 Customer.Location:Manchester / Remote, UKSalary:£60k & BenefitsReal-time Event-Driven Architecture. Great chance for growth & upskilling. Well established, highly regarded business with a start-up vibe. This is the opportunity to join a small but international company as they further develop their automated real-time financial CRM. Having just been through series A funding there in a prime position to grow out the team. What you’ll be doing Working with cutting-edge technology, and a team eager to find even better approaches you'll help to further develop the platform and suggest new practices. You'll be reporting directly to the CTO & CEO who are very agnostic about your skills coming in. Predominantly working with Kotlin but are happy with any solid programming background as they're more than happy to upskill you in Kotlin. The system is a microservices architecture orchestrated via Kubernetes and hosted in Azure its an event-driven architecture with Kafka, enabling an event sourcing approach. So we are looking so someone who is skilled in either microservices or event-driven Architecture, although, a strong passion will suffice! The teams are small, cross-functional, DevOps teams working with pair programming with a strong focus on automation to reduce cycle time and a philosophy of keeping things as simple as they can be. What experience you’ll need to apply Previous work with event-driven architecture or microservices. Solid skills in modern Object-Oriented or Functional Programming. What you’ll get in return for your experience A great salary of up £60k with yearly reviews, flexi-time so you can choose when you work. Although they would like someone in the Manchester office more often than not, they realise for the best talent this may not be feasible so feel free to apply if you are out of the manchester range.You'll get to work with cutting-edge technology, and a team eager to find even better approaches so you'll have constant opportunities to upskill. What nextDoes this sound like the one? Send your CV to Will to find out more, or feel free to send over an email with any questions.
— Data Data Data!Location:Bristol / 100% Remote, UKSalary:£45K - £60KStart-up helping businesses find value in their data. 100% remote working with no plans to change. Small team with plans to scale at pace, lots of career progression. We’re helping a start-up with plans to scale at pace to find a .Net Developer to join a small team with lots of progression. Their product supports businesses to harness the power of their data through an enterprise platform that provides a solution for businesses to manage & utilise both operational and analytical data in one place. There’s currently 6 Developers/Engineers on the team, reporting into the CTO. The role is remote-first so you can work from anywhere in the UK! What experience you’ll need Proven experience in C# development. Significant knowledge of MVC/.Net Core. Skilled in utilising the Azure DevOps stack. Any exposure to Snowflake is desirable. Extensive knowledge of (REST) API development. Ability to build and deploy cloud infrastructure (ideally Azure). Any Azure data warehousing experience would be useful. Awareness of Terraform for IaC would be useful. Experience with things like SQL/SSIS/Synapse and awareness of data templating & pipelining. Appreciation for data and theory behind software engineering fundamentals. What you’ll be doing Reporting into the Development Lead, you’ll focus on end-to-end platform development with some involvement in infrastructure (Dev/Sys Ops), adding new features and building new functionalities with a focus on back-end due to the data-centric nature of the product. You’ll be involved in building and deploying cloud-based infrastructure, adopting a cloud-native approach to development and constantly introducing/utilising modern tooling to ensure the platform reaches new heights of capability. You’ll ensure that all code you produce is clean, concise and reusable, bearing in mind scalability as the team grows, advocating for engineering best practices at all times. What you’ll get in return for your talents Joining a start-up in the next phase of growth brings plenty of opportunity for career progression, giving you a chance to build on your skill set whilst gaining exposure to all areas of the business which will only support your career further. They offer 26 days holiday, a healthy pension scheme, flexible working hours and 100% remote working with no plans to change. The team are very talented so you know you’ll be surrounded by like-minded techies, learning something new every day. What’s next? If you’d like to apply or find out more just give Joe a call!
— MLOps & DeploymentLocation:London, UKSalary:£80k Bonus & BenefitsA leading ML Deployment company are looking for a Data Visualisation / Front end developer who specialises in D3.JS, SVG or Canvas based visualisations. What you'll be doingOperating on the cutting edge of technology, in an agile environment that is evolving as we scale, we are looking for a Data Visualisation specialist to join our front end team to deep dive into data to generate more than just the expected insight. Providing bespoke visualisations for the machine learning models and deployments showcasing their capabilities as well as providing real-time analytics and identifying outliers etc. Your time will be split across this with a small focus on front end development when you'd be needed to. What you'll need to apply Understanding of D3 / SVG / Canvas based visualisations Experienced in developing modern web applications using latest technologies (ideally React/TypeScript) Skilled in the trifecta for data visualisation: visualisation, statistical analysis and storytelling What you'll get in return for your experienceA based salary of up to £80k, bonus, benefits and share options. The expectation is to be in the Shoreditch office 2 days a week. What's next Please get in touch with Will with an up-to-date CV, don't hesitate to call/email for the finer details.
— Digital PublisherLocation:Remote, UKSalary:Up to £85kFully remote position Scala, Datalake, AWS Collaborate with Data Science and Software Engineering Teams A Digital Publisher requires a Senior Data Engineer to bolster the capabilities of the team. What you'll be doing As a Senior Data Engineer, you will build and manage ingestion pipelines from a vast number of external sources with a focus on automation.You’ll prepare and validate data for a variety of purposes including ML, GDPR and Insight via the Datalake and warehouse. The Data Engineering Team has recently transitioned the codebase from Python/GO to Scala so the team are looking for skills in this area. If Scala is something you have recently started the team are flexible coming in, as long as you are willing to learn. What you'll need to apply Experience with Scala, Java or Python Cloud experience desirable Knowledge of CI/CD ELT experience Intuitive mindset What you'll get in return for your experience A based salary of up to £85k plus bonus and benefits. The role and team are fully remote, if you would like to go into the office this can be arranged. What's next Please get in touch with Scott with an up-to-date CV, don't hesitate to call/email for the finer details.
Data case studies
Alistair Rogers, Data Scientist
- Alistair is an experienced Data Scientist with working with clients across government, healthcare and banking sectors.
- While successfully working in London as a Data Scientist for one of the Big Four professional service companies, he was planning to move to Bristol and approached us to get an understanding of the local market, especially opportunities and skills in demand within Data in the South West well ahead of the move.
- We advised on opportunities and businesses in and around Bristol as well as in-demand skill sets so he could gather relevant exposure in advance.
- Once ready to make the move, we were able to match Alistair perfectly with an open opportunity. Equipping him with tips and advice, we guided him through the interview process and negotiated the salary that was in line with his expectations. Alistair started as a Data Scientist with OnCorps, a start-up FinTech firm.
"Alex and ADLIB were fantastic to work with and absolutely made the daunting experience of finding a job in a new city a lot easier! They take the time to understand the fields that they are recruiting for and even go to developer meetups to learn more about the areas that they recruit in. Would definitely recommend working with Alex and ADLIB."
Alistair Rogers, Data Scientist
Establishing a Data Science function
- LV= are one of the UK’s largest personal insurers who announced earlier this year that they were partnering with the University of Bristol to establish a team of Data Scientists and Engineers with the aim of making advancements in the field of Data Science by sharing knowledge, skills and opportunities.
- We initially worked with Venura as a candidate, finding him the role at LV=. He soon needed another two sets of hands, planning on growing his team to 3.
- To help him with this, we worked with him to truly understand his style of working and management, gathering a detailed brief that outlined the ideal candidates.
- By tapping into existing candidate pools and relationships, we were able to suggest a range of suitable candidates with a wide range of experience and that had the vital mix of technical and soft skills needed, to be working alongside University of Bristol as a team.
- This resulted in Venura/ LV= making two great Data Engineer hires.
“From finding me my current role to helping place two fantastic hires, ADLIB has been a pivotal role in the development of our team here at Bristol. The guys are easy to work with, friendly and most importantly inspire trust. I look forward to working with them in the future.”
Dr. Venura Perera, Data Science Manager at LV=