Data Engineering jobs and careers
As the use of data in business gets more and more prevalent, the ability to quickly and effectively produce data algorithms that can analyse large complex datasets is crucial. In order to do this, the right data infrastructure needs to be in place.
Why consider a career as a Data Engineer?
Data Engineers build databases, data warehouses and data lakes to service the needs of the Data Analysts and Data Scientists in their businesses. This area is fast growing and Data Engineers are in massive demand as so many companies race to unlock the value in their data.
Typical role titles include
Big Data Engineer
Business Intelligence Developer
Business Intelligence Engineer
Big Data Developer
Data factory Developer
Data Availability Engineer
Data Science Engineer
Big Data Software Engineer
Data Warehouse Engineer
SQL Server Engineer
Data Infrastructure Engineer
Data Infrastructure Programmer
Data Infrastructure Developer
Data Analytics Engineer
Big Data Architect
Big Data Specialist
Big Data Lead
Head of Big Data
Career progression example
Junior Data Engineer
Senior Data Engineer
Lead Data Engineer
Head of Data Engineering
At an entry level, junior / graduate Data Engineering professionals on average will be earning between £30k-£35k. At the mid-level you’d be looking to earn £50k-£60k and seniors would be looking to earn £70k+.
Is it right for me? The skills it takes...
Programming skills: Java | Python | Golang | Cython | Software Design - A background in APIs e.g. web APIs and static/dynamic libraries | ML Libraries - e.g. TensorFlow, CNTK, MLib, Spark, Kafka, Kinesis and Redshift.
What qualifications does it take?
A BSc, Masters (MSc) or Doctorate (PhD) in a maths, physics, statistics, artificial intelligence (AI), software engineering, engineering or computer science field with technical skills in programming. In addition, demonstrable experience working with large data sets.
Our Data recruitment team
Our latest Data jobsSearch all jobs
— Scale-up Tech FirmLocation:Central LondonSalary:Up to £75kGreenfield design and build. Architect data infrastructure for a cloud-native company. Great engineering culture, tech stack and family atmosphere. This scale-up technology firm is growing rapidly through both organic growth and acquisition. They require a Data Engineer that is up to the challenge of owning the design, build and management of their cloud data infrastructure. What you’ll be doing As the Data Engineer, you will evaluate serverless database technologies that will effectively host, integrate and migrate current and future customer data. You will design and architect the data pipelines, suggest different tools and continually improve the set-up. This role requires a variety of engineering activities including; prototype development, architecture, ETL, process automation and more. What you’ll need to apply Experience with Python/Java/Scala etc. Experience with Cloud e.g. AWS, GCP, Azure Ability to design, build and manage data infrastructure Experience of working on greenfield projects desired Ability to communicate problems and solutions to stakeholders What you’ll get in return for your experience A base salary of up to £75,000 plus benefits including work from home, training and investment in your skills and much more. What’s next Please get in touch with Scott with an up-to-date-cv today. Please don’t hesitate to email/call to discuss the finer details.
— Analytics ProviderLocation:BathSalary:Up to £70KOn-prem and Cloud data development. Define analytic standards for the industry. Collaborate with software engineering and DevOps teams. This client is migrating to the cloud to support analytical services offered to customers. This project is set to define industry standards so the incoming hire will have a huge impact on this. What you'll be doing As a Senior Data Engineer, you will model, pipeline and integrate the current set-up to the cloud to support the analytics platform. This will require collaboration with the development teams to ensure the data is accessible across the platform. What you’ll need to apply Proven experience as a Data/Software Engineer Experience with AWS, Azure, GCP or similar SQL Server experience Sourcecode experience e.g Github or Bitbucket Data visualisation experience e.g Power BI, Tableau preferred Object-orientated or functional programming experience preferred What you’ll get in return for your experience A base salary of up to £70,000 DOE plus benefits including WFH 2 days a week. What’s next Please get in touch with Scott with an up-to-date CV, don’t hesitate to email/call to discuss the role in more detail.
— Data Science ConsultancyLocation:Central LondonSalary:Up to £90kDevelop Cloud, Big Data and on-prem solutions. Enable data science activities for clients. Cutting-edge data engineering projects. This global consultancy pride themselves on improving client data science and engineering activities. They are seeking data engineers that are capable of developing a wide range of solutions for their customers. What you’ll be doing You will work on-site with clients to provide them a variety of data solutions. This will require working with serverless and on-prem technologies to effectively host, integrate and migrate valuable client data. This role requires a variety of engineering activities including; prototype development, ETL, architecture, process automation and more. What you’ll need to apply Experience with Java/Scala/Python etc. Experience with Cloud services Experience with Big Data Tools e.g Spark, Hadoop Ability to communicate problems and solutions to stakeholders Degree in Computer Science, Physics or similar What you’ll get in return for your experience A base salary of up to £90,000 plus bonus & benefits including work from home, training and investment in your skills and much more. What’s next Please get in touch with Scott with an up-to-date-cv today. Please don’t hesitate to email/call to discuss the finer details.
— FinTech FirmLocation:CardiffSalary:Up to £65kOn-prem and cloud data development. Work in a team of data engineers and architects. Develop BI solutions, databases and scalable infrastructure. This client is migrating to the cloud to utilise new data services. They are a data-driven firm, it guides their strategic decision-making and service/product development. As a result, they require a Senior Data Engineer to join the team of data engineers to support this migration. What you'll be doing As a Senior Data Engineer, you will be influential in supporting modern, scalable, cloud-based data infrastructure. You will support the design, roll-out and execution of the data strategy across multiple products and collaborate with other data teams to ensure that the data is integrated and accessible. This role requires a range of data engineering activities including; prototyping, pipelining, architecture, process automation and more. What you’ll need to apply Proven experience as a Data/Software Engineer Experience with AWS, Azure, GCP or similar SQL Server experience CI/CD experience preferred e,g Docker, Azure DevOps Object-orientated or functional programming experience preferred Agile experience preferred What you’ll get in return for your experience A base salary of up to £65,000 plus bonus and benefits. What’s next Please get in touch with Scott with an up-to-date CV, don’t hesitate to email/call to discuss the role in more detail.
— ConsultancyLocation:BristolType:Salary:Up to £450 a dayExcellent opportunity to work for a growing consultancy firm Work on interesting projects Remote working and opportunities to travel abroad for projects This fast-growing Data Consultancy are looking for some interim data engineering & architecture support across a few key projects. What you’ll be doing You will be leading in the design and build of data architecture and engineering solutions for end clients. The work will be a combination of office-based, remote and on-site work. What experience you’ll need to apply - Data Architecture experience- Strong Python and SQL skills- Experience of developing APIs- Strong stakeholder management and communication skills- Excellent understanding of business use cases for analytics and how to provide the data- Excellent stakeholder management and influencing skills What you’ll get in return for your experience A competitive day rate of up to £450 per day What’s next?Please get in touch with Savannah with an up to date CV today. Don’t hesitate to call/email to discuss the finer details.
— Global leaders in data-driven consultancy from inception through to strategic vision.Location:London, or RemoteSalary:£30,000 to £65,000Work on highly engaging projects which always provide dynamic experiences. Join a massively successful company with plenty of creative minds. Work in client-facing environments to see the practical outcomes of your work. What you’ll be doing: You will be working in an analytics first environment to help garner the highest possible value from the data presented by clients. You will get the chance to work with flexibility, sometimes implementing technical solutions and sometimes commercial ones. Pool together resources and the support of other consultants to build large and rewarding projects. What experience you’ll need to apply: Proficiency in writing SQL to handle and manipulate data. ETL experience for data migration. Experience in Tableau (other data visualisation tools would be considered). BI analytics tools: Oracle/Hyperion, Cognos, Qlik, etc. Big Data: Cloudera, Hadoop, AWS, Azure, etc. ETL tools: Alteryx, SSIS, etc. Warehousing tools: Teradata, Netezza, Oracle, SAP. It is important to recognize that not all of these tools are necessary but a selection from each bracket would be advantageous. It is important to highlight that not all of the above skills will be essential, but in some cases are preferable. What you’ll get in return for your experience: Multiple salary bands available: Senior would be up to £65,000. Mid-level would be up to £45,000. Juniors would look at £30,000+. A competitive benefits package. The chance to work on many interesting projects. Very good flexibility across geographic locations and remote working. What Next: Please get in touch with Kye Williams with an up to date CV today. Don’t hesitate to call/email to discuss in more detail.
— Data Science AgencyLocation:BathSalary:Up to £55kOn-prem and cloud data development. Deliver data solutions to support a portfolio of clients. Fantastic company culture and working environment. A renowned agency in the data science and analytics space are seeking a Data Engineer to join their team and support data science activities for clients What you'll be doing Working in the Engineering Team, you will support the platform through development, testing and analysis activities. This will require; database design, pipelining and CI/CD to ensure the production environment is stable and can scale, automating processes wherever possible. What you’ll need to apply Proven experience as a Data/Software Engineer Experience with Azure SQL Server experience Object-orientated or functional programming experience Agile experience preferred What you’ll get in return for your experience A base salary of up to £55,000 plus benefits including WFH. What’s next Please get in touch with Scott with an up-to-date CV, don’t hesitate to email/call to discuss the role in more detail.
— High growth technology firmLocation:BristolSalary:Competitive• Unique opportunity to join a high growth international technology firm.• Work with an international team of talented Machine Learning Engineers and Software Engineers working on cutting edge algorithms.• Excellent time to join as this firm has a proven and successful business model that it is rolling out globally. Work with a bunch of like-minded technologists on a cutting-edge tech stack working on novel algorithm development. They are a firm with a start-up feel but backed by successful international parent company. What you'll be doingYou will play a major part in bridging the gap between the Machine Learning, Software Engineering and Site Reliability teams to build and rollout Machine Learning use cases to their mobile application and website. You’d also be working with the creation of data pipelines to enable the delivery of data through their platforms. This is a broad role with the chance to get stuck in with a range to tools and technologies. What experience you will need to apply• Experience as a Data Scientist, Data Engineer or Software Engineer• Strong programming skills in Python• Cloud computing experience with either AWS, GCP and Azure is key here. • Experience with container orchestration solutions like Docker or Kubernetes would be a real bonus. • Interest in working with an international team What you will get in return for your experienceA very competitive base salary as well as relocation assistance and benefits. As well as flexible working hours, regular socials, amazing central Bristol offices and the opportunity to choose your own gear and setup. What’s next?If this sounds like the role for you, get in touch with Adam with your updated CV and we’ll handle the rest.
— Technology FirmLocation:BristolSalary:CompetitveOptimise Big Data platforms. Collaborate with data architects, lead data engineers. Challenge Head of Data Engineering on technical architecture. This client is currently migrating Big Data platforms to utlise additional services. As a result, they require a Lead Data Engineer with experience in technical architecture and data strategy experience to optimise the platforms. What you'll be doing As the Lead Data Engineer, you will model, integrate and optimise scalable, cloud-based solutions. This position will require working with multiple Big Data Technologies. You will support the design, roll-out and execution of the data strategy across the business. As the lead, you’ll mentor the team and work data teams to ensure that the data is integrated and accessible. What experience you'll need to apply Solid ETL experience Python, Scala or Java development experience Cloud Data Platform experience (AWS, GCP, Azure or similar) CI/CD experience Experience of using either Spark, Hive, Hadoop, HDFS, Hydra preferred Experience of setting standards and supporting team members What you'll get in return for your experience A competitive salary with excellent bonus and benefits package. Grow with a leading company and have the potential to become the Head of Data Engineering. What's next Please get in touch with Scott with an up to date CV today. Don't hesitate to email/call to discuss the job in further detail.
— Financial Services InstitutionLocation:BristolSalary:Up to £40kJoin a data science team comprising multiple data engineers and data scientists. End-to-end machine learning model building and deployment. Work with a variety of technologies including Cloud, ML and DevOps tools. This client is building a data science team in Bristol which will be working on a variety of machine learning projects. They require Data Engineers to implement machine learning across the organisation to improve processes and analytics. The team is set to double in size by the end of 2020. What you'll be doing You will work with data engineers and data scientists to deploy ML algorithms to traditional methods of analysis. The production environment is already up and running so this role will be exploratory and research-focused. You will work on end-to-end ML model building and deployment so this could be a great role for those new to/interested in this field. What experience you'll need to apply Degree in Computer Science, Maths, Physics or similar numerical field required Python programming experience Cloud experience (AWS, GCP, Azure or similar) preferred CI/CD experience preferred Desire and ability to learn emerging technologies essential Graduates with data/software engineering project achievements considered What you'll get in return for your experience A base salary of up to £40k plus bonus, benefits and the opportunity to progress machine learning skills and technologies. What's next? Please get in touch with Scott with an up-to-date CV today. Don't hesitate to email/call to discuss the job in further detail.
Data case studies
Alistair Rogers, Data Scientist
- Alistair is an experienced Data Scientist with working with clients across government, healthcare and banking sectors.
- While successfully working in London as a Data Scientist for one of the Big Four professional service companies, he was planning to move to Bristol and approached us to get an understanding of the local market, especially opportunities and skills in demand within Data in the South West well ahead of the move.
- We advised on opportunities and businesses in and around Bristol as well as in-demand skill sets so he could gather relevant exposure in advance.
- Once ready to make the move, we were able to match Alistair perfectly with an open opportunity. Equipping him with tips and advice, we guided him through the interview process and negotiated the salary that was in line with his expectations. Alistair started as a Data Scientist with OnCorps, a start-up FinTech firm.
"Alex and ADLIB were fantastic to work with and absolutely made the daunting experience of finding a job in a new city a lot easier! They take the time to understand the fields that they are recruiting for and even go to developer meetups to learn more about the areas that they recruit in. Would definitely recommend working with Alex and ADLIB."
Alistair Rogers, Data Scientist
Two niche hires in record time
- SunLife are a financial services company and one of the largest life insurance companies in the world.
- As part of a small restructure, they were looking to expand their Performance Optimisation team, by adding two analysts.
- Low quality of applications and scarcity of top analytics talent can make finding specialists extremely difficult.
- By tapping into existing candidate pools and relationships, we were able to suggest a range of suitable candidates with a wide range of experience, resulting in SunLife making two great Performance Analyst hires.
“ADLIB helped Sunlife hire two great analysts in record time , who are already embedded in to the team and delivering great pieces of work.”
Billy Mohan, Digital Performance Manager at SunLife