Data Engineering jobs and careers
As the use of data in business gets more and more prevalent, the ability to quickly and effectively produce data algorithms that can analyse large complex datasets is crucial. In order to do this, the right data infrastructure needs to be in place.
Why consider a career as a Data Engineer?
Data Engineers build databases, data warehouses and data lakes to service the needs of the Data Analysts and Data Scientists in their businesses. This area is fast growing and Data Engineers are in massive demand as so many companies race to unlock the value in their data.
Typical role titles include
Big Data Engineer
Business Intelligence Developer
Business Intelligence Engineer
Big Data Developer
Data factory Developer
Data Availability Engineer
Data Science Engineer
Big Data Software Engineer
Data Warehouse Engineer
SQL Server Engineer
Data Infrastructure Engineer
Data Infrastructure Programmer
Data Infrastructure Developer
Data Analytics Engineer
Big Data Architect
Big Data Specialist
Big Data Lead
Head of Big Data
Career progression example
Junior Data Engineer
Senior Data Engineer
Lead Data Engineer
Head of Data Engineering
At an entry level, junior / graduate Data Engineering professionals on average will be earning between £30k-£35k. At the mid-level you’d be looking to earn £50k-£60k and seniors would be looking to earn £70k+.
Is it right for me? The skills it takes...
Programming skills: Java | Python | Golang | Cython | Software Design - A background in APIs e.g. web APIs and static/dynamic libraries | ML Libraries - e.g. TensorFlow, CNTK, MLib, Spark, Kafka, Kinesis and Redshift.
What qualifications does it take?
A BSc, Masters (MSc) or Doctorate (PhD) in a maths, physics, statistics, artificial intelligence (AI), software engineering, engineering or computer science field with technical skills in programming. In addition, demonstrable experience working with large data sets.
Our Data recruitment team
Our latest Data jobsSearch all jobs
— SAAS ProviderLocation:BathSalary:Up to £40KOwn BI for a global SaaS provider Design and build a variety of data warehouse solutions for customers Progress reporting and data standards by implementing new technologies This firm requires a BI Developer to develop data warehouse solutions, support analytics and improve the availability of quality-assured data to internal and external customers. What you'll be doing As the ETL Developer, you will work with internal and external customers to develop, analyse and progress BI. You'll build and maintain warehouse solutions to enable effective data management, data migration and analytics. This will require a combination of on-premise warehouse development and BI reporting. What you'll need to apply Minimum 3 years’ experience as an ETL/BI Developer Solid ETL experience e.g. SSIS, Talend, Pentaho Data modelling experience Knowledge of BI visualisation tools e.g. Power BI, Tableau Cloud experience preferred What you'll get in return for your experience A great salary of up to £40,000 plus benefits including the opportunity to implement and shape their modern BI suite. What's next Please get in touch with Scott with an up-to-date CV today. Don't hesitate to email/call to discuss the finer details.
— Data Science ConsultancyLocation:BristolSalary:Up to £55kDevelop Cloud and Big Data solutions. Build on existing and design new services. Remote working, flexi-time and great bonuses. This client is building out their data engineering capability to bolster technology offerings to clients. What you'll be doing You will support the development and integration of several products, requiring you to work with a combination of serverless technologies with clients and internal teams. You will build on top of existing platform services to deliver custom solutions to clients. As a result, you'll collaborate with Data Engineers and Data Scientists to ensure that the data is integrated and accessible. What experience you'll need to apply Python, Scala or Java Experience with Spark/Hadoop/HDFS/Flink etc. Cloud experience (AWS, GCP, Azure or similar) preferred Docker preferred High performing graduates with demonstratable data/software engineering project achievements considered What you'll get in return for your experience A base salary of up to £55,000 DOE plus excellent bonuses and benefits package including flexi-time and work from home. What's next? Please get in touch with Scott with an up to date CV today. Don't hesitate to call/email to discuss the job in further detail.
— FinTech FirmLocation:CardiffSalary:Up to £50kOn-prem and cloud data development. Work in a team of data engineers and architects. Develop BI solutions, databases and scalable infrastructure. This client is migrating to the cloud to utilise new data services. They are a data-driven firm, it guides their strategic decision-making and service/product development. As a result, they require a Data Engineer to join the team of data engineers to support this migration. What you'll be doing As a Data Engineer, you will support modern, scalable, cloud-based data infrastructure. You will support the design, roll-out and execution of the data strategy across multiple products and collaborate with other data teams to ensure that the data is integrated and accessible. This role requires a range of data engineering activities including; prototyping, pipelining, process automation and more. What you’ll need to apply Proven experience as a Data/Software Engineer SQL Server experience Cloud experience desirable CI/CD experience desirable e,g Docker, Azure DevOps Object-orientated or functional programming experience preferred Agile experience preferred What you’ll get in return for your experience A base salary of up to £50,000 plus bonus and benefits including WFH. What’s next Please get in touch with Scott with an up-to-date CV, don’t hesitate to email/call to discuss the role in more detail.
— Leading Automotive AI CompanyLocation:CambridgeSalary:Competitive SalaryA chance to work with world-class Engineers Competitive salary and great benefits Central Cambridge office with a competitive salary A leading artificial intelligence automotive company is currently looking for a Python Engineer to join their world-class team of Engineers based in Cambridge. What you’ll be doing As a Python Engineer, you will be involved in the development and deployment of software to help bring their automotive technology to market. You’ll be working on exciting real-world projects and have the chance to work in a fast-moving environment. You’ll be working closely with a talented and innovative thinking team to solve technical challenges. What experience you’ll need to apply A STEM degree (PhD desired) Comfortable coding in Python and C++. Experience using continuous integration and/or continuous deployment tools and Docker. Enjoy problem-solving and have a thirst for learning new things. What you’ll get in return for your experience There’s a competitive salary on offer which is entirely dependent on experience. You’ll be entitled to a generous pension, stock options, medical care and more. What's next? If this sounds like the role for you, get in touch with Zoe (email@example.com) with your updated CV and we’ll handle the rest.
— Autonomous VehiclesLocation:CambridgeSalary:Up to £80k DOEData engineering research & development. Collaborate with data scientists and machine learning engineers. Build and deploy models for enhanced data crunching. Our client is a leader in autonomous vehicles and are currently looking for a top-tier Data Engineer to work as part of their research & development team. What you'll be doing You will focus on developing data-crunching software alongside research engineers that is robust and can scale. As part of this team, you'll have the opportunity to make an instant impact and work with world-class talent. What you'll need to apply Experience with Python, Scala, Golang or C++ essential Experience working in a research environment Solid ETL skills CI/CD experience Degree in Computer Science, Software Engineering or similar What you'll get in return for your experience A base salary or up to £80,000 plus benefits, stock options and the chance to work with industry-leading technology. What's next Please get in touch with Scott with an up-to-date CV today, don't hesitate to call/email to discuss the finer details.
— Financial Services InstitutionLocation:BristolSalary:Up to £40kJoin a data science team comprising multiple data engineers and data scientists. End-to-end machine learning model building and deployment. Work with a variety of technologies including Cloud, ML and DevOps tools. This client is building a data science team in Bristol which will be working on a variety of machine learning projects. They require Data Engineers to implement machine learning across the organisation to improve processes and analytics. The team is set to double in size by the end of 2020. What you'll be doing You will work with data engineers and data scientists to deploy ML algorithms to traditional methods of analysis. The production environment is already up and running so this role will be exploratory and research-focused. You will work on end-to-end ML model building and deployment so this could be a great role for those new to/interested in this field. What experience you'll need to apply Degree in Computer Science, Maths, Physics or similar numerical field required Python programming experience Cloud experience (AWS, GCP, Azure or similar) preferred CI/CD experience preferred Desire and ability to learn emerging technologies essential Graduates with data/software engineering project achievements considered What you'll get in return for your experience A base salary of up to £40k plus bonus, benefits and the opportunity to progress machine learning skills and technologies. What's next? Please get in touch with Scott with an up-to-date CV today. Don't hesitate to email/call to discuss the job in further detail.
Data case studies
Alistair Rogers, Data Scientist
- Alistair is an experienced Data Scientist with working with clients across government, healthcare and banking sectors.
- While successfully working in London as a Data Scientist for one of the Big Four professional service companies, he was planning to move to Bristol and approached us to get an understanding of the local market, especially opportunities and skills in demand within Data in the South West well ahead of the move.
- We advised on opportunities and businesses in and around Bristol as well as in-demand skill sets so he could gather relevant exposure in advance.
- Once ready to make the move, we were able to match Alistair perfectly with an open opportunity. Equipping him with tips and advice, we guided him through the interview process and negotiated the salary that was in line with his expectations. Alistair started as a Data Scientist with OnCorps, a start-up FinTech firm.
"Alex and ADLIB were fantastic to work with and absolutely made the daunting experience of finding a job in a new city a lot easier! They take the time to understand the fields that they are recruiting for and even go to developer meetups to learn more about the areas that they recruit in. Would definitely recommend working with Alex and ADLIB."
Alistair Rogers, Data Scientist
Establishing a Data Science function
- LV= are one of the UK’s largest personal insurers who announced earlier this year that they were partnering with the University of Bristol to establish a team of Data Scientists and Engineers with the aim of making advancements in the field of Data Science by sharing knowledge, skills and opportunities.
- We initially worked with Venura as a candidate, finding him the role at LV=. He soon needed another two sets of hands, planning on growing his team to 3.
- To help him with this, we worked with him to truly understand his style of working and management, gathering a detailed brief that outlined the ideal candidates.
- By tapping into existing candidate pools and relationships, we were able to suggest a range of suitable candidates with a wide range of experience and that had the vital mix of technical and soft skills needed, to be working alongside University of Bristol as a team.
- This resulted in Venura/ LV= making two great Data Engineer hires.
“From finding me my current role to helping place two fantastic hires, ADLIB has been a pivotal role in the development of our team here at Bristol. The guys are easy to work with, friendly and most importantly inspire trust. I look forward to working with them in the future.”
Dr. Venura Perera, Data Science Manager at LV=