Data Engineering jobs and careers
As the use of data in business gets more and more prevalent, the ability to quickly and effectively produce data algorithms that can analyse large complex datasets is crucial. In order to do this, the right data infrastructure needs to be in place.
Why consider a career as a Data Engineer?
Data Engineers build databases, data warehouses and data lakes to service the needs of the Data Analysts and Data Scientists in their businesses. This area is fast growing and Data Engineers are in massive demand as so many companies race to unlock the value in their data.
Typical role titles include
Big Data Engineer
Business Intelligence Developer
Business Intelligence Engineer
Big Data Developer
Data factory Developer
Data Availability Engineer
Data Science Engineer
Big Data Software Engineer
Data Warehouse Engineer
SQL Server Engineer
Data Infrastructure Engineer
Data Infrastructure Programmer
Data Infrastructure Developer
Data Analytics Engineer
Big Data Architect
Big Data Specialist
Big Data Lead
Head of Big Data
Career progression example
Junior Data Engineer
Senior Data Engineer
Lead Data Engineer
Head of Data Engineering
At an entry level, junior / graduate Data Engineering professionals on average will be earning between £30k-£35k. At the mid-level you’d be looking to earn £50k-£60k and seniors would be looking to earn £70k+.
Is it right for me? The skills it takes...
Programming skills: Java | Python | Golang | Cython | Software Design - A background in APIs e.g. web APIs and static/dynamic libraries | ML Libraries - e.g. TensorFlow, CNTK, MLib, Spark, Kafka, Kinesis and Redshift.
What qualifications does it take?
A BSc, Masters (MSc) or Doctorate (PhD) in a maths, physics, statistics, artificial intelligence (AI), software engineering, engineering or computer science field with technical skills in programming. In addition, demonstrable experience working with large data sets.
Our Data recruitment team
Our latest Data jobsSearch all jobs
— Tech for GoodLocation:BathSalary:Up to £35kWork alongside a team of experienced developers. Design and build ETL solutions. Autonomous role in a collaborative environment. This established software house is continuing to grow and needs a specialist data developer to join with their team of experienced developers in Bath. This position will work on projects for external clients to deliver a wide range of data migration requirements. What you’ll be doing You will work alongside a team of experienced developers and external clients to scope out their data migration needs. This will include identifying, documenting and validating the migration scope by liaising with clients while also maintain the existing ETL set-up. You’ll shape the analytics at this firm by designing and implementing new ETL solutions and inform all relevant parties on the end-to-end process. Due to these responsibilities, you will be a well-organised developer, capable of working on different projects while engaging internal and external stakeholders. What you’ll need to apply Experience in ETL Development (e.g Talend, SSIS, Informatica, Alteryx.) Solid SQL Experience with object-orientated programming desirable Agile/Scrum desirable Proactive and self-organised What you’ll get in return for your experience A competitive salary of up to £35,000 DOE plus bonus and benefits including flexible working, social events, training and development budget and more. Graduates with a placement year or internships are encouraged to apply! What’s next Please get in touch with Scott with an up-to-date CV today, don’t hesitate to call/email to discuss the role in more detail.
— Operational Data FirmLocation:RemoteSalary:Up to £50Work with Cloud and Big Data technologies. Build modern, scalable infrastructure. Flexible organisation that encourages remote working. This organisation are building an analytics platform to progress their data science capabilities. This platform is defining the data structure of the organisation and enables clients to be integrated via a variety of serverless technologies. What you’ll be doing As the Data Engineer, you will support a data structure that enables Data Science activities consistent with the long-term data strategy. This will require deploying a diverse range of modern applications that facilitate the integration of existing sources and implement original technologies. You’ll be responsible for each tool, ensuring that all available data can be acquired and accessed by the wider team for data science initiatives. What you’ll need to apply Minimum 2 years experience in Data, Cloud or Software Engineering Modern programming experience (Python, Scala, Java or similar) Knowledge of CI/CD, Cloud Services and Git Ability to learn new tools quickly What you’ll get in return for your experience A salary of up to £50,000 plus great benefits. The hiring manager is happy for applicants from an on-premise background so this is a great opportunity to gain commercial experience working with Cloud and Big Data technologies. What’s next Please get in touch with Scott with an up-to-date CV today, don’t hesitate to call/email to discuss the finer details.
— Global Tech FirmLocation:BristolSalary:Up to £60kDevelop, optimise and support Big Data platforms. Pipeline information from rich, global datasets. Collaborate with data architects, engineers and scientists. This firm looking to transition from batch-processing architecture to a streamed-based model and they require data engineers to join their global analytics team. This team collates information globally to make it available to business units across the organisation. They are open to junior, mid-level and senior candidates. What you'll be doing Working closely with the data architects and the wider data teams, you will ensure that the infrastructure is in place to analyse the huge amounts of data generated by this company. As a result, you'll drive improvements to the scalability, efficiency and the continuous deployment environment. This is a great opportunity for an ambitious data engineer to gain experience with a variety of modern data technologies across cloud ecosystems. What experience you'll need to apply Minimum of 1 years' experience in data or software engineering Python, Java or Scala programming experience Cloud experience preferred (GCP, AWS, Azure) Data flow tool experience e.g Airflow, Nifi, Dataflow/similar CI/CD experience preferred What you'll get in return for your experience A base salary of up to £60k (scope for more DOE) with excellent bonuses and benefits package. Grow with a global company and work with the most modern data technology on the market. What's next Please get in touch with Scott with an up-to-date CV today. Don't hesitate to email/call to discuss the job in further detail
— FTSE 100 Market-Leading BusinessLocation:BristolSalary:Up to £50kOpportunity to work with Cloud & Big Data Technologies coming from an on-prem background. Data warehouse and data lake development. Varied projects including IoT data. A Data Engineer is required to progress the Cloud-based data set up for a growing Data Team. They are open to on-prem developers who have a solid background in data modelling and warehousing. What you'll be doing You will create versatile data pipelines to pull data from on-prem and Cloud sources and pump it out for front-end users. Additionally, you'll continue to help migrate the on-prem estate into Cloud data warehousing and data lake technologies. Alongside the Data Architect and Datawarehouse Manager, you will make use of more Cloud services for capacity management, IoT and more. What you'll need to apply Solid ETL skills Dimensional modelling experience Cloud experience desirable Python desirable What you'll get in return for your experience A base salary of up to £50k plus bonus and benefits. You'll get to work with the full AWS data stack including data lake technologies so this is a great opportunity for those looking to work as modern Cloud Data Engineer. The expectation is 1-2 days in the office post-covid measures. What's next? Please get in touch with Scott with an up-to-date CV today. Don't hesitate to call/email to discuss the finer details.
— Ed TechLocation:Remote/BristolSalary:Up to £50kOutstanding career progression, greenfield products. Thriving EdTech company with planned growth. Gain experience with Cloud services. The first Data Engineer/Developer for an EdTech client is required to come in and effectively model data from various products and sources. What you'll be doing As a Data Engineer/Developer, you will be a key contributor to the technology roadmap and will need to be creative and innovative to help deliver their ambitious plans. You will be instrumental in the delivery of their development pipelines by designing, documenting, building, maintaining, and improving their data models and utilising data services in the Cloud. This is a great opportunity for someone from an on-prem background to work with the AWS data stack. What you'll need to apply Solid ETL skills e.g SSIS, Talend, Informatica Data modelling Demonstrable experience in design of ERDs and Schemas SQL Experience connecting APIs Desirables: Experience with AWS Experience with PostgreSQL Data warehouse design and builds What you'll get in return for your experience In return for your skills and hard work, you’ll be rewarded with a salary of up to £50K DOE, a great package plus fantastic long-term prospects as they have really big plans for the future (did someone say machine learning projects?...). They have a fantastic working environment with a smart central office, an Agile/Scrum approach and a strong focus on learning and development including the opportunity to pursue courses, certification and tech conferences. You'll get to be involved with regular hackathons plus Friday beers, regular socials all within a friendly and hardworking team to be a part of. They are really proud of what they produce, always sharing skills and ideas and constantly striving to produce their best software solutions yet. The role is offered fully remote, and flexible part-time options are available too as the company want to be as inclusive as possible. What's next Please get in touch with Scott with an up-to-date CV, don't hesitate to call/email to discuss the finer details.
Data case studies
Alistair Rogers, Data Scientist
- Alistair is an experienced Data Scientist with working with clients across government, healthcare and banking sectors.
- While successfully working in London as a Data Scientist for one of the Big Four professional service companies, he was planning to move to Bristol and approached us to get an understanding of the local market, especially opportunities and skills in demand within Data in the South West well ahead of the move.
- We advised on opportunities and businesses in and around Bristol as well as in-demand skill sets so he could gather relevant exposure in advance.
- Once ready to make the move, we were able to match Alistair perfectly with an open opportunity. Equipping him with tips and advice, we guided him through the interview process and negotiated the salary that was in line with his expectations. Alistair started as a Data Scientist with OnCorps, a start-up FinTech firm.
"Alex and ADLIB were fantastic to work with and absolutely made the daunting experience of finding a job in a new city a lot easier! They take the time to understand the fields that they are recruiting for and even go to developer meetups to learn more about the areas that they recruit in. Would definitely recommend working with Alex and ADLIB."
Alistair Rogers, Data Scientist
Establishing a Data Science function
- LV= are one of the UK’s largest personal insurers who announced earlier this year that they were partnering with the University of Bristol to establish a team of Data Scientists and Engineers with the aim of making advancements in the field of Data Science by sharing knowledge, skills and opportunities.
- We initially worked with Venura as a candidate, finding him the role at LV=. He soon needed another two sets of hands, planning on growing his team to 3.
- To help him with this, we worked with him to truly understand his style of working and management, gathering a detailed brief that outlined the ideal candidates.
- By tapping into existing candidate pools and relationships, we were able to suggest a range of suitable candidates with a wide range of experience and that had the vital mix of technical and soft skills needed, to be working alongside University of Bristol as a team.
- This resulted in Venura/ LV= making two great Data Engineer hires.
“From finding me my current role to helping place two fantastic hires, ADLIB has been a pivotal role in the development of our team here at Bristol. The guys are easy to work with, friendly and most importantly inspire trust. I look forward to working with them in the future.”
Dr. Venura Perera, Data Science Manager at LV=