In This Article

In This Article

Man looks at screens with data | FourthRev

How a Data Engineer Broke into AI with the Data Science Career Accelerator

When Sheldon Lee Kemper joined the Data Science with Machine Learning & AI Career Accelerator, he wasn’t looking to change direction – he was ready to take the next step. With a strong background in data engineering, Sheldon recognised that the future of his field would be shaped by AI and machine learning. He needed a programme that could bridge that gap – providing advanced, applied training in AI while maintaining a strong foundation in practical data science.

The Career Accelerator delivered. Towards the end of the programme, Sheldon was headhunted by Capgemini for a new role as a Data Engineer – one that came with a salary increase and a more AI-driven focus. His story is a powerful example of how experienced professionals are using the programme to deepen their expertise, expand their impact, and lead in an evolving data landscape.

In his own words, here’s Sheldon’s journey – from structured pipelines to intelligent automation, and everything in between.


A few years ago, I wouldn’t have predicted that I’d be diving deep into AI and machine learning. My background was in data engineering, and I was comfortable working with big data pipelines, ETL processes, and cloud computing. But as I watched the industry evolve, it became clear – AI wasn’t just an add-on; it was transforming how data was processed, interpreted, and used for decision-making.

That realisation led me to upskill. At first, I explored machine learning through self-study, online courses, and small projects. But I knew that to truly integrate AI with data engineering, I needed a structured, hands-on programme. That’s what drew me to the Data Science with Machine Learning & AI Career Accelerator from the University of Cambridge Institute of Continuing Education – a seven-month immersive experience focused on real-world applications.

I wasn’t looking to transition into data science entirely – I wanted to create a new role that blends AI with data engineering, bridging the gap between intelligent automation and scalable data infrastructure.

Getting into the deep end: A crash course in AI and ML

The first few months of the programme were intense. We covered everything from machine learning fundamentals to neural networks, NLP, and time series forecasting. Even with my technical background, I quickly realised that building AI solutions required a different mindset than traditional data engineering.

Some of the key areas I focused on included:

  • Neural networks and deep learning – Manually working through forward and backward propagation to understand how models learn.
  • Optimisation and regularisation – Implementing dropout, L2 regularisation, and hyperparameter tuning to improve model performance.
  • Natural language processing (NLP) – Exploring sentiment analysis, topic modelling, and transformer models like BERT and T5.
  • Time series forecasting – Comparing ARIMA, exponential smoothing, and machine learning approaches to predict trends.

One of the most challenging yet rewarding aspects was transitioning from structured, relational data processing to working with messy, unstructured data – especially in NLP.

The Employer Project: Bringing AI into financial risk analysis

Midway through the programme, we were introduced to our Employer Project with the Bank of England. The challenge was to extract insights from quarterly earnings call transcripts from Global Systemically Important Banks (G-SIBs). These transcripts contained valuable but unstructured financial data, making it difficult for analysts to efficiently interpret key insights.

Our goal was to develop an AI-powered NLP pipeline that could automate financial analysis. The team built:

  • Sentiment analysis (FinBERT) – To determine the tone of statements made in earnings calls.
  • Topic modelling (BERTopic, LDA) – To extract key themes and discussions from the transcripts.
  • Abstractive summarisation (T5, BART) – To generate concise summaries for analysts.
  • Retrieval-augmented generation (RAG) chatbot – To allow users to query transcripts and retrieve relevant insights.

I focused on developing the RAG chatbot, ensuring that it could retrieve, summarise, and interpret financial insights in real time.

The challenges we faced (and how we solved them)

The messy data problem

Financial transcripts are long, inconsistent, and full of irrelevant content. Speaker labels weren’t standardised, and important insights were buried in corporate language.

Solution: We built a robust preprocessing pipeline to clean and structure the data before feeding it into our models.

Siloed workstreams led to disjointed outputs

Initially, team members worked on separate models independently, which caused issues when trying to integrate everything.

Solution: We introduced clear dependencies between components, aligned outputs, and used regular checkpoints to ensure all models worked together seamlessly.

Summarisation wasn’t quite working

Our summarisation models were producing generic responses because the input formatting was inconsistent.

Solution: We refined our data inputs and prompting techniques, improving the ROUGE scores and ensuring more meaningful summaries.

Adapting when models were incomplete

Some models weren’t ready on time, which could have delayed the pipeline’s progress.

Solution: We found alternative data sources and models to continue testing while waiting for finalised components.

The moment it all came together

The real turning point came when the team shifted from working in silos to working as a unit. Instead of just focusing on our own components, we started thinking about how they interacted.

One of the best moments was getting the retrieval chatbot to work smoothly – it was incredibly rewarding to query a transcript and instantly receive a meaningful, summarised financial insight. It was no longer just an academic exercise; it was something that could have real-world applications.

Lessons learned: More than just AI

This experience taught me far more than just technical skills.

  • AI isn’t just about accuracy, it’s about usability. Our models needed to work in a way that made sense for financial analysts, not just data scientists.
  • Collaboration is everything. The best AI models are useless if they don’t integrate well with the full system. Aligning workflows was critical.
  • Being adaptable is a necessity. AI projects never go 100% as planned, and the ability to pivot and refine is what makes them successful.
  • AI and data engineering are converging. The future isn’t just about building better AI models, it’s about integrating them into scalable, automated data pipelines.

Full circle: From early interest to real-world AI implementation

Thinking back to my early journey into data science, I started by exploring theory and small-scale projects, but this programme helped me apply AI in a business-critical environment. The Cambridge ICE Career Accelerator provided me with the technical expertise, leadership experience, and problem-solving skills to bridge the gap between data engineering and AI-driven decision-making.

For anyone considering this programme, my advice is simple: if you want to go beyond theory and work on AI that actually solves problems, this is the right place.

The experience has given me the confidence and capability to integrate AI into real-world data workflows, and I know that this is just the beginning of the next phase in my career.


Sheldon’s story is just one example of how the Data Science with Machine Learning & AI Career Accelerator is equipping learners to solve real business problems, lead cross-functional projects, and step confidently into the next chapter of their careers. Whether you’re a career changer, an early career professional or, like Sheldon, an experienced practitioner aiming to expand your impact – the programme provides the technical depth, industry exposure and career coaching to help you get there.

Download the brochure to learn more about how this programme can accelerate your career in data science.

SHARE

Find out more about the LSE Data Analytics Career Accelerator

Related articles

In his own words, Data Engineer Sheldon shares how the Data Science Career Accelerator helped him break into AI and land a role at Capgemini.
Discover how Mike used the King’s Product Management Career Accelerator to turn his experience into a purpose-led tech startup.
Discover how learners on the Data Science Career Accelerator advanced their careers with the Employer Project set by the Bank of England.