An illustration of a sandwich

Image courtesy of Getty Images.

Researchers to teach robots how to differentiate between sandwich ingredients so they can make your favourite BLT

Loughborough University computer scientists have teamed up with a food production automation company for a project that looks to teach AI robots how to differentiate between food items so they can make sandwiches in real-world factory environments.

Project lead Dr Baihua Li, of the School of Science, hopes the research with Millitec Food Systems will “empower a range of new automation functions on food production conveyors and pipelines”.

Food manufacturing is the largest manufacturing industry within Europe, but the industry faces major problems with labour supply due to increased costs and a shortage of workers willing to undertake less-skilled roles.

Millitec supplies hi-tech manufacturing machinery and a range of robotic products for food production automation that look to plug this gap in the industry.

It has developed a range of technology that can assemble and pack sandwiches, with the intention of reducing intensive labour work required on production conveyors.

Their current sandwich-assemblers are able to assist in the sandwich-making process – for example, they can butter bread and cut sandwiches – but they are unable to undertake tasks that require them to differentiate between items, such as selecting salad toppings to put inside a sandwich.

The project with Loughborough University looks to take the robotic technology to the next level of intelligence.

Dr Li and her team of researchers are to develop machine vision and embedded artificial intelligence (AI) technology for the robot manipulators that will enable them to recognise a variety of items and carry out more advanced tasks such as picking up the right elements in the right amount and order.

They will investigate using a low-cost reliable camera and sensing system on Millitec’s ‘Delta robots', which, in essence, will allow the machines to ‘see’.

They will then develop algorithms that train the robots to recognise various breads and food ingredients, and accurately detect their location and orientation.

 Millitec's Delta robot.

Millitec’s Delta robot.

The academics will create the algorithms using ‘deep learning’ – a method of teaching a machine how to carry out tasks automatically without explicit human instructions.

This involves collecting thousands of images and getting a computer system to analyse them, so it learns what different items look like.

As well as being taught how to identify food items, the Millitec robots will be trained to spot and deal with errors on production conveyors, such as missing ingredients or items in the wrong position.  

The developed technology will be deployed as an embedded system on Millitec’s existing automation machines, meaning the prepacked sandwich you purchase from the petrol station in the near future could have been made from start to finish by robots.

 A sandwich with its ingredients above it in the air

The machines will be taught how to differentiate between different food items – meaning one day the sandwich you purchase may have been prepared entirely by robots. Image courtesy of Getty Images. 

Dr Li commented:Loughborough's Computer Science department has a solid track record and expertise in AI.

“Industry presents new challenges to our research and this project will deal with various challenges in real-world factory conditions and meet the commercial requirements in accuracy, safety and speed.

“The developed robust vision algorithms and camera-based sensing system will also reduce the system manufacturing cost.

“We will transfer the latest advances of our research in machine vision, deep learning and robotics to drive innovation for high care food manufacturing.

“Successful development and commercialisation of the robotics system will significantly reduce the human workforce and improve production quality and efficiency, allowing employees to focus on higher-value activities.”

Richard Ledger, Managing Director of Millitec, said: “We’re thrilled to be developing the latest range of food production robotics in conjunction with Loughborough University.

“Throughout our 15 years in the industry, we have seen the challenges presented by skills shortages, and a clear need for a technological solution to support food manufacturers.

“This development project will be a major leap forward in food production automation.”

This research is a 24-month KTP (Knowledge Transfer Partnership)* project, jointly funded by Millitec and Innovate UK.

KTPs aim to help businesses improve their competitiveness and productivity through the better use of knowledge, technology and skills that reside within the UK knowledge base.

For further information on Loughborough University’s Computer Science department, click here.

Notes for editors

Press release reference number: 20/09

*Knowledge Transfer Partnerships 

Knowledge Transfer Partnerships (KTPs) are funded by UKRI through Innovate UK with the support of co-funders, including the Scottish Funding Council, Welsh Government, Invest Northern Ireland, Defra and BEIS. Innovate UK manages the KTP programme and facilitates its delivery through a range of partners including the Knowledge Transfer Network (KTN), Knowledge Bases and Businesses. Each partner plays a specific role in the support and delivery of the programme.

Loughborough University 

Loughborough University is equipped with a live in-house broadcast unit via the Globelynx network. To arrange an interview with one of our experts please contact the press office on 01509 223491. Bookings can be made online via

Loughborough is one of the country’s leading universities, with an international reputation for research that matters, excellence in teaching, strong links with industry, and unrivalled achievement in sport and its underpinning academic disciplines.

It has been awarded five stars in the independent QS Stars university rating scheme, named the best university in the world for sports-related subjects in the 2019 QS World University Rankings, University of the Year by The Times and Sunday Times University Guide 2019 and top in the country for its student experience in the 2018 THE Student Experience Survey.

Loughborough is in the top 10 of every national league table, being ranked 4th in the Guardian University League Table 2020, 5th in the Times and Sunday Times Good University Guide 2019 and 8th in The UK Complete University Guide 2020.

Loughborough is consistently ranked in the top twenty of UK universities in the Times Higher Education’s ‘table of tables’ and is in the top 10 in England for research intensity. In recognition of its contribution to the sector, Loughborough has been awarded seven Queen's Anniversary Prizes.

The Loughborough University London campus is based on the Queen Elizabeth Olympic Park and offers postgraduate and executive-level education, as well as research and enterprise opportunities. It is home to influential thought leaders, pioneering researchers and creative innovators who provide students with the highest quality of teaching and the very latest in modern thinking.


Loughborough staff, students and alumni make a real difference. They challenge convention, think creatively and find solutions to some of the biggest challenges facing society today and in the future.

Meet the #LboroGameChangers at