Capital Code Academy V2 – Public Learning Edition • Begin AI Essentials
Technology explained

Transformer

A neural-network architecture that uses attention to process relationships in sequences.

In plain language

A neural-network architecture that uses attention to process relationships in sequences. The most useful way to understand this concept is to connect it to a real problem rather than memorising a definition.

Why it matters

Transformer influences how modern digital systems are designed, used or evaluated. Learners should understand its purpose, limitations and relationship to other technologies.

Simple example

Imagine a learner or organisation trying to make a digital service faster, safer or easier to use. Transformer may be one part of the system that helps information move, decisions happen or results become more relevant.

Questions to ask

  • What problem does it solve?
  • What input does it need?
  • What can go wrong?
  • How should a human verify the result?
Continue learning: Explore the course catalogue for a guided lesson and practical activity related to Transformer.