A router scores four experts for each token and sends it to the best one or two, as long as they have room. Tokens over capacity are dropped, and a load-balance loss measures how evenly the work is spread.
This interactive visualization needs JavaScript.