Another "The Thick Of It" question about British references

In s03e06 of The Thick of It, Ben and Ollie have a rapid exchange which is full of references that I've never heard of... Can anyone explain what these bold parts are about? I assume they're just references to specific elements of British culture.

GLENN: Ah, the prodigal Swain returns.

OLLY: Ben 10! Benstrual cycle. Ben on the 4th of July.

BEN: Olly put the kettle on, on the good ship Olly-pop, Olled Lang Syne

OLLY: How are things going at the, uh, Department of Education Education Education?

BEN: There's shit going up the foot pump, Olly. Mainly because you are the Robin Hood of politics.

OLLY: Well, Robin Hood was a hero.

BEN: No, he was not a hero. He was a terrorist.

What is Ben calling Olly with all these nick names? Why does Olly say Education three times? And what is this "foot pump" reference?

dialogue the-thick-of-it

Best Answer

Brit here. Allow me to explain:

"Olly put the kettle on" is a reference to the nursery rhyme "Polly Put The Kettle On".
"On the good ship Olly-pop" is presumably a reference to the Shirley Temple song "On The Good Ship Lollipop". (Credit for this one goes to @Yasskier, in an answer he's since deleted - I'd never heard of the song myself.)
"Olled Lang Syne" is a reference to the Robert Burns poem "Auld Lang Syne", which in Britain is traditionally sung at New Years' celebrations.
"Department of Education Education Education" - this is a reference to a famous speech by former British Prime Minister Tony Blair, in which he claimed that his three top priorities in office would be "education, education, and education". Given that The Thick of It is a series about politicians, the reference is quite fitting.
This is a foot pump:

It's used to blow up inflatables: you stamp hard on the pedal and it blows air out through the tube. "There's shit going up the foot pump" has roughly the same meaning as "shit's just hit the fan".