Nick Cave and Kylie Minogue reunited on-stage in Victoria Park for a rare performance of their hit Where the Wild Roses Grow.

The legendary Australian showman also played a string of hits from his back catalogue with his band the Bad Seeds to close the All Points East festival, which has been taking place in the park since the beginning of last weekend.

Fellow Aussie Minogue, who recently celebrated her 50th birthday, joined him to perform their 1995 hit duet to the delight of the tens of thousands of music fans who had descended on the park – most of whom erupted when Cave announced she would be joining him.

The song, which was released in 1995, has rarely been performed live by the pair and was last played in London in 2013.

The immaculately dressed rocker made a lively start to the show, only pausing to ask for someone to hand him a knife so he could rough up the leather soles of his brand new pair of shoes to stop him falling over.

One of the songs that prompted the biggest reaction from the crowd was Red Right Hand, repopularised by the soundtrack for BBC crime drama Peaky Blinders.

Spine-chillingly brutal renderings of From Her to Eternity and Do You Love Me? made up the highlights, as Cave tore mercilessly into song after song with a power that would put people half his age to shame.

Towards the end of his set, the performer beckoned people from the crowd up beside him during an extended version of Stagger Lee and an intense performance of Push the Sky Away – and soon enough rapturous fans had packed out the stage.

But the stunt didn’t interfere with the show, with the crowd members stood at the back of the stage, dancing and singing along.

Fans took to social media after the show to discuss Cave’s performances. One Twitter user said: “I went from not wanting to see Nick Cave to becoming his biggest fan yesterday at All Points East. From now on I will only wear slim cut suits and white shirts.”