All Over the Place was The Bangles' first full length album for Columbia Records. Released in 1984, the sound is lively and shows more Bangles collaboration and less keyboard overdubs that were used later on their more commercially successful albums. Although the album was not a commercial success, it gave them the chance to perform as an opening act for Cyndi Lauper and Huey Lewis and the News and brought the group to the attention of Prince, who would write Manic Monday, their first hit.

Two singles were released from this album, "Hero Takes a Fall", which peaked outside the U.K. Top 40, and "Going Down to Liverpool," written by Kimberley Rew of Katrina and the Waves,  which won the Bangles the BPI Award, the British equivalent of the Grammy. The video for "Going Down To Liverpool" features Leonard Nimoy, who plays the part of the band's chauffeur.