Ken was met at Southampton by brother Bill and Chris Barber. They had already contacted Ken and advised him that they had formed a co-operative band, originally intending to use Pat Halcox, but, at the time, he had decided not to turn professional.

The first Ken Colyer Jazzmen, therefore, was formed, with Ken on trumpet, Chris Barber on trombone, Monty Sunshine on clarinet, Ron Bowden on drums, Lonnie Donnegan on banjo and Jim Bray on bass. At the time Ken told the Melody Maker: "We are going to try to popularise New Orleans music without distorting it, aborting it, or slapping any gimmicks on it. I am pleased to be reunited with some of the old Crane River bandsmen, and very glad to have Ron Bowden who is the best British drummer I have played with." Certainly not the sentiments he was to express in just over a year’s time.

After a brief period of rehearsal, the band left for a tour of Denmark. They were well received, played at several locations, including the Storyville Club, and even commandeered the Landskrona ferry for a riverboat shuffle. During their stay in Copenhagen, the band was recorded and these recordings became the first releases on the Storyville label.

The band returned to London and took-up residencies at Mack’s, 100 Oxford Street (now the 100 Club) on Monday nights, and Bert Wilcox’s Club in Bryanston Street. In September 1953 an LP was recorded for Decca, which was released under the title New Orleans to London. It included one track — a 30’s pop song "Isle of Capri," which for some reason caught the attention of Jack Payne, who played it on his BBC show. As a 78, the record sold well and even made a brief appearance in a best-sellers chart — the first British jazz record to do so.

Things seemed to be going well for Ken — but it was not to last. The break came and Ken left the band. "I had realised that Barber still considered himself the leader. All they wanted from me was a little reflected glory until the novelty wore off. I tried to meet Barber halfway musically. He was more interested in arranged numbers, all nice and tidy. I intend to re-form my band as soon as I find the musicians. If necessary I’ll search the countryside."

He did just that; recruiting Bernard Bilk from Bristol on clarinet, Eddie O’Donnell on trombone and Diz Disley on banjo/guitar from Leeds, Stan Greig from Edinburgh on drums and Dick Smith from London on bass. Almost at once they went into the Decca studios to record the LP Back to the Delta. The band was chosen to open the National Jazz Federation’s first Festival of British Jazz at the Royal Festival Hall in October.