Bargy's work for the Benson Orchestra established him as a triple-threat talent, and his services were soon sought out by other bands. In late 1921, after a falling out with Benson, Bargy left and formed his own orchestra, taking many members of the group with him. He disbanded a few years later and joined the band led by composer-saxophonist Isham Jones. In 1928, Bargy began a twelve-year association with Paul Whiteman's great dance orchestra as pianist/arranger. Now his experience in editing and writing songs for the old Imperial Piano Roll company stood him in good stead. Many of the early Whiteman arrangements were done by Bargy. He remained with Whiteman until 1940 working not only as a Pianist and arranger, but even becoming second in command and often leading the band when Whiteman couldn't be present. Not too well recalled now, but it was Bargy's piano that was afeatured attraction during Whiteman's famous debut of Gershwin's "Rhapsody in Blue".