Oliver completed a Bachelor of Music – Tuba Performance at the Sydney Conservatorium of Music in 2003, and obtained his Bachelor of Teaching (High School Music) from the University of Western Sydney in 2005.

He has extensive experience teaching privately as a trumpet, trombone, euphonium and tuba teacher at various schools around Sydney, including North Sydney Demonstration Primary and North Strathfield Public Schools.

Oliver moved to Western NSW in 2006, where he taught music and language at Parkes High School and conducted the Parkes High School Concert Band. Oliver also taught music and art at Broken Hill High School before moving to Bathurst in 2009.