Walton & Hersham play their home games at the Elmbridge Sports Hub, Waterside Drive, Walton-on-Thames, Surrey, KT12 2JP.
The club moved into the stadium for the 2017–18 season following a two-year, £20 million redevelopment on the site of the former Waterside Stadium. The stadium was shared with Walton Casuals until they folded, as well as the local athletics club with an eight-lane Olympic standard athletics track located behind the main stand and clubhouse of the football stadium.
The club have spent much of their history at Stompond Lane, where they began playing upon formation in 1945. The Swans notably hosted Southampton in a 6–1 defeat in the 1957–58 FA Cup First Round and earned a 0–0 draw against Brighton & Hove Albion in the 1973–74 FA Cup edition. In 2017, the stadium was demolished to make way for new housing developments as the club moved across town.