Exit Richmond Park through Roehampton Gate, onto Priory Lane. The entrance to the sports ground is off Bank Lane. There is parking but I would get there early! For a quick getaway park on the street. There is a nice Costa Coffee in the clubhouse (it is a bank after all).
View with Google Maps
Parking is limited so park near to the outside of the pitches