Traveling west from the intersection of Victoria Rd S and College Ave E, take the first driveway to the left.  You cannot see the Arboretum from College, however it is just a short drive up the lane.
Free parking is available at the Arboretum

Link to Arboretum map page