That's about the middle of the area to be. At this point, the map is of the Hemlock Hills section and just working into the Wooster part you were at your 4k mark.
From 2009 The plan is to go all the way to Rt 7. As you say - really nice woods and terrain.
You went up to/and along the ridge on the Ives Trail that Rick laid out all the way through Tarrywile and beyond.
There is also a map of the area S of Bennett Pond to where you parked.