I've been thinking for a while that a single scull might be a good fit for you (not that I've ever been in one myself, all of my limited rowing was in an eight). In fact, I was discussing that with Aims at Pawtuckaway. There are challenges involved in owning one and getting it on and off of a car, but if there's a nearby boathouse where the logistics would be easier, I think you should try it. I can definitely picture you rowing on the Connecticut, and it's a pleasant picture.
I had a city council colleague who was a lifetime sculler. He was/ is impressively fit.
The shoulders, leg and core workout is pretty well unparalleled and in my case the stretching out of the back seems it cannot hurt.
I also thought about taking it up but in the end decided that if I were to try one of the two the kayak would be the one for me.
The only things I can think of to be aware of are: 1) you have to be okay with the notion of traveling backwards, and 2) you probably aren't built to be competitive at it, because you're not particularly tall. Not an issue if you're rowing for exercise and enjoyment.
I was a canoe guy, and now I'm a kayak guy. But sculling seems markedly more elegant.
Not to mention the opportunity to get tips from a world class competitor.