That's something anyway!
I wouldn't fall into the trap of going all aero (i.e. bike, wheels etc) as you'll (obivously) go a lot faster - but that's not the point. The point is to measure your improvement like-for-like. Even without aero wheels and tri bars you're now quicker than Boltboi whom I assume was shaved down, fit and lean, aero and on very light carbon race wheels?
For academic purposes you could borrow BB's wheels and watch yourself go 2 minutes or so quicker one day on a solo effort, just to feel better about how much faster they do make it.
Yeah I didn't have any issues riding the roadie and would continue to do so (without aero bars, mmm bubbles of nothing), unless I wanted to test the TT bike one day for laughs. Only thing is it wasn't quite like-for-like for me. That's only the second time I've done the Champion Lake 20km but first time was on the Giant TCR and second time on the Trek, which I know for certain can do KP loops faster than the Giant. Don't really know how they compare on the flats though.
I can see an E-Bike in your future