I like your set up. The latch is probably a wise addition.
I once had a cushioned seat that I fixed to swivel. Worked well for casting but tended to rotate back and forth while paddling, not good.
A built-in bench seat would be the simplest, but not very comfortable. Everything about boat...