You don't need to remove anything to get at the nuts which hold the pegs on!
They are a little bit fiddly to get at, but really not a problem. The only problem is they are real tight, as they have been loctite'd into place. Just need a spanner (12mm I think?), and you can get to them from behind the bike.
I have removed mine, but will put them on whenever my missus wants to go on the back, only takes 5 minutes to put back on.