I just tried putting the bolts in the top existing holes and I think I might be alright for clearance. Drilling the plate for the bottom ones to line up with existing holes seems the way to go.
I need to space out to access the key. So I'll try mounting the bags on the top two bolts when I get some spacers. Then have a closer look at the clearance.