[CarsOrBikes]

I'd refit them, it'll add distance to the pad/piston and could lead to a degree of bind, probably could tapered/uneven wear, and likely as not a softer pedal

 

[CarsOrBikes]

for the oil leak, check the lower starter bolt and block right below it, if wet there it'll likely be the main seal, also wet by the 'c' access plate, brake cleaner it off there when cold and it can usually be seen to return pretty quickly, the main seal leak usually gets picked up at the bottom of the seal and flung upward collected around the starter before it collects elsewhere or gets to leak out the tell tale hole, and emerges under the starter, often mis diagnosed as only a sump gasket, when it can be just the seal or commonly both....

 

[CarsOrBikes]

as soon as I read the first line I thought that must be some pretty boring driving....

....confirmed in the second line