If you have less downforce your wheels have less traction, I’m thinking more pedal pressure (clamping force) to achieve the same braking force.
Second, if you have lots of traction, you are less likely to need brakes.
Third, unloading and loading the tires suddenly due to big changes in downforce, would also translate to big brake force changes. Those big spikes would cause temps to spike.
Just throwing out some guesses. Probably other factors.