I think the operative factor here is related to the volumetric measure of your cojones.
The Brittain System is most forgiving (unlike the Max 8) of pilot override actions. My experience with a failed aileron servo was a somewhat aggravating pull that was easily overcome and removal of the PC button cut it out completely. Of course, I then had no PC. In my experience it is always obvious when the Brittain is not working. When it IS working is not always obvious--I had a CFI/I remark to me during a training flight that I had "Excellent rudder skills." He had no idea that the PC was doing all the work.
IMNSHO, an AP should always be viewed as a convenience and never an essential element of pilotage. So, what you need to be prepared for is the fact that it will fail, period. When that happens is left to probability. So you slap some "Rapid Rubber Repair" on the servo and go flying on a beautiful VFR day. If it works fine, you are done--but you must always be prepared for it not working in the future.
Far too many pilots are dependent on equipment rather than basic "Stick & Rudder" skills to the point that when the equipment takes control of their aircraft they fail to realize what is happening and, even worse, they do not know how to take the control back.