I'd guess you are looking at a cap failure in the original PSU. 386 era is what, early 90s. 30+ years is a good run. If a replacement PSU doesn't have a switch, you could always hook it to a surge ...
Whenever possible, a computer should be shut down from the operating system. This ensures open files are saved, temporary files are deleted, and applications and the operating system are properly ...