Most capacitors do not have an electrolyte. Most have a dielectric, this may be vacuum, air, plastic or aluminium oxide in electrolytic capacitors.
Voltage is limited by the breakdown of the dielectric. Vacuum is best, modern plastics are very good and the dielectic constant is much higher than one so the capacitor can be much smaller.