I'm learning networking. I had however a doubt is there a way to manually reboot the above switches and routers besides the command line? By maybe unplugging and plugging the equipment quickly or a reboot button anywhere on the equipment?
Cisco has always been known to not include any on/off or reset buttons on any of their switching equipment. The only way, besides the CLI (Command Line Interface), to restart or reset your switch is to disconnect the power and reconnect it again.
All Cisco equipment is made from military grade parts, though some will argue, that the quality over time has deteriorated. But it will definitely not take any damaged from a hard power unplug reset.
The routers on the other hand, can have an on/off button, but it depends a lot on the model.