Press the Esc key on the keyboard to close the active side panels. The active panel is the one that has keyboard focus. When the panel is closed, keyboard focus is automatically given to the main editor.
If none of the open panels has keyboard focus, all of them will be closed. To quickly close all panels at any time, simply press the Esc key twice.