Your widgets will be listed on the left side of the screen. Select a widget, then press the delete button to delete it.

If you have a widget that needs to be saved but does not need to show up on the website, you can use the active feature. Uncheck the active box to deactivate the widget and you will be able to activate it at any time in the future.