If an object is removable, you can delete it from the context menu that appears when you right-click on it.
You can also delete an object by pressing the DEL key.