If a work unit in the folder is being edited, first set the work unit to "Exclude from editing."
Right-click the Work Unit folder and select Delete. Deleting will also delete the work unit and associated files contained in the folder on the local file system.