To delete a selected part from the parts palette, from the Options menu, select Modify Palette > Delete Part.