You should never remove items that are in the vanilla game. Instead, move them and/or disable them.
Use TES5Edit to make sure it's clean
Right click on your .esp -> Apply Filter for Cleaning. Right click on your .esp again and choose "Remove Identical to Master". Then, right click on your .esp again and choose "Undelete and Disable".
Mod Compatibility