Patchouli is quite a big library and it doubles your mod size.
Users will be forced to download Patchouli manually and this is good because they will know about it - will (probably) read the description and know what is Patchouli doing, also, users will check for its updates and this can fix some future issues (like users reporting on your repo some crash that is caused by something being broken in this library)
Alternatively, you can release an additional version without Patchouli if you don't want to remove it.
Patchouli is quite a big library and it doubles your mod size. Users will be forced to download Patchouli manually and this is good because they will know about it - will (probably) read the description and know what is Patchouli doing, also, users will check for its updates and this can fix some future issues (like users reporting on your repo some crash that is caused by something being broken in this library)
Alternatively, you can release an additional version without Patchouli if you don't want to remove it.