Illegal updates with sigmoid

Heard this in an NPTEL lecture, probably from Mitech Khapra from IITM, that for sigmoid some directions are illegal. This serves as an attempt to understand why.

Last updated: September 25, 2025