In the speaker's illustrative formulation, sigmoid-activated input units act as tests of weight-defined inner products and produce values between zero and one.

“in like we can view this as let's say a thousand let's say test functions. So the activation function is let's say you make a sigmoid to make it very very instructive between zero and one. And it figures out well is this test so this weight, this inner product, is this test successful.”