Calculus of the Inverse Logit Function
I was recently doing some logistic regression, and calculated the derivative of the Inverse Logit function (sometimes known as expit), to understand how the coefficients impact changes depending on the predicted probability. It turns out it has some mathematically interesting properties that I thought would be fun to explore.
The inverse logit function is
This is interesting in that if the predicted probability is p, then a small change in a predictor with a coefficient a should change the probability by approximately
However I find this expression interesting and wanted to find out whether it defines the inverse logit function. We want to find a function
Integrating gives
so that this indeed does define the inverse logit up to a translation.
Translating it to an inverse logit so that the maximum probability is at 0 gives it one more interesting property,
Of course this symmetry property isn’t defining, since any function defined on the positive numbers between 0 and 1 can be extended on the negative numbers to satisfy this property.