Loiter reaction tuning

Is it possible to tune the Loiter mode to be very smooth when RC sticks are centered. And same time to stay crisp on RC input?

For example when I hovering in a windy conditions then I wand my copter to not jerk fighting the gusts (it is OK for me that copter will drift ± some meters near the hover point).
But if I push RC stick then I want my copter to be crisp.

I know there are Loiter parameters and RC_FEEL
But it is looks like they only allows to make copter smooth on RC input and crisp on location holding (i.e. contrariwise of my task).

Does anyone has an idea?