Update : This problem may have come from somewhere else and the trick explained here somehow worked. I’m not sure.
I discovered a problem on my EKF later on that led to the oscillations coming back. I solved it here. So please bear in mind that the advice/fix I gave in this thread were done with a malfunctioning EKF that could have been the real root of the issue.