Continuos position error while copter is in mission

Hello all, our drone MTOW is 5.5kg, survey and mapping copter. While doing a mission position variance is going high which leads drone pitch up and down and at cornering it starts wobbling. I have gone through the logs, and as per my findings whenever rangefinder detects sun rays the position variance is going and making drone unstable. is it the rangefinder causing this issues or any other parameter should be changed. please suggest some good solution to overcome this.

Get a better outdoors capable lidar.

I am using Benewake TF02 pro rangefinder. My doubt, is it the rangefinder causing the position error or any other problem?