### Godot version

4.0.beta16

### System information

macOS Monterey 12.3.1

### Issue description

Since Godot 4 beta 16, scrolling in a scene is very slow; it looks me a long time to reach the point I want.

Here is an example in Godot 4 beta 15:

https://user-images.githubusercontent.com/1923206/215263090-0996323f-fad5-46bf-9473-19c7754b9d69.mp4

Using Godot 4 beta 16:

https://user-images.githubusercontent.com/1923206/215263131-937e2a3c-a2c6-4d40-9a4f-c1404fb503fd.mp4

Sometimes I can scroll not too badly, but sometimes it looks like it is almost not moving.

I only have macOS to try this; I can't tell on Windows or Linux.


### Steps to reproduce

Open a scene and start to scroll.

### Minimal reproduction project

Any projects will have this issue.
pan_key_pressed = false;
	is_dragging = false;
}
void ViewPanner::callback_helper(Callable p_callback, Vector<Variant> p_args) {
	const Variant **argptr = (const Variant **)alloca(sizeof(Variant *) * p_args.size());
	for (int i = 0; i < p_args.size(); i++) {
		argptr[i] = &p_args[i];
	}
	Variant result;
	Callable::CallError ce;
	p_callback.callp(argptr, p_args.size(), result, ce);
}
void ViewPanner::set_callbacks(Callable p_pan_callback, Callable p_zoom_callback) {
	pan_callback = p_pan_callback;
	zoom_callback = p_zoom_callback;
}
void ViewPanner::set_control_scheme(ControlScheme p_scheme) {
	control_scheme = p_scheme;
}
void ViewPanner::set_enable_rmb(bool p_enable) {
	enable_rmb = p_enable;
}
void ViewPanner::set_pan_shortcut(Ref<Shortcut> p_shortcut) {
	pan_view_shortcut = p_shortcut;
	pan_key_pressed = false;
}
void ViewPanner::set_simple_panning_enabled(bool p_enabled) {
	simple_panning_enabled = p_enabled;
}
void ViewPanner::set_scroll_speed(int p_scroll_speed) {