### Godot version

4.0.beta16

### System information

macOS Monterey 12.3.1

### Issue description

Since Godot 4 beta 16, scrolling in a scene is very slow; it looks me a long time to reach the point I want.

Here is an example in Godot 4 beta 15:

https://user-images.githubusercontent.com/1923206/215263090-0996323f-fad5-46bf-9473-19c7754b9d69.mp4

Using Godot 4 beta 16:

https://user-images.githubusercontent.com/1923206/215263131-937e2a3c-a2c6-4d40-9a4f-c1404fb503fd.mp4

Sometimes I can scroll not too badly, but sometimes it looks like it is almost not moving.

I only have macOS to try this; I can't tell on Windows or Linux.


### Steps to reproduce

Open a scene and start to scroll.

### Minimal reproduction project

Any projects will have this issue.
ERR_FAIL_COND(p_scroll_speed <= 0);
	scroll_speed = p_scroll_speed;
}
void ViewPanner::set_scroll_zoom_factor(float p_scroll_zoom_factor) {
	ERR_FAIL_COND(p_scroll_zoom_factor <= 1.0);
	scroll_zoom_factor = p_scroll_zoom_factor;
}
void ViewPanner::set_pan_axis(PanAxis p_pan_axis) {
	pan_axis = p_pan_axis;
}
void ViewPanner::setup(ControlScheme p_scheme, Ref<Shortcut> p_shortcut, bool p_simple_panning) {
	set_control_scheme(p_scheme);
	set_pan_shortcut(p_shortcut);
	set_simple_panning_enabled(p_simple_panning);
}
bool ViewPanner::is_panning() const {
	return is_dragging || pan_key_pressed;
}
void ViewPanner::set_force_drag(bool p_force) {
	force_drag = p_force;
}
ViewPanner::ViewPanner() {
	Array inputs;
	inputs.append(InputEventKey::create_reference(Key::SPACE));
	pan_view_shortcut.instantiate();
	pan_view_shortcut->set_events(inputs);
}