NeuFlow v2: High-Efficiency Optical Flow Estimation on Edge Devices
Real-time high-accuracy optical flow estimation is crucial for various
real-world applications. While recent learning-based optical flow methods have
achieved high accuracy, they often come with significant computational costs.
In this paper, we propose a highly efficient optical flow method that balances
high accuracy with reduced computational demands. Building upon NeuFlow v1, we
introduce new components including a much more light-weight backbone and a fast
refinement module. Both these modules help in keeping the computational demands
light while providing close to state of the art accuracy. Compares to other
state of the art methods, our model achieves a 10x-70x speedup while
maintaining comparable performance on both synthetic and real-world data. It is
capable of running at over 20 FPS on 512x384 resolution images on a Jetson Orin
Nano. The full training and evaluation code is available at
https://github.com/neufieldrobotics/NeuFlow_v2.
66c3f49f359d1ee9697fba8b
Zhiyong Zhang
66c3f49f359d1ee9697fba8c
Aniket Gupta
66c3f49f359d1ee9697fba8d
Huaizu Jiang
66c3f49f359d1ee9697fba8e
Hanumant Singh
NeuFlow v2: High-Efficiency Optical Flow Estimation on Edge Devices
Real-time high-accuracy optical flow estimation is crucial for various
real-world applications. While recent learning-based optical flow methods have
achieved high accuracy, they often come with significant computational costs.
In this paper, we propose a highly efficient optical flow method that balances
high accuracy with reduced computational demands. Building upon NeuFlow v1, we
introduce new components including a much more light-weight backbone and a fast
refinement module. Both these modules help in keeping the computational demands
light while providing close to state of the art accuracy. Compares to other
state of the art methods, our model achieves a 10x-70x speedup while
maintaining comparable performance on both synthetic and real-world data. It is
capable of running at over 20 FPS on 512x384 resolution images on a Jetson Orin
Nano. The full training and evaluation code is available at
https://github.com/neufieldrobotics/NeuFlow_v2.
A new optical flow method based on NeuFlow v1 achieves high accuracy with significantly reduced computational cost, offering a 10x-70x speedup over state-of-the-art methods.
NeuFlow v1 light-weight backbone fast refinement module optical flow estimation synthetic data real-world data FPS Jetson Orin Nano