Real-Time Optical Flow Estimation

Major progress has been made for estimating optical flow using deep neural networks in recent years. However, optical flow estimation is an extremely computationally expensive task as it requires computing estimates of the motion between two time steps of a video or a sequence of images. We build upon the previous work RAFT which is the current state-of-the-art approach for optical flow estimation. In this work, by applying techniques such as pruning, quantization, and distillation we aim to improve the inference time of RAFT. Our experiments show that our model achieves similar performance while also being faster and light weight in comparison to original RAFT architecture.

You can find our code in this github repo, paper here, and our video presentation here.

Charles Nimo
Charles Nimo
Computer Science

I am broadly interested in machine learning, trustworthy AI, and computer vision.

Related