How can I make bidirectional search

So I did manage to make frame interpolation by using algorithms for motion estimation ( three step, and diamond search) , but they are unidirectional, now im stack cause i need them to be bidirectional (interpolated frame need to be predicted from previouse and current frame). Any ideas how to do that ?