A friend of mine told me how to make cv::findHomography more stable.
The solution is very easy, comment lines 91-121 of module/calib3d/fundam.cpp and then compile. The unstability is due to the new algorithm to compute the homography. From the function name, it checks subset of corresponding points maybe. After comment the function contents, cv::findHomography gets much more stable 🙂