Try to use Deep Learning to obtain fundamental matrices.
Deep Image Homography Estimation
Cascaded Lucas-Kanade Networks(CVPR2017)
Relative Camera Pose Estimation
run the file single_fnet.py
the arguments to be specified are mentioned in the same file.