Skip to content

Regression test for cudaoptflow NvidiaOpticalFlow tests failing #3374

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
4 tasks done
cudawarped opened this issue Nov 14, 2022 · 0 comments
Open
4 tasks done

Regression test for cudaoptflow NvidiaOpticalFlow tests failing #3374

cudawarped opened this issue Nov 14, 2022 · 0 comments
Assignees

Comments

@cudawarped
Copy link
Contributor

cudawarped commented Nov 14, 2022

System information (version)
  • OpenCV => 4.6.0 (master latest commits as of 14/11/22)
  • Operating System / Platform => Windows 11 64 Bit
  • Compiler => Visual Studio 2022
  • GPU => NVIDIA GeForce RTX 3070 Ti Laptop
Detailed description

The regression tests for NvidiaOpticalFlow_1_0 and NvidiaOpticalFlow_2_0 are failing.

The test for NvidiaOpticalFlow_1_0 fails because the result is different to the gs result. This could be because I am using different hardware to that which generated testdata/gpu/opticalflow/nvofGolden.flo. However the test for NvidiaOpticalFlow_2_0 is failing because the results file

testdata/gpu/opticalflow/nvofGolden_2.flo

doesn't exist?

Steps to reproduce
opencv_test_cudaoptflow.exe --gtest_filter=CUDA_OptFlow/NvidiaOpticalFlow_*_0.Regression/0
[==========] Running 2 tests from 2 test cases.
[----------] Global test environment set-up.
[----------] 1 test from CUDA_OptFlow/NvidiaOpticalFlow_1_0
[ RUN      ] CUDA_OptFlow/NvidiaOpticalFlow_1_0.Regression/0, where GetParam() = NVIDIA GeForce RTX 3070 Ti Laptop GPU
D:\repos\opencv\contrib\modules\cudaoptflow\test\test_optflow.cpp(522): error: Expected: (checkSimilarity(golden, upsampledFlow)) <= (1e-10), actual: 0.0709006 vs 1e-10
[  FAILED  ] CUDA_OptFlow/NvidiaOpticalFlow_1_0.Regression/0, where GetParam() = NVIDIA GeForce RTX 3070 Ti Laptop GPU (205 ms)
[----------] 1 test from CUDA_OptFlow/NvidiaOpticalFlow_1_0 (205 ms total)

[----------] 1 test from CUDA_OptFlow/NvidiaOpticalFlow_2_0
[ RUN      ] CUDA_OptFlow/NvidiaOpticalFlow_2_0.Regression/0, where GetParam() = NVIDIA GeForce RTX 3070 Ti Laptop GPU
D:\repos\opencv\contrib\modules\cudaoptflow\test\test_optflow.cpp(606): error: Value of: golden.empty()
  Actual: true
Expected: false
[  FAILED  ] CUDA_OptFlow/NvidiaOpticalFlow_2_0.Regression/0, where GetParam() = NVIDIA GeForce RTX 3070 Ti Laptop GPU (3789 ms)
[----------] 1 test from CUDA_OptFlow/NvidiaOpticalFlow_2_0 (3790 ms total)

[----------] Global test environment tear-down
[==========] 2 tests from 2 test cases ran. (3997 ms total)
[  PASSED  ] 0 tests.
[  FAILED  ] 2 tests, listed below:
[  FAILED  ] CUDA_OptFlow/NvidiaOpticalFlow_1_0.Regression/0, where GetParam() = NVIDIA GeForce RTX 3070 Ti Laptop GPU
[  FAILED  ] CUDA_OptFlow/NvidiaOpticalFlow_2_0.Regression/0, where GetParam() = NVIDIA GeForce RTX 3070 Ti Laptop GPU
Issue submission checklist
  • I report the issue, it's not a question
  • I checked the problem with documentation, FAQ, open issues,
    forum.opencv.org, Stack Overflow, etc and have not found any solution
  • I updated to the latest OpenCV version and the issue is still there
  • There is reproducer code and related data files: videos, images, onnx, etc
@cudawarped cudawarped changed the title Regression NvidiaOpticalFlow tests failing Regression cudaoptflow NvidiaOpticalFlow tests failing Nov 14, 2022
@cudawarped cudawarped changed the title Regression cudaoptflow NvidiaOpticalFlow tests failing Regression test for cudaoptflow NvidiaOpticalFlow tests failing Nov 14, 2022
@asmorkalov asmorkalov self-assigned this Jan 26, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

3 participants