Skip to content

Conversation

@alvoron
Copy link
Contributor

@alvoron alvoron commented Jul 5, 2024

Details:

  • Subgraph tests are enabled on ARM platforms

Tickets:

@alvoron alvoron requested review from a team as code owners July 5, 2024 12:00
@github-actions github-actions bot added the category: CPU OpenVINO CPU plugin label Jul 5, 2024
@alvoron alvoron added the platform: arm OpenVINO on ARM / ARM64 label Jul 5, 2024
@alvoron alvoron force-pushed the alvoron_subgraph_tests2 branch from e9c1c60 to d727e6a Compare July 5, 2024 14:23
Copy link
Contributor

@EgorDuplensky EgorDuplensky left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Can we try to enable causal mask preprocess fusion for ARM as well?
@usstq What do you think?

};

#if defined(OPENVINO_ARCH_ARM)
const ExpectedResult successfull_fuse_result{1, 1, 3};
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

It seems the reason is an additional reorder appears in the graph because the Eltwise (bias?) is not fused into groupconvolution node

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Copy link
Contributor

@EgorDuplensky EgorDuplensky left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@maxnick Can we use a planar layout for ReLuConcatConvSumInPlaceTest subgraph test? Since currently the test forces blocking layout it is impossible to run it on ARM

Copy link
Contributor

@EgorDuplensky EgorDuplensky left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

let's remove layout specialization from interaction subgraph test and enable it for ARM as well.

@@ -0,0 +1,90 @@
// Copyright (C) 2018-2024 Intel Corporation
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Why we have to make those instances x86 specific?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Reference implementation (ref_any) does not support nchw/ndchw layouts on ARM. I've got the error No supported primitive descriptors matched the provided input / output memory format filters while pushing these layouts into the test.
nspc works well for reference on both ARM and x64. Can we replace nchw/ndchw with nhwc/ndhwc and keep conv tests common?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Discussed with Dmitry, there is no need to enable ncsp descriptor for ARM in Convolution node. We will keep ncsp tests as x64-specific.


TEST_P(FuseTransposeAndReorderTest3, CompareWithRefs) {
run();
check_transpose_count(1);
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

what result do we get for ARM?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

There is no Transpose on ARM.

@maxnick
Copy link
Contributor

maxnick commented Jul 9, 2024

ReLuConcatConvSumInPlaceTest

Yes, sure, but please use nspc layout instead as the main one for optimized convolution implementations.

@alvoron
Copy link
Contributor Author

alvoron commented Jul 9, 2024

let's remove layout specialization from interaction subgraph test and enable it for ARM as well.

As discussed offline, Interaction node and interaction transformations are enabled on x64 only, so Interaction tests are x64 specific as well.

@alvoron alvoron force-pushed the alvoron_subgraph_tests2 branch from 5a9b362 to 37ab2c6 Compare July 9, 2024 13:06
selectedType += execType.get_type_name();
}

std::vector<CPUSpecificParams> filterCPUSpecificParams(const std::vector<CPUSpecificParams>& paramsVector) {
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Let's revert this change and fix the particular test cases which cause the issue

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This change is reverted (this method has been moved to utils/x64/filter_cpu_info.cpp
2 methods - getCPUParamsBlocked4D and getCPUParamsBlocked5D were implemented in single_layer_tests/slice.cpp to do x64-specific fintering

@dmitry-gorokhov dmitry-gorokhov added this pull request to the merge queue Jul 16, 2024
@dmitry-gorokhov dmitry-gorokhov added this to the 2024.4 milestone Jul 16, 2024
Merged via the queue into openvinotoolkit:master with commit 6805e62 Jul 16, 2024
@alvoron alvoron deleted the alvoron_subgraph_tests2 branch July 16, 2024 09:10
spran180 pushed a commit to spran180/openvino that referenced this pull request Jul 27, 2024
### Details:
 - Subgraph tests are enabled on ARM platforms

### Tickets:
 - CVS-112267
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

category: CPU OpenVINO CPU plugin platform: arm OpenVINO on ARM / ARM64

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants