Performance on a GPU is slower than on CPU on Android

[hristorv]

I have tested both the CPU and the GPU versions in the newest version 2.0 with zipformer model and the performance on the GPU is far slower than on the CPU. I am doing something wrong? Do I need to change some of the settings? I am assuming that the GPU should be faster than the CPU version.

[csukuangfj]

How did you test it?

[hristorv]

I've added my own RTF and for the CPU it is around 0.4 and for the GPU it is more than 1. I've played with all configurations and i have not seen any difference?

[spianmo]

我已经在最新版本 2.0 中使用 zipformer 模型测试了 CPU 和 GPU 版本，GPU 的性能远低于 CPU。我做错了什么？我需要更改某些设置吗？我假设 GPU 应该比 CPU 版本快。

I also have the same problem

[danpovey]

It's possible that the GPUs on some of these handheld devices are designed more to reduce power consumption than to make things faster?

[spianmo]

It's possible that the GPUs on some of these handheld devices are designed more to reduce power consumption than to make things faster?

May be NCNN vulkan efficiency problem