Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Support shallow fusion with RNNLM #200

Open
csukuangfj opened this issue May 11, 2023 · 0 comments
Open

Support shallow fusion with RNNLM #200

csukuangfj opened this issue May 11, 2023 · 0 comments
Labels
help wanted Extra attention is needed

Comments

@csukuangfj
Copy link
Collaborator

k2-fsa/sherpa-onnx#147
added shallow fusion with RNNLM.

We also need to support it in sherpa-ncnn.

The first step is to use k2-fsa/icefall#1050 as a reference to convert the model
to ncnn. Since the RNNLM uses only nn.Embedding, nn.Linear, nn.LSTM, it should be straightforward to
convert the model to ncnn via PNNX.

The next step is to use k2-fsa/sherpa-onnx#147
as a reference to add code to sherpa-ncnn. Since sherpa-ncnn does not support batch size > 1, the implementation should be much simpler.

Help from the community is highly appreciated. If you have any doubts, please leave a message and we can help you.

@csukuangfj csukuangfj added the help wanted Extra attention is needed label May 11, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
help wanted Extra attention is needed
Projects
None yet
Development

No branches or pull requests

1 participant