Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[BUG] Fix some bugs in OpenMoE Implementation #5267

Open
wants to merge 8 commits into
base: main
Choose a base branch
from
Open

[BUG] Fix some bugs in OpenMoE Implementation #5267

wants to merge 8 commits into from

Commits on Jan 13, 2024

  1. only import LoadBalancer when needed to avoid errors

    @Orion-Zheng
    Orion-Zheng committed Jan 13, 2024
    Configuration menu
    Copy the full SHA
    e65d2b2 View commit details
    Browse the repository at this point in the history

  2. Update README with inference demo and update requirements

    @Orion-Zheng
    Orion-Zheng committed Jan 13, 2024
    Configuration menu
    Copy the full SHA
    a44a830 View commit details
    Browse the repository at this point in the history

  3. update config files for different models

    @Orion-Zheng
    Orion-Zheng committed Jan 13, 2024
    Configuration menu
    Copy the full SHA
    fb8c5ec View commit details
    Browse the repository at this point in the history

  4. update inference example

    @Orion-Zheng
    Orion-Zheng committed Jan 13, 2024
    Configuration menu
    Copy the full SHA
    3d000cc View commit details
    Browse the repository at this point in the history

  5. correct some bugs in modeling_openmoe.py

    @Orion-Zheng
    Orion-Zheng committed Jan 13, 2024
    Configuration menu
    Copy the full SHA
    64bc50b View commit details
    Browse the repository at this point in the history

  6. Save half of the memory used for converting checkpoints by using init… 

    …_empty_weights and lazy_parameters
    @Orion-Zheng
    Orion-Zheng committed Jan 13, 2024
    Configuration menu
    Copy the full SHA
    2c416de View commit details
    Browse the repository at this point in the history

  7. update convert_openmoe_ckpt.sh and fix typos in modeling_openmoe.py

    @Orion-Zheng
    Orion-Zheng committed Jan 13, 2024
    Configuration menu
    Copy the full SHA
    2eee01f View commit details
    Browse the repository at this point in the history

  8. add cpu support to device.py

    @Orion-Zheng
    Orion-Zheng committed Jan 13, 2024
    Configuration menu
    Copy the full SHA
    80eeb06 View commit details
    Browse the repository at this point in the history