Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

malloc failed! on stories260 model #510

Open
vikramdattu opened this issue Apr 21, 2024 · 1 comment
Open

malloc failed! on stories260 model #510

vikramdattu opened this issue Apr 21, 2024 · 1 comment

Comments

@vikramdattu
Copy link

I have cloned the tinyllamas repo and trying stories260 model. It fails with the malloc failed issue

./run tinyllamas/stories260K/stories260K.bin -z tinyllamas/stories260K/tok512.bin -t 0.0
malloc failed!

15M model however works out of the box. But not able to run any model from the GH repo!

Trying it on M1 Mac. Any ideas?
@vikramdattu vikramdattu mentioned this issue Apr 21, 2024
Open
@jameswdelancey
Copy link
Contributor

When you run tokenizer.py to export the tokenizer, the legacy version will work with run.c

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@vikramdattu @jameswdelancey