Fix push problem and add flatten layer and assert

Fix push problem and add flatten layer and assert #620