Destroy direct buffer promptly instead of waiting for GC

Destroy direct buffer promptly instead of waiting for GC #42