Putting away elixer and rare candy on skyblock?

I cannot for the life of me figure out how to get this stuff out of my inventory, I figure it's intentionally supposed to be glued to your inventory but at the same time the game won't let me go into the pvp zone without taking the elixer out. Kind of infuriating. How do I get these out of my inventory?

 

You can put these stuff in your ender chest