Fleece Need Help

OK, so I need some tips on how to make the fleece I have work. Should have done more research before switching, but I've already switched and currently have 5 pieces of nice, soft green fleece. And that's what I use as bedding, currently. One piece of fleece, and that's it. There is one, main recurring problem with this: My guinea pig (Corey) pushes it to the side in his little poop place. Meaning that all the stuff ends up on the main, cold cage floor. It's not bad for his paws as the cage floor isn't wiring, but I can't imagine it'd be comfortable, and it makes it hard to clean his cage. So, what can I do to fix this, and what am I doing wrong? (because I know I'm doing something wrong).