Honestly bunnies usually come around. I took care of a chinchilla for a few days, and my female bunny went nuts, kicking her litter everyone, chasing her mate ( poor guy had no idea why!), and thumping. 24 hours later she was fine. Hopefully your bunny will adjust, as you seem to really love the little guy!
I'd love to accept your friend request as soon as I figure out how lol