Help me like my rabbit! And for him to like me!?

We just got a rabbit and I think he hates me. He LOVES my husband, will cuddle up with him, play with him, etc. He just sniffs me and runs away and thumps his hind legs even when I'm not doing anything to deserve it. I've never been mean to him. I always bring him his food, water, treats, toys, etc. I don't know why he doesn't like me. Now he's got me scared of him and I don't want to sit on the floor when he's out anymore because I'm afraid he's going to bite me or something. What should i do? It makes me nervous when he starts sniffing me because I think he's going to bite me. If I reach out to pet him, he darts away and thumps his back feet. If my husband reaches out to pet him, he lays down and snuggles with my husband. What's the deal?