Asking him to give up this privilege of having a sexual relationship without making any effort is foolish.
It would be like expecting a homeless man to give back a $20 bill he found on the street.
Sorry if that sounds like a bit of a verbal bitchslap, but the truth hurts. You could quibble that it would have been nice for him to call you, or maybe write you a note on letterhead, officially establishing his lack of interest. In what culture is “ignoring someone for two weeks” a sign of passion?
As to how you’re not being honest with yourself…at the beginning of your question, you wrote that you don’t want a serious relationship. You got attached, you called him, you texted him, you surprised him at his place, you started getting angry when he didn’t invite you out.
By Thursday (a week since I’d seen him last) he still hadn’t called so I called him and he did the ‘answer the phone and hang it up to make it look like a dropped call’ game twice before he finally answered the third time.