Some colleagues are very tolerant of me, and I don't like them. What should I do?

For such a thing, I personally think it is ok to be indifferent but not annoying. Questions asked by colleagues and your affairs do not involve your principles or other things. You can let your colleagues know in a joking way that you don't want them to know, but at the same time, I personally think it's better to get along. After all, you are colleagues.