Last week the 36-year-old actor ‘treated’ his fans to the snap of him almost naked save for a pair of old, slightly washed out white underwear.
The picture was quickly deleted but James defended his actions when speaking to David Letterman on The Late Show.
He said: “To me it’s just a fun thing, it’s something that I don’t put a lot of thought into but it gets a lot of attention, I have a lot of followers on Instagram.”
The Of Mice and Men star insisted he was only giving his fans what they wanted, and that he wasn’t doing any harm.
He said: “It’s not like I’m putting it on billboards – Instagram is for my fans but now the bloggers are following me on there so they’ll just take it and use it as they want.
“It’s provocative. I didn’t ask you to look at it, it’s what the people want!”
Continuing, James said that if his posts upset some people then they shouldn’t be following him.
He added: “Why is it my fault now? I had nothing to do with it. If you don’t want to see it, don’t follow me.”
James made headline last month when his Instagram conversation with a 17-year-old fan was leaked. During the conversation, James asked if she was single, how old she was and whether he should book a room for them.