The 19-year-old recently moved into a new rental property in Atlanta while he looks for a home to buy there, but residents are reportedly furious he is living in their exclusive neighbourhood.
A source told gossip website TMZ.com that the Baby singer's neighbours have scheduled a protest in a bid to stop him from moving in, as they fear that Bieber will be "bad for our children".
The Buckhead Neighbourhood Coalition is asking protesters to show up at 9am on Monday morning and more than 200 people have already indicated they will attend.
Organisers have also launched a petition in a bid to get Justin to leave the area.
It reads: "We have worked hard to achieve our goals and get where we are. Justin Bieber's relocation to Atlanta can be nothing but bad for our children."
"Some can't even let their child play in the driveway without fear; he has raced vehicles under the influence before. What's to say he won't do it again?
"Please don't allow a child to ruin what we have worked so hard to obtain."
This comes just a day after Justin revealed on Twitter that he feels he's become an "easy target" for the general public:
Writing on Twitter to nearly 50 million of his fans, he said: "I guess I'm an easy target for some. I'm still human. I will continue to meet hate with love. It's all about the music. Much love."
Do you think Justin Bieber's neighbours are right to stage a protest? Or have things gotten a little out of hand? Let us know in the Comments Box below.