No. People with an agenda will always act with an agenda, but EON will not be labeled racist just for choosing a different actor.
The problem comes from people saying that Bond, or many other characters, CAN'T be black, and that only characters who are written specifically to be black, should be black.
The problem comes from people who see Hunger Games and see a little girl that is murdered, and, because she's black, say they can't feel any sadness. When they read the book, they pictured a little white girl (or the story might have said she was white, but it's basically irrelevant to the character, I forget the details), but since the girl in the movie was black, they couldn't feel sorry for her or any sadness when she was murdered. Yes, that was a thing that people admitted to on the internet.
They also complained about Lenny Kravitz's character being black, despite being apparently described in the book with tanned skin and an afro of thick, black hair.
The problem is with people that think that, unless a character is black, that character can't be black.
Here's one for you: Will Smith almost played Neo in The Matrix. He, like others when they were pitched the first movie, turned down the role because he didn't get it, or how they would pull it off.
Neo's race is never mentioned, never important to any element of the story, and there are other races represented throughout (though the bad guys are almost all white). Think about how many other characters for whom that is true. Think about how many more major movie or television series could plug in a talented non-white actor or actress without having to change a single thing. And then ask yourself why it hasn't been done more.