When the 25-year-old mother called up and told the bakery department she wanted her son's name spelled out, she was told to talk to a supervisor, who denied the request.
A spokeswoman for the store, Karen Meleta, said that they considered Campbell's request inappropriate.
The couple are now upset with not only the store's decision but also with the outpouring of angry Internet postings in response to a local newspaper article over the weekend on their flare-up over frosting.
"I think people need to take their heads out of the cloud they've been in and start focusing on the future and not on the past," CBS News quoted Heath Campbell as saying telling the Easton Express-Times during an interview.
"There's a new president and he says it's time for a change; well, then it's time for a change.
"They need to accept a name. A name's a name. The kid isn't going to grow up and do what (Hitler) did," he added.
The Campbells' other two children also have unusual names: JoyceLynn Aryan Nation Campbell turns 2 in a few months and Honszlynn Hinler Jeannie Campbell will be one in April.
Heath Campbell said he named his son after Adolf Hitler because he liked the name, and also because "no one else in the world would have that name."
He sounded surprised by all the controversy the dispute had generated.