Mr Trump reportedly used the term last week during a bipartisan Oval Office meeting on immigration reform.
He has now told reporters: "I am not a racist. I'm the least racist person you have ever interviewed."
It is the first time the president has responded directly to the racism accusations.
He made the denial to White House press pool reporters at the Trump International Golf Club in West Palm Beach on Sunday night.