The San Francisco Chronicle said Mr Baker died in his sleep at his home in New York on Thursday night.
He initially designed an eight-colour flag in 1978 for the city's gay freedom day, the precursor to the modern pride parade.
Mr Baker's original flag had eight colours, each representing a different aspect of humanity. Later, it was reduced to six stripes, removing pink and indigo, and swapping blue for turquoise.