Nicer Fuel Glow primarily modifies fuels, not the burner entities themselves, so vanilla furnaces probably don't list the mod either. You'll just have to try some different fuels and check.
If they all glow the same, the entities are not tagged to display custom fuel colours. I'd consider overriding it, but generally I prefer to let mod authors make those decisions themselves.