I don't really know how to add the image icon button thingy so that you can select the item/fluid/signal that you want, but rich text is already supported.
I tested adding "[item=buffer-chest,quality=epic][item=iron-chest]" to the name of a Visual Signal and it works just fine, it renders the icons.