I think the problem was that my code removed songs from the ambient music by making nill an entry on the list that also served as reference for song added in the speaker, not only causing an error because the game was tasked to add emtpy note to the speaker. But also not desired behavior, as songs on speaker are numbered and there is no logic to handle re-numeration if a song is removed from the speaker list. Changes were made so ambient music and speaker use different copy of the list of songs, and one can only remove some ambient songs, like the song 10 iron complaint, without creating any error.
It will not be possible to remove it from the speaker list at the moment, only from game music.
It was also tested to work with Maraxsis, and Cerys and a bunch of other mods i'm using with different combo of settings , hopefully no bugs anymore !
I could try to rework the mentionned song too , i cannot do magic if you don't like the genre of the song or what it is but i have received some other feedback on it for the quality of the vocals and mastering which will be published only if it yields somewhere x)