VoiceOver talks into iPhone alarm

Hi,
sorry for my bad English in advance, I'm just typing this without actually knowing the correct words.
So I'm a person who is very sensitive to sounds, so I set a very gentle alarm sound on my iPhone to wake up in the morning. I imported it to Apple Music library and then selected it from there in the native clock app. And now here is the problem: Whenever the alarm gets off, VoiceOver screams at me: "Alarm". First I thought I could simply toggle off speech but then I can't use the phone as a watch and I still get this stupid voiceover activation sound when the alarm starts. So what I don now is turning off VoiceOver over night and then turn it back on in the morning. But this is not ideal.
And then there is this problem where Apple Music set alarms often don't start at the beginning, but in the middle of the track which is not good for this kind of sound (downloaded, no streaming).
Anyone a solution for this?