How Can I Fit a New NVMe SSD into My Motherboard with a Tight Space?

I've been working on upgrading my PC by swapping out my old SATA SSD for a new NVMe SSD. The problem is, there's an attachment on my motherboard that's blocking the drive and heatsink by just a millimeter or two. This makes it impossible to properly screw in the SSD for full stability. I've heard a few potential solutions. One suggestion was to get an NVMe without a heatsink, but I don't want to spend another $100-$200 for that option. I could remove the heatsink from the new drive, but I'm concerned about damaging it. Even without the heatsink, I feel like it's still a tight squeeze. Another thought was to leave the drive unscrewed or taped in place, but I'm aware that's not safe for long-term use. There's also this black component just below the screw on my motherboard, and I'm wondering if it's essential. I think it might be soldered on, which complicates things. I'm open to any other solutions that won't require a lot more spending and carry low risk of damage. If it helps, this is from a pretty old prebuilt PC—happy to share the motherboard guide or photos if need be!