I'm running a virtual machine with the type "Standard E4ds v5 (4 vCPUs, 32 GiB memory)" and I'm trying to load ChromaDB from disk into RAM. However, I'm only getting a maximum disk speed of 20-23 MB/sec. My disk type is "Standard HDD LRS" and according to the documentation, I should be able to achieve up to 60 MB/sec. Am I missing something, or is there a way to tweak settings to boost my disk performance?
3 Answers
If you haven't done so yet, try checking if you're using the D drive or ephemeral disk. You might get better performance by switching to the E4s_v5 instead, which could help cover the cost of an SSD that you need.
The issue likely stems from the fact that HDDs have unpredictable performance compared to SSDs. The speeds you're seeing could be typical because the advertised numbers are often just best-case scenarios. HDDs are fine for bulk storage but can be slow for anything requiring quick access.
Exactly! HDDs work fine for archival purposes, but you’re definitely going to want to switch to an SSD for better real-time performance.
Yeah, I agree with that. You're not likely to hit those maximum speeds because HDDs can vary so much in performance. If you're looking for reliability, you should definitely consider upgrading to a SSD.
Thanks for the tip! I hadn't considered switching VMs, I'll look into it.