We wanted to build 50TB Elasticsearch on Azure.
Replicas count: 3
Shard count: 1000
For doing this, we are considering below two VM SKUs.
DS5v2 – Intel Xeon processor
RAM: 56 GB
Managed Disk: Premium SSD
L32s v2: AMD EPYC 7551 processor
RAM: 256 GB
Local NVMe premium SSD disks attached to VMs (ephemeral)
By default, I was assuming we’d have to use managed disks as we couldn’t rely on the local temporary storage. That could get blown up at any time. Attached managed storage seems to be the way most people talk about supporting this scenario online.
However, the Lsv2-series has both temporary storage and NVMe disk. The spec sheet for it talks about it being ideal for “Big Data, SQL, and NoSQL databases.”. Which seems to fit our problem space.
L32sv2 is very promising, we wanted to know SLAs for this VM SKU(s)