Understanding SAN (Storage Area Network) in the Cloud

This educational article presents a high-level overview of Storage Area Networks (SAN) solutions in the cloud. For more information on software-defined cloud storage for the public cloud start with our solutions page: Lightbits on Microsoft Azure

What is a Storage Area Network (SAN)?

A SAN is a network of storage devices that offers a pool of shared block storage for multiple computing devices. SANs first appeared in the mid-1990s as a viable alternative to Direct Attached Storage (DAS) and NAS (Network Attached Storage) for high-speed, mission-critical analytic and transactional workloads like databases that require scalable storage and that can deliver high IOPS and low latency. They are also well-suited for virtualized environments which accelerated their adoption.

A SAN consolidates storage in a single block-level storage area, allowing users to access and manage data from a central location. To maintain high storage traffic and network performance, the SAN is typically implemented via a separate network infrastructure from the local area network (LAN).

Compute servers connected to the SAN gain access to whatever storage devices are on SAN controllers, such as tape libraries, local storage, and disk arrays. This design also offers the advantage of centralized storage management. SANs also help with improved storage security. With data in a centralized, shared SAN storage architecture, an organization can apply consistent policies for security, data protection, and disaster recovery (DR). A SAN potentially enables multiple backups of its data, and its block-level access helps improve application availability.

The design of the SAN also lends itself to dynamic fail-over, which helps with availability and business continuity. The SAN’s network fabric of interconnected storage devices and computers further improves availability. If one network path is disrupted, the SAN enables an alternate path. This way, it’s less likely that the failure of a single device will render storage inaccessible.

What are the Pros and Cons of Storage Area Network (SAN)?

Their widespread use in on-premises datacenters notwithstanding, SANs have a number of disadvantages. For one thing, SANs are expensive, they can cost hundreds of thousands of dollars and require proprietary hardware. Because they require proprietary hardware, their provisioning cycles can be long, especially during times when supply chains are compromised (e.g., during the COVID pandemic). The cost of setting up and maintaining the infrastructure can be significant. It can take some time before you see a return on investment. This makes SANs better suited for larger organizations that can afford to invest in capital and management costs.

They can be complex and thus difficult to manage. A SAN is built in layers, with connections between the underlying storage arrays, the SAN network switches, and the servers that use the SAN. Each layer, device, and connection requires ongoing administration and maintenance, incurring additional costs.

There are multiple locations for faults and patching. Component upgrades and interfaces need frequent, if not constant attention. Indeed, various SAN components are not known for “playing nicely” together. SAN vendors often use proprietary protocols and management tools, which further complicate the task of SAN management. Additionally, SAN becomes a bottleneck in all-flash storage environments, which are now becoming the norm in most enterprises.

The complexity of SANs can require specific expertise to manage and maintain. Overseeing the SAN inevitably becomes a job for someone or even an entire team. When an organization has more than one SAN the complexity and administrative load grow all the more strenuous. A virtualized SAN architecture can relieve some of the pressure on admins to take care of hardware but presents its own complexity at the same time.

Security is also an issue, despite the uniform policy advantages highlighted above. A SAN is almost always a shared environment. As a result, it is vulnerable to lateral attacks, where a malicious actor gains access to one area of the SAN but then moves across it to breach data held elsewhere in the network.

That being said, while there are numerous cons there are benefits of SANs, such as high performance, scalability, and centralized management.? Many organizations implement SAN to enable workloads that require high-speed data transfer rates and low latency. They can also be easily scaled and enable centralized management of storage resources, simplifying administration and improving efficiency in managing large amounts of data.

Other attractive benefits are redundancy features and multiple paths to storage devices, ensuring high availability and fault tolerance. SAN systems can facilitate efficient data backup and recovery processes, allowing for faster and more reliable data protection strategies. Also, it should be noted that SANs work well with virtualized and containerized environments.

What is Cloud SAN?

Cloud SAN (Storage Area Network) refers to a cloud-based implementation of a traditional SAN. This model delivers block-level storage services over a network, typically the internet or a dedicated network connection.? It delivers the benefits of traditional SANs to the cloud environment, offering enhanced flexibility, scalability, and cost efficiency while maintaining high performance and reliability.

Just like traditional SANs, Cloud SAN provides block-level storage, where data is stored in fixed-sized blocks. The physical storage devices are abstracted into a pool of storage resources that can be dynamically allocated to meet demand.

By moving to a cloud-based SAN, you can reduce the costs associated with maintaining physical hardware and the complexities of a traditional SAN setup. Instead, you can pay only for the storage you use.

This type of storage is suitable for applications requiring high performance and low latency, such as transactional databases that require fast read/write speeds and high availability and virtual machines.

What are the Pros and Cons of Cloud SAN?

Cloud SANs offer significant benefits in terms of scalability, cost efficiency, and ease of management. However, they also come with potential drawbacks such as latency issues, and security concerns.

Depending on the distance to the cloud location, cloud SAN models can introduce latency, which negatively impacts performance.? This can be particularly problematic for applications that require real-time data access. In addition, a lot of organizations have cost sensitivities and while cloud storage costs might be lower, data transfer (ingress and egress) can incur additional fees, potentially leading to higher overall storage costs for data-intensive operations.

A final consideration is that you may have less control over your storage environment in the cloud compared to your on-premises data center, and your customization options might be limited by the cloud provider’s offerings.

Lightbits “SAN in the Cloud”

Lightbits software-defined storage brings a SAN experience to the cloud. You provision, manage, and pay for storage resources as a pool instead of volume by volume. For large-scale migrations, you won’t need to spend weeks sizing each volume individually, and you won’t have to over-provision for maximum expected throughput or capacity, unlike native cloud storage options that work on a direct attached storage model. With Lightbits, you can scale performance and capacity independently.

For even greater efficiency and cost reduction, Lightbits uses thin provisioning and compression to conserve capacity. That means you can size your volumes for the future but only pay for consumption today. You won’t need to predict maximum capacity and pay for underutilization. At the same time, your Lightbits software licenses are portable between on-premises and public clouds.

Where native cloud storage communicates with applications over a limited bandwidth storage network, Lightbits leverages the network speed of NVMe/TCP to deliver higher throughput and consistently lower latency to your applications. Your users will continue to get an excellent experience during peak usage times. With Lightbits, you don’t have to pay for additional provisioned IOPS as you scale services.

Using a solution like Lightbits that leverages low latency NVMe storage and standard TCP/IP, you can deploy high-performing, clustered storage that is cost-effective and highly scalable—but without SAN’s traditional overhead headaches. If you want to try Lightbits high-performance block storage as a “SAN in the cloud,” it is available on the AWS Marketplace and Microsoft Azure .

For further insights and to continue your learning journey, explore our blog “Why it Might be Time for SAN Replacement. ”

?

Additional learning materials:

• Building Data Storage for the Future
• Deploying Reliable High-Performance Storage with Lightbits
• Lightbits for Private Clouds