| |
Cover |
1 |
|
| |
Title Page |
5 |
|
| |
Copyright |
6 |
|
| |
Contents |
13 |
|
| |
Foreword by Duncan Epping |
19 |
|
| |
Introduction |
21 |
|
| |
Who Should Read This Book? |
21 |
|
| |
What Is Covered in This Book? |
22 |
|
| |
Chapter 1 Software-Defined Storage Design |
25 |
|
| |
Software-Defined Compute |
26 |
|
| |
Software-Defined Networking |
26 |
|
| |
Software-Defined Storage |
27 |
|
| |
Designing VMware Storage Environments |
28 |
|
| |
Technical Assessment and Requirements Gathering |
29 |
|
| |
Establishing Storage Design Factors |
30 |
|
| |
The Economics of Storage |
34 |
|
| |
Calculating the Total Cost of Ownership for Storage Resources |
35 |
|
| |
Information Lifecycle Management |
37 |
|
| |
Implementing a Software-Defined Storage Strategy |
39 |
|
| |
Software-Defined Storage Summary |
40 |
|
| |
Hyper-Converged Infrastructure and Virtual SAN |
42 |
|
| |
Virtual Volumes |
42 |
|
| |
Classic and Next-Generation Storage Models |
43 |
|
| |
Chapter 2 Classic Storage Models and Constructs |
45 |
|
| |
Classic Storage Concepts |
45 |
|
| |
RAID Sets |
49 |
|
| |
Virtual Provisioning |
68 |
|
| |
Storage Tiering |
73 |
|
| |
Storage Scalability Design |
78 |
|
| |
Storage Management Tools |
81 |
|
| |
Multitenanted Storage Design |
82 |
|
| |
Quality of Service |
83 |
|
| |
Data Deduplication and Data Compression |
84 |
|
| |
Storage Device Security |
85 |
|
| |
Hardware High Availability |
85 |
|
| |
Storage Array–Based Disaster Recovery and Backups |
86 |
|
| |
Storage Array Snapshots and Clones in a Classic Storage Environment |
87 |
|
| |
vSphere Metro Storage Cluster |
89 |
|
| |
All-Flash Disk Arrays |
89 |
|
| |
vSphere Storage Technologies |
91 |
|
| |
Virtual Disks |
92 |
|
| |
Virtual Machine Storage Controllers (vSCSI Adapters) |
95 |
|
| |
Datastore |
97 |
|
| |
Raw Device Mapping |
103 |
|
| |
When to Use RDMs over VMFS or NFS? |
105 |
|
| |
Storage vMotion and Enhanced vMotion Operations |
105 |
|
| |
Datastore Clusters |
106 |
|
| |
Storage Distributed Resource Scheduler |
107 |
|
| |
Storage I/O Control |
109 |
|
| |
Classic Storage Model—vStorage APIs for Array Integration |
113 |
|
| |
Classic Storage Model—VASA 1.0 |
114 |
|
| |
VADP and VAMP |
115 |
|
| |
Boot from SAN |
116 |
|
| |
Classic Storage Model—vSphere Storage Policies |
118 |
|
| |
Tiered Storage Design Models in vSphere |
119 |
|
| |
Sub-LUN System Access |
122 |
|
| |
Chapter 3 Fabric Connectivity and Storage I/O Architecture |
125 |
|
| |
Fibre Channel SAN |
126 |
|
| |
Fibre Channel Protocol |
126 |
|
| |
Fibre Channel Topologies |
139 |
|
| |
Switch-Based Fabric Architecture |
141 |
|
| |
Security and Traffic-Isolation Features |
149 |
|
| |
N_Port Virtualization and N_Port ID Virtualization |
155 |
|
| |
Boot from SAN |
156 |
|
| |
Fibre Channel Summary |
156 |
|
| |
iSCSI Storage Transport Protocol |
159 |
|
| |
iSCSI Protocol Components |
159 |
|
| |
iSCSI Traffic Isolation |
161 |
|
| |
Jumbo Frames |
162 |
|
| |
iSCSI Device-Naming Standards |
162 |
|
| |
CHAP Security |
163 |
|
| |
iSCSI Network Adapters |
164 |
|
| |
Virtual Switch Design |
167 |
|
| |
iSCSI Boot from SAN |
172 |
|
| |
iSCSI Protocol Summary |
172 |
|
| |
NFS Storage Transport Protocol |
173 |
|
| |
Comparing NAS and SAN |
173 |
|
| |
NFS Components |
173 |
|
| |
NAS Implementation |
176 |
|
| |
Single Virtual Switch / Single Network Design |
181 |
|
| |
Single Virtual Switch / Multiple Network Design |
183 |
|
| |
vSphere 6 NFS Version 4.1 Limitations |
185 |
|
| |
NFS Protocol Summary |
185 |
|
| |
Fibre Channel over Ethernet Protocol |
185 |
|
| |
Fibre Channel over Ethernet Protocol |
187 |
|
| |
Fibre Channel over Ethernet Physical Components |
189 |
|
| |
Fibre Channel over Ethernet Infrastructure |
191 |
|
| |
Fibre Channel over Ethernet Design Options |
191 |
|
| |
Fibre Channel over Ethernet Protocol Summary |
194 |
|
| |
Multipathing Module |
194 |
|
| |
Pluggable Storage Architecture |
198 |
|
| |
iSCSI Multipathing |
201 |
|
| |
NAS Multipathing |
202 |
|
| |
Direct-Attached Storage |
204 |
|
| |
Evaluating Switch Design Characteristics |
206 |
|
| |
Fabric Connectivity and Storage I/O Architecture Summary |
208 |
|
| |
Chapter 4 Policy-Driven Storage Design with Virtual SAN |
211 |
|
| |
Challenges with Legacy Storage |
211 |
|
| |
Policy-Driven Storage Overview |
214 |
|
| |
VMware Object Storage Overview |
215 |
|
| |
Virtual SAN Overview |
216 |
|
| |
Virtual SAN Architecture |
218 |
|
| |
Virtual SAN Disk Groups |
218 |
|
| |
Comparing Virtual SAN Hybrid and All-Flash Models |
224 |
|
| |
All-Flash Deduplication and Compression |
226 |
|
| |
Data Locality and Caching Algorithms |
229 |
|
| |
Virtual SAN Destaging Mechanism |
230 |
|
| |
Virtual SAN Distributed Datastore |
230 |
|
| |
Objects, Components, and Witnesses |
231 |
|
| |
On-Disk Formats |
236 |
|
| |
Swap Efficiency / Sparse Swap |
238 |
|
| |
Software Checksum |
239 |
|
| |
Virtual SAN Design Requirements |
240 |
|
| |
Host Form Factor |
240 |
|
| |
Host Boot Architecture |
241 |
|
| |
Virtual SAN Hardware Requirements |
246 |
|
| |
Virtual SAN Network Fabric Design |
260 |
|
| |
vSphere Network Requirements |
260 |
|
| |
Physical Network Requirements |
264 |
|
| |
Virtual SAN Storage Policy Design |
274 |
|
| |
Storage Policy–Based Management Framework |
274 |
|
| |
Virtual SAN Rules |
275 |
|
| |
Virtual SAN Rule Sets |
277 |
|
| |
Default Storage Policy |
291 |
|
| |
Application Assessment and Storage-Policy Design |
292 |
|
| |
Virtual SAN Datastore Design and Sizing |
295 |
|
| |
Hosts per Cluster |
297 |
|
| |
Storage Capabilities |
299 |
|
| |
Configuring Multiple Disk Groups |
300 |
|
| |
Endurance Flash Sizing |
302 |
|
| |
Objects, Components, and Witness Sizing |
303 |
|
| |
Datastore Capacity Disk Sizing |
305 |
|
| |
Capacity Disk Size |
306 |
|
| |
Designing for Availability |
311 |
|
| |
Designing for Hardware Component Failure |
313 |
|
| |
Host Cluster Design and Planning for Host Failure |
316 |
|
| |
Quorum Logic Design and vSphere High Availability |
326 |
|
| |
Fault Domains |
326 |
|
| |
Virtual SAN Internal Component Technologies |
332 |
|
| |
Reliable Datagram Transport |
332 |
|
| |
Cluster Monitoring, Membership, and Directory Services |
332 |
|
| |
Cluster-Level Object Manager |
334 |
|
| |
Distributed Object Manager |
334 |
|
| |
Local Log-Structured Object Manager |
334 |
|
| |
Object Storage File System |
335 |
|
| |
Storage Policy–Based Management |
336 |
|
| |
Virtual SAN Integration and Interoperability |
336 |
|
| |
Chapter 5 Virtual SAN Stretched Cluster Design |
339 |
|
| |
Stretched Cluster Use Cases |
341 |
|
| |
Fault Domain Architecture |
342 |
|
| |
Witness Appliance |
342 |
|
| |
Network Design Requirements |
344 |
|
| |
Distance and Latency Considerations |
346 |
|
| |
Bandwidth Requirements Calculations |
349 |
|
| |
Stretched Cluster Deployment Scenarios |
351 |
|
| |
Default Gateway and Static Routes |
351 |
|
| |
Stretched Cluster Storage Policy Design |
351 |
|
| |
Preferred and Nonpreferred Site Concepts |
353 |
|
| |
Stretched Cluster Read/Write Locality |
353 |
|
| |
Distributed Resource Scheduler Configurations |
356 |
|
| |
High Availability Configuration |
359 |
|
| |
Stretched Cluster WAN Interconnect Design |
363 |
|
| |
Evaluating WAN Platforms for Stretched Clusters |
363 |
|
| |
Deploying Stretched VLANs |
371 |
|
| |
WAN Interconnect High Availability |
377 |
|
| |
Secure Communication |
377 |
|
| |
Data Center Interconnect Design Considerations Summary |
378 |
|
| |
Stretched Cluster Solution Architecture Example |
380 |
|
| |
Cisco vPC over DWDM and Dark Fiber |
382 |
|
| |
OTV over DWDM and Dark Fiber |
384 |
|
| |
Cisco LISP Configuration Overview |
387 |
|
| |
Stretched Cluster Failure Scenarios |
387 |
|
| |
Stretched Cluster Interoperability |
389 |
|
| |
Support Limitations |
389 |
|
| |
Chapter 6 Designing for Web-Scale Virtual SAN Platforms |
391 |
|
| |
Scale-up Architecture |
392 |
|
| |
Scale-out Architecture |
394 |
|
| |
Designing vSphere Host Clusters for Web-Scale |
396 |
|
| |
Building-Block Clusters and Scale-out Web-Scale Architecture |
396 |
|
| |
Scalability and Designing Physical Resources for Web-Scale |
397 |
|
| |
Leaf-Spine Web-Scale Architecture |
401 |
|
| |
Chapter 7 Virtual SAN Use Case Library |
405 |
|
| |
Use Cases Overview |
407 |
|
| |
Two-Node Remote Office / Branch Office Design |
410 |
|
| |
Horizon and Virtual Desktop Infrastructure |
416 |
|
| |
Virtual SAN File Services |
419 |
|
| |
Solution Architecture Example: Building a Cloud Management Platform with Virtual SAN |
419 |
|
| |
Introduction and Conceptual Design |
419 |
|
| |
Customer Design Requirements and Constraints |
422 |
|
| |
Cluster Configuration |
428 |
|
| |
Network-Layer Design |
432 |
|
| |
Storage-Layer Design |
436 |
|
| |
Cloud Management Platform Security Design |
447 |
|
| |
Chapter 8 Policy-Driven Storage Design with Virtual Volumes |
453 |
|
| |
Introduction to Virtual Volumes Technology |
454 |
|
| |
Virtual Volumes Component Technology Architecture |
458 |
|
| |
Virtual Volumes Object Architecture |
458 |
|
| |
Management Plane |
460 |
|
| |
VASA 2.0 Specification |
460 |
|
| |
VASA Provider |
460 |
|
| |
Data Plane |
461 |
|
| |
Storage Container |
461 |
|
| |
Protocol Endpoints |
464 |
|
| |
Binding Operations |
466 |
|
| |
Storage Policy–Based Management with Virtual Volumes |
468 |
|
| |
Published Capabilities |
470 |
|
| |
Storage Capabilities |
472 |
|
| |
Storage Capabilities Summary |
473 |
|
| |
Benefits of Designing for Virtual Volumes |
473 |
|
| |
Enhanced Performance |
474 |
|
| |
Greater Application Control |
474 |
|
| |
Operational Simplification |
474 |
|
| |
Reduced Wasted Capacity |
474 |
|
| |
Virtual Volumes Key Design Requirements |
474 |
|
| |
vSphere Storage Feature Interoperability |
475 |
|
| |
VAAI and Virtual Volumes |
475 |
|
| |
Virtual Volumes Summary |
475 |
|
| |
Chapter 9 Delivering a Storage-as-a-Service Design |
477 |
|
| |
STaaS Service Definition |
481 |
|
| |
Cloud Platforms Overview |
482 |
|
| |
Cloud Management Platform Architectural Overview |
485 |
|
| |
vRealize Automation Cloud Management Platform |
485 |
|
| |
vRealize Orchestrator |
489 |
|
| |
The Combined Solution Stack |
492 |
|
| |
Workflow Examples |
492 |
|
| |
Summary |
496 |
|
| |
Chapter 10 Monitoring and Storage Operations Design |
497 |
|
| |
Storage Monitoring |
497 |
|
| |
Monitoring Component Health |
498 |
|
| |
Monitoring Capacity |
498 |
|
| |
Monitoring Storage Performance |
499 |
|
| |
Monitoring Security |
500 |
|
| |
Storage Component Monitoring |
501 |
|
| |
Monitoring Storage on Host Servers |
501 |
|
| |
Monitoring the Storage Fabric |
501 |
|
| |
Monitoring a Storage Array System |
504 |
|
| |
Storage Monitoring Challenges |
505 |
|
| |
Common Storage Management and Monitoring Standards |
507 |
|
| |
Virtual SAN Monitoring and Operational Tools |
510 |
|
| |
vRealize Operations Manager |
516 |
|
| |
Management Pack for Storage Devices |
516 |
|
| |
Storage Partner Solutions |
518 |
|
| |
vRealize Log Insight |
521 |
|
| |
Log Insight Syslog Design |
522 |
|
| |
End-to-End Monitoring Solution Summary |
523 |
|
| |
Storage Capacity Management and Planning |
523 |
|
| |
Management Strategy Design |
526 |
|
| |
Process and Approach |
527 |
|
| |
Capacity Management for Virtual SAN |
529 |
|
| |
Summary |
529 |
|
| |
Index |
533 |
|
| |
EULA |
555 |
|
