Storage Networks Explained: Basics and Application of Fibre Channel SAN, NAS, iSCSI,InfiniBand and FCoE, 2nd Edition

by ; ; ; ;
Format: eBook
Pub. Date: 2009-06-01
Publisher(s): Wiley
Availability: This title is currently not available.
List Price: $118.85

Rent Textbook

Select for Price
There was a problem. Please try again later.

New Textbook

We're Sorry
Sold Out

Used Textbook

We're Sorry
Sold Out

eTextbook

We're Sorry
Not Available

Summary

All you need to know about Storage Area NetworksThe amount of data of an average company doubles every year. Thus, companies who own 1TB of data today will own 32TB in five years. Storage networks help to tame such data quantities and to manage this data growth efficiently. Since stored data and information are the biggest asset of any company, anyone who is involved in the planning or the operation of IT systems requires a basic knowledge of the principle and the use of storage networks.Storage Networks Explained covers the fundaments, techniques and functions of storage networks such as disk subsystems, Fibre Channel SAN, Internet SCSI (iSCSI), Fibre Channel over Ethernet (FCoE), Network Attached Storage (NAS), file systems, and storage virtualization. Furthermore the authors describe the use of these techniques and how they are designed to achieve high-availability, flexibility, and scalability of data and applications. Additional attention is given to network backup and the management of storage networks. Written by leading experts in the field, this book on storage area networks is updated and fully revised.Key features: Presents the basic concepts of storage networks, such as I/O techniques, disk subsystems, virtualization, NAS and SAN file systems Covers the design of storage networks which provide flexible, highly-available, and scaleable IT systems Explains the use of storage networks for data sharing, data protection, and digital archiving Discusses management of storage networks using SNMP, SMI-S, and IEEE 1244This book provides system administrators and system architects, as well as students and decision makers, with the tools needed for optimal selection and cost-effective use of storage networks.The Linux Journal awarded the first edition with the "Editor's Choice Award 2005" in the category "System Administration Book."

Table of Contents

About the Authors
Foreword to the Second Edition
Preface by the Authors
List of Figures and Tables
Introduction
Server-Centric IT Architecture and its Limitations
Storage-Centric IT Architecture and its Advantages
Case Study: Replacing a Server with Storage Networks
The Structure of the Book
Technologies for Storage Networks
Intelligent Disk Subsystems
Architecture of Intelligent Disk Subsystems
Hard Disks and Internal I/O Channels
JBOD: Just a Bunch of Disks
Storage Virtualisation Using RAID
Different RAID Levels in Detail
RAID 0: block-by-block striping
RAID 1: block-by-block mirroring
RAID 0+1/RAID 10: striping and mirroring combined
RAID 4 and RAID 5: parity instead of mirroring
RAID 6: double parity
RAID 2 and RAID 3
A comparison of the RAID levels
Caching: Acceleration of Hard Disk Access
Cache on the hard disk
Write cache in the disk subsystem controller
Read cache in the disk subsystem controller
Intelligent Disk Subsystems
Instant copies
Remote mirroring
Consistency groups
LUN masking
Availability of Disk Subsystems
Summary
I/O Techniques
The Physical I/O Path from the CPU to the Storage System
SCSI
SCSI basics
SCSI and storage networks
The Fibre Channel Protocol Stack
Links, ports and topologies
FC-0: cables, plugs and signal encoding
FC-1: 8b/10b encoding, ordered sets and link control protocol
FC-2: data transfer
FC-3: common services
Link services: login and addressing
Fabric services: name server and co
FC-4 and ULPs: application protocols
Fibre Channel SAN
Point-to-point topology
Fabric topology
Arbitrated loop topology
Hardware components for Fibre Channel SAN
InterSANs
Interoperability of Fibre Channel SAN
IP Storage
IP storage standards: iSCSI, iFCP, mFCP, FCIP and iSNS
TCP/IP and Ethernet as an I/O technology
Migration from Fibre Channel to IP storage
Infiniband-based Storage Networks
InfiniBand
Virtual Interface Architecture (VIA)
SCSI via InfiniBand and RDMA
Fibre Channel over Ethernet (FCoE)
I/O Consolidation based on Ethernet
FCoE Details
Case studies
Data Center Bridging (DCB)
Outlook
Summary
File Systems and Network Attached Storage (NAS)
Local File Systems
File systems and databases
Journaling
Snapshots
Volume manager
Network File Systems and File Servers
Basic principle
Network Attached Storage (NAS)
Performance bottlenecks in file servers
Acceleration of network file systems
Case study: The Direct Access File System (DAFS)
Shared Disk File Systems
Case study: The General Parallel File System (GPFS)
Comparison: Fibre Channel SAN, FCoE SAN, iSCSI SAN and NAS
Summary
Storage Virtualisation
Once Again: Virtualisation in the I/O Path
Limitations and Requirements
Architecture-related limitations of non-virtualised storage networks
Implementation-related limitations of storage networks
Requirements of the data
Proposed solution: storage virtualisation
Definition of Storage Virtualisation
Implementation Considerations
Realisation of the virtualisation entity
Replacement of storage devices
Efficient use of resources by dynamic storage allocation
Efficient use of resources by data migration
Performance increase
Availability due to the introduction of redundancy
Backup and archiving
Data sharing
Privacy protection
Storage Virtualisation on Block or File Level
Storage Virtualisation on Various Levels of the Storage Network
Storage virtualisation in the server
Storage virtualisation in storage devices
Storage virtualisation in the network
Symmetric and Asymmetric Storage Virtualisation in the Network
Symmetric storage virtualisation
Asymmetric storage virtualisation
Summary
Application and Management of Storage Networks
Application of Storage Networks
Definition of the Term 'Storage Network'
Layering of the transmission techniques and protocols
Networks in the I/O path
Data networks, voice networks and storage networks
Storage Sharing
Disk storage pooling
Dynamic tape library sharing
Data sharing
Availability of Data
Failure of an I/O bus
Failure of a server
Failure of a disk subsystem
Failure of virtualisation in the storage network
Failure of a data centre based upon the case study 'protection of an important database'
Adaptability and Scalability of IT Systems
Clustering for load distribution
Web architecture
Web applications based upon the case study 'travel portal'
Summary
Network Backup
General Conditions for Backup
Network Backup Services
Components of Backup Servers
Job scheduler
Error handler
Metadata database
Media manager
Backup Clients
Performance Gains as a Result of Network Backup
Performance Bottlenecks of Network Backup
Application-specific performance bottlenecks
Performance bottlenecks due to server-centric IT architecture
Limited Opportunities for Increasing Performance
Separate LAN for network backup
Multiple backup servers
Backup server and application server on the same physical computer
Next Generation Backup
Server-free backup
LAN-free backup
LAN-free backup with shared disk file systems
Backup using instant copies
Data protection using remote mirroring
Tape library sharing
Backup of File Systems
Backup of file servers
Backup of file systems
Backup of NAS servers
The Network Data Management Protocol (NDMP)
Backup of Databases
Functioning of database systems
Classical backup of databases
Next generation backup of databases
Organisational Aspects of Backup
Summary
Archiving
Terminology
Differentiating between information and data
Archiving
Digital archiving
Reference architecture for digital archive systems
Differentiating between archiving and backup
Differentiating between archiving and ILM
Motivation, Conditions and Requirements
Reasons for archiving
Legal requirements
Technical progress
Requirement for stability
Risks from the environment and from society
Requirement for adaptability and scalability
Operational requirements
Cost-related requirements
Conclusion: Archive systems as a strategic investment
Implementation Considerations
WORM storage technologies
Data security
Data integrity
Proof of regulatory compliance
Deletion of data
Continuous operation
Loss-free operation
Data management: storage hierarchy and migration
Component-neutral archiving
Selection of components and vendors
Interfaces in Archive Systems
Interface between application and DMS
Java Content Repository (JCR)
Interface between DMS and archive storage
eXtensible Access Method (XAM)
Management interfaces
Interface between DMS systems
Standardised interfaces for archive systems
Archive Solutions
Archiving of emails
Archiving of files
Archiving of ERP systems
Archiving in hospitals
Central archives
Operational and Organisational Aspects
Summary and Outlook
Business Continuity
General Conditions
Terminology
Target audience
Classification of risks
Classification of outages
IT failures in the context of business processes
Resumption of business processes
Business continuity for the web architecture
Cost optimisation for business continuity
Risk analysis and risk management
Creation of a business continuity plan
Strategies of Business Continuity
High availability
Disaster recovery
Continuous business operation
Parameters of Business Continuity
Availability
Characterisation of availability (MTBF, MTTR and MTTF)
Calculation of overall availability
Characterisation of failures (RTO and RPO)
Network Recovery Objective (NRO)
Quality of Service for Business Continuity
Service Level Agreements (SLAs)
High availability versus disaster recovery
The seven-tier model
Tier 0: no data backup
Tier 1: data backup without a backup data centre
Tier 2: data backup with backup data centre
Tier 3: electronic vaulting
Tier 4: instant copies
Tier 5: software mirroring
Tier 6: disk subsystem-based mirroring
Tier 7: fully automated solutions
Business Continuity Solutions
Basic techniques
Solution segments of the seven-tier model
Backup and restore
Rapid data recovery using copies
Rapid data recovery using mirrors
Continuous availability
Switch of Operational Location
Organisational Aspects
Summary
Management of Storage Networks
Requirements
User-related requirements
Component-related requirements
Architectural requirements
One central management system
Five basic services
Characterisation of Management Interfaces
In-band interfaces
Out-band interfaces
Standardised interfaces
Proprietary interfaces
Conclusion
In-band Management
In-band management in Fibre Channel SAN
Out-band Management
The Simple Network Management Protocol (SNMP)
CIM and WBEM
Storage Management Initiative Specification (SMI-S)
CMIP and DMI
Operational Aspects of the Management of Storage Networks 413
Summary
Removable Media Management
The Significance of Removable Media
Removable Media
Tapes
CD, DVD and magneto-optical media
Management features of removable media
Libraries and Drives
Libraries
Drives
Media changers
Problems and Requirements in Respect of Removable Media Management
Efficient use of the available resources
Access control
Access synchronisation
Access prioritisation and mount request queuing
Grouping, pooling
Media tracking and vaulting
Cartridge life cycle management
Monitoring
Reporting
The IEEE 1244 Standard for Removable Media Management
Media management system architecture
Media manager and MMP
Library manager and drive manager
Summary
The SNIA Shared Storage Model
The Model
The functional approach
Graphical representations
An elementary overview
The components
The layers
The file/record layer
The block layer
Combination of the block and file/record layers
Access paths
Caching
Access control
Clustering
Storage, data and information
Resource and data sharing
The service subsystem
Examples of Disk-Based Storage Architectures
Direct attached block storage
Storage network attached block storage
Block storage aggregation in a storage device: SAN appliance
Network attached block storage with metadata server: asymmetric block services
Multi-site block storage
File server
File server controller: NAS heads
Asymmetric file services: NAS/file server metadata manager
Object-based storage device (OSD)
Extension of the SNIA Shared Storage Model to Tape Functions
Logical and physical structure of tapes
Differences between disk and tape
Extension of the model
Examples of Tape-Based Backup Techniques and Architectures
File backup
File system volume backup
Volume backup
File backup to virtual tape
Direct attached tape
LAN attached tape
Shared tape drive
Partitioned tape library
Virtual tape controller
Virtual tape controller with disk cache
Data mover for tape
File server with tape drive
File server with external tape
File server with data mover
Summary
Final Note
Glossary
Annotated Bibliography
Proof of Calculation of the Parity Block of RAID 4 and 5
Checklist for the Management of Storage Networks
Applications
Monitoring
Availability
Performance
Scalability
Efficient use
Data
Availability
Performance
Data protection
Archiving
Migration
Data sharing
Security/access control
Resources
Inventory/asset management and planning
Monitoring
Configuration
Resource use
Capacity
Efficient resource utilisation
Availability
Resource migration
Security
Topology
Monitoring
Availability
Performance
Index
Table of Contents provided by Publisher. All Rights Reserved.

An electronic version of this book is available through VitalSource.

This book is viewable on PC, Mac, iPhone, iPad, iPod Touch, and most smartphones.

By purchasing, you will be able to view this book online, as well as download it, for the chosen number of days.

Digital License

You are licensing a digital product for a set duration. Durations are set forth in the product description, with "Lifetime" typically meaning five (5) years of online access and permanent download to a supported device. All licenses are non-transferable.

More details can be found here.

A downloadable version of this book is available through the eCampus Reader or compatible Adobe readers.

Applications are available on iOS, Android, PC, Mac, and Windows Mobile platforms.

Please view the compatibility matrix prior to purchase.