Designing Optical Infrastructures For IP Networks

OPT-231 2948_05_2001_c1
2001, Cisco Systems, Inc. All rights reserved.
Copyright 1998, Cisco Systems, Inc. All rights reserved. Printed in USA. Presentation_ID.scr
Designing Optical Infrastructures for IP Networks

Session OPT-231
OPT-231 2948_05_2001_c1
Market Trends
Fiber everywhere Decreasing costs of bandwidth Optical infrastructure New services
OPT-231 2948_05_2001_c1
Evolution of Internet Backbone Architecture

Multiplexing, Protection, and Management at Every Layer
Early Early 1990s 1990s IP IP PPP/HDLC PPP/HDLC SONET/SDH SONET/SDH Fiber Fiber 1996 1996 1997 1997 1999 1999 2001 2001
IP IP IP IP ATM/FR ATM/FR SONET/SDH SONET/SDH Fiber Fiber POS POS SONET/SDH SONET/SDH Fiber Fiber IP IP POS POS MPLS MPLS DWDM DWDM Fiber Fiber IP IP POS POS MPLS MPLS UCP UCP DWDM DWDM Fiber Fiber
ATM
POS 622Mbps
DWDM 2.5Gbps POS
DWDM Channels 10Gbps POS
Mbps
PPP POS DWDM MPLS UCP
x 10Mbps
x100Mbps
Gbps
x10G
Point to Point Protocol Packet Over SONET/SDH Dense Wave Division Multiplexing Multi -Protocol Label Switching Unified Control Plane
Architecture Has Been Evolved at Every Two Years to Increase the Capacity by Ten(10)
5
OPT-231 2948_05_2001_c1
Moving up the Services Value Chain
IP Router
L3 Services
IP VPN IP QoS
SONET
TDM Services ?Services ?Transit ? Services Managed Bandwidth
Value Add Services
Wavelength Routing Lambdas
Optical Technologies
Fiber
OPT-231 2948_05_2001_c1
Complex Core Network Management

Many EMS layers, and technologies Service introductions synchronized with each layer Service topology dependent
IP Router Mesh ATM Mesh SONET Rings: Add/Drop Multiplexers, Digital Cross Connects Point-to-Point DWDM
OPT-231 2948_05_2001_c1
How to Build Better and Cheaper Optical Internet?

OAM and P 49%
Depreciation 31%
OAM and P cost dominates most Service Providers budgets

G and A 7% Sales and Marketing 13%
Source: ARMIS 43-01 Reports and Probe Research, Inc.

OPT-231 2948_05_2001_c1
Service Velocity
Create service velocity:
Intelligent network elements, and simplified OSS Distributed network database Circuit-routed, Ethernet-like Inherent scaling Service-driven topology IP Routers Requiring Connectivity
OPT-231 2948_05_2001_c1
Optical Technologies
OPT-231 2948_05_2001_c1
10
IP+Optical Metro/Core Architecture
Metro Network Connects Customers to Services
Service PoP
Core Network Interconnects PoPs
Physical Rings Logically Hub and Spoke Fragmented Market Rapid Change
OPT-231 2948_05_2001_c1
Physical Point-to-Point Logically Peered Established Market Change Emerging (Ring-Mesh)

11
Optical Transport Options
IP
Dark fiber SONET/SDH DWDM

SONET/SDH GE
DWDM Fiber
OPT-231 2948_05_2001_c1
12
Dark Fiber
Effective alternative if fiber plant capacity is not limited or there is no need for bandwidth multiplication Modest distance (80 Km or less) No statistical gain Considerations when deploying IP infrastructures over dark fiber
Fiber plantcapacity and topology Power budgetsoptics reach Signal loss (due to attenuation and dispersion)optics reach Network design must address protection
OPT-231 2948_05_2001_c1
13
Effects of Jitter and Noise

Jitter Distorts the Signal in the Temporal Domain
Signal Amplitude
Error If Signal Is in This Area
Noise Distorts the Signal in the Amplitude Domain
Time
OPT-231 2948_05_2001_c1
14
Optical Attenuation
Specified in loss per kilometer (dB/km)
0.40 dB/km @ 1310 nm
Loss, dB/km 1 0.8
0.25 dB/km @ 1550 nm
0.6 0.4 0.2 0.1 1.2 1.3 1.4 1310 1310 Window Window
1550 1550 Window Window
Loss due to absorption by impurities

1400 nm peak due to hydroxyl (OH) ion absorption
OPT-231 2948_05_2001_c1
1.5
1.6
1.7
Wavelength, m
15
Calculating Link Loss Budget

Link Loss Budget = Optical Power Budget Design Margin Power Penalties
Optical Power Budget Design Margin (EOL) Power Penalties Connector and Splice Link Loss Budget
26dB (OC-48c POS [1550nm]) 1dB 2dB (OC-48c POS [1550nm]) 3dB 20dB
OPT-231 2948_05_2001_c1
16
Link Loss Budget Example

Tx Transmitter Power 2dB
Fiber Patch Fiber Distribution Panel 1dB 3dB
80Km Fiber Span
Link Loss 0.25dB/Km + Budget 20dB 1dB for Splice Loss
Fiber Distribution Panel Fiber Patch
19dB 1dB 20dB At Receiver
Rx Receiver Sensitivity 28db

OPT-231 2948_05_2001_c1
17
SONET/SDH
OPT-231 2948_05_2001_c1
18
SONET
Widely deployed optical transport technology TDM transmission Optimized for voice traffic Proactive fault and performance monitoring capability Fast restoration
? 50 msecs
OPT-231 2948_05_2001_c1
19
SONET/SDH Network Configurations

Point-to-Point Linear Two Nodes, Terminal Mode Up to 16 Nodes, ADM
Unidirectional Path Switched Ring
UPSR
All Traffic Homing to a Central Location

TX
Two Fiber Bi-directional Ring
2F BLSR
RCV
Traffic with Neighboring Pattern, Reusable Bandwidth
Four Fiber Bi-directional Ring

OPT-231 2948_05_2001_c1
4F BLSR
Traffic with Neighboring Pattern, Reusable Bandwidth

20
10
Packet Over SONET (POS)
OPT-231 2948_05_2001_c1
21
POS APS/MSP
APSAutomatic Protection Switching (APS) SDHMultiplex Switching Protection (MSP) Uses K1 and K2 byte; 1 + 1 Protection
Working Router W SONET/SDH Network P Working Router
OPT-231 2948_05_2001_c1
Working Router W
P
Protect Group Protocol
Protect Router
22
11
POS Applications
PoS Packet-over-SONET/SDH Runs over dark fiber, SONET, or WDM Enables transport mix and match Provides efficient evolution path for incumbents Provides optimized transport for greenfield builds Standards based
ADM
POS
Core EDGE
EDGE
Section Section + + Path Path Line Line OH OH OH OH
Concatenated Payload
ADM
TDM
ADM
ADM
Flag FCS Flag Address Address Control Control PPP PPP FCS Flag Flag 8 8 8 Packet 8 8 8 Packet 16/32 16/32 8 8
Dark Fiber
OPT-231 2948_05_2001_c1
~ ~ ~
WDM
~ ~ ~
23
Dynamic Packet Transport DPT
OPT-231 2948_05_2001_c1
24
12
DPT Overview
New Layer 2 MAC protocol Uses SONET/SDH framing Bandwidth efficient
MAC MAC IP IP Packet Packet MAC MAC IP IP Packet Packet Section Section + + Line Line Overhead Overhead Path Path OverOverhead head
Concatenated Concatenated Payload Payload
Fairness (SRP-fa) Scalable Fast protection switching and service restoration Multicasting and priority
OPT-231 2948_05_2001_c1
SRP-Based LAN/MAN
25
Dynamic Packet Transport

Maximize bandwidth efficiency Bandwidth consumed only on traversed segment Multiple nodes transmit concurrently Fairness via SRP-fa Self-healing through IPS Minimize provisioning and configuration
DPT Ring
OPT-231 2948_05_2001_c1
26
13
Dense Wave Division Multiplexing DWDM
OPT-231 2948_05_2001_c1
27
DWDM
Used to provide bandwidth multiplication where fiber plant capacity is scarce No protection on tributary side Network design must address protection
OPT-231 2948_05_2001_c1
28
14
DWDM for Fiber Gain

DWDM Offers Compelling Economics
40km 40km 40km 40km 40km 40km 40km 40km 40km 40km 40km 40km 40km 40km 40km 40km 40km 40km
1310 1310 1310 1310 1310 1310 1310 1310 1310 1310 1310 1310 1310 1310 1310 1310 TERM TERM TERM TERM RPTR RPTR RPTR RPTR RPTR RPTR RPTR RPTR RPTR RPTR RPTR RPTR RPTR RPTR RPTR RPTR 1310 1310 1310 1310 1310 1310 1310 1310 1310 1310 1310 1310 1310 1310 1310 1310 TERM TERM TERM TERM RPTR RPTR RPTR RPTR RPTR RPTR RPTR RPTR RPTR RPTR RPTR RPTR RPTR RPTR RPTR RPTR 1310 1310 1310 1310 1310 1310 1310 1310 1310 1310 1310 1310 1310 1310 1310 1310 TERM TERM TERM TERM RPTR RPTR RPTR RPTR RPTR RPTR RPTR RPTR RPTR RPTR RPTR RPTR RPTR RPTR RPTR RPTR 1310 1310 1310 1310 1310 1310 1310 1310 1310 1310 1310 1310 1310 1310 1310 1310 TERM TERM TERM TERM RPTR RPTR RPTR RPTR RPTR RPTR RPTR RPTR RPTR RPTR RPTR RPTR RPTR RPTR RPTR RPTR
OC-48 OC-48 OC-48 OC-48 OC-48 OC-48 OC-48 OC-48
DWDM Transmission10 Gb/s

120 120 km km 120 120 km km 120 120 km km
OA
OA
OA
OA
OC-48 OC-48 OC-48 OC-48 OC-48 OC-48 OC-48 OC-48
4 fibers 32 regenerators
OPT-231 2948_05_2001_c1
1 fiber 4 optical amplifiers

29
Optical Networks
OPT-231 2948_05_2001_c1
30
15
Design Considerations (Backbone)

Infrastructure redundancy
Routers Links No single point of failure
Path redundancy
Load sharing Protection
Capacity planning and traffic engineering Topology

OPT-231 2948_05_2001_c1
31
Clocking and Synchronization

Linecard Loop Timed Tx Rx Linecard Linecard Tx Rx Linecard
Rx
Tx
Switch Fabric
Rx
Tx
Internal Clock
Set clock source internal for back to back connections, dark fiber and DWDM
Linecard Tx ADM Rx SONET/SDH Network PRC Rx Loop Timed Rx Tx Loop Timed ADM Tx Rx Linecard
SDH ADM or termclocking derives from the Stratum 1 source in the SDH network Applies to both POS and SRP Clock the router from Line Always!
OPT-231 2948_05_2001_c1
32
16
Extending the Distance

OC-48 POS/SRP (LR) Regen Regen OC-48 POS/SRP (LR)
80 Km
80 Km
80 Km
Use regenerator
3RRe-amp, Re-shape and Re-time
Can be used for both POS and SRP Cisco regen supports IP over DCC for management 30 regens can be cascaded to get a distance of 2400 Km (? 1500 miles)
OPT-231 2948_05_2001_c1
33
Optical Network Infrastructure

Router
SONET/ SDH
DWDM
Fiber Plant
OPT-231 2948_05_2001_c1
34
17
Topology Options (Backbone)
Mesh
Full or partial
Point-to-point
POS
Ring
POS or SRP
OPT-231 2948_05_2001_c1
35
Full Mesh
POPA POPB
POPC
POPD
OPT-231 2948_05_2001_c1
Primary path Secondary/Load Share path

36
18
Full Mesh
All the backbone routers are connected to each other Single hop from any backbone router to the other Depending on the number of routers in the backbone, may require a lot of slots/ports
n(n-1)/2 ports
OPT-231 2948_05_2001_c1
37
Partial Mesh (1)

POPA POPB
POPC
POPD
OPT-231 2948_05_2001_c1

38
19
Partial Mesh
Each backbone router is connected to two or more backbone routers Multi-hop to some backbone router Uses less slot/port and fiber compared to full mesh topology Cost effective
OPT-231 2948_05_2001_c1
39
Point to PointPOS
Point to point connection using POS
OC-3/STM-1OC-192/STM-64c
EncapsulationHDLC/PPP Connecting to SONET/SDH

APS/MSP for protection
Connecting to DWDM or Dark fiber

Multiple links for load sharing and protection
OPT-231 2948_05_2001_c1
40
20
Connecting to DWDM
POPA POPB
POPC
DWDM
POPD

OPT-231 2948_05_2001_c1
41
Connecting to SONET/SDH
POPA W POPB W
SONET/SDH
POPC W POPD W
P Working Protect
OPT-231 2948_05_2001_c1
42
21
DPT PoP Design

Internet Backbone OC-192/STM-64c POS
OC-48/STM -16c
Internet Backbone OC-192/STM-64c POS

OPT-231 2948_05_2001_c1
43
MPLS
OPT-231 2948_05_2001_c1
44
22
Traffic Engineering with MPLS

Why traffic engineer?
Optimize link utilization Specific paths by customer or class Balance traffic load
Route Chosen by IP Routing Protocol Route Specified by Traffic Engineering
Traffic follows pre-specified path Path differs from normally routed path Controls packet flows across a L2 or L3 network infrastructure
OPT-231 2948_05_2001_c1
45
Unified (Optical) Control Plane Overview
OPT-231 2948_05_2001_c1
46
23
Existing Control Planes

Network Element Optical Cross Connect Optical Cross Connect MPLS IP-LSR Standard Body None ATM Forum IETF Routing Proprietary PNNI Constraint Based Signaling Proprietary PNNI LDP/ RSVP Available Future Deployed Deployed
Separate control planes exist for L1/2/3 Limited communication creates isolation Results in an overlay network model
Source: John DrakeMPLS Conference 1999
OPT-231 2948_05_2001_c1
47
UCP Protocols Standards Summary

Function Routing Protocol Signaling Link Management, Verification, Neighbor Discovery, Etc. Model Standards Body MP ? S/GMPLS IGP TE Extensions RSVP/CR-LDP Extensions LMP O-UNI N/A RSVP/CR-LDP Extensions LMP G.ASON N/A Out-of-band Client UNI Central Control, IP/ATM/ SONET Clients
Peer/Overlay Peer/IETF
Overlay to Peer OIF
Overlay ITU-T
Peer
Overlay Is a Subset of the Peer Model

Overlay
Drafts as of January 2001

OPT-231 2948_05_2001_c1 48
24
Unified Control Plane

Network and Service Management Services Unified Control Plane Packet Labels/VPI VCI Packets/Cells SONET/SDH
Internetworking Operating System
??Labels
Wavelength Routing DWDM Transport
OPT-231 2948_05_2001_c1
49
Control Plane Functions

Resource discovery Connection management
Path set-up/tear down Maintenance and monitoring
Topology/state dissemination
Reliable broadcast/Flooding
Path Selection
Constraint-based routing
OPT-231 2948_05_2001_c1
50
25
OCP/UCP Technology Scenarios

UNI
Used to build point-to-point SVC-Like circuit set-up mechanism Used to accelerate service delivery of IP or other service definitions across an optical overlay network topology
GMPLS
Used to enable standard protocol based circuit provisioning and restoration technique node by node within the interior of an optical transport network Used to construct a multi-vendor optical transport network Enables scalable node to node peering and full-mesh topologies Allows for the administrative boundary of a UNI Leverages existing IP network layer service definitions
Miscellaneous others
Pure IP Control Plane, Central Server Provisioning, GSMP (VSI)
OPT-231 2948_05_2001_c1
51
Evolution of Optical Core (IP over ? ) with Unified Control Plane

OC-48/STM16c OC-192/STM64c
Layer 3 : Packet Core
UCP
UCP
Unified Control Plane
Layer 1 : Optical Core

Optical Network Cloud
Benefits: Network simplification: common framework for packets and wavelen gths Reduced provisioning costs Increased service velocity Fast path restoration
OPT-231 2948_05_2001_c1
52
26
Router + OXC: Optical Pass-through for IP Traffic

Customers
POP Intraconnect
Egress OLSPs Egress
Customer Transit
Ingress
Transit Traffic forwarded thru OXCs

Offloads core routers of per-packet transit processing Frees up IP router resources for handling customer traffic
One-hop O-LSPs across core network

No intermediate per-packet processing lower latency and jitter
Improved Network Performance

OPT-231 2948_05_2001_c1
53
Deploying IP Services
OPT-231 2948_05_2001_c1
54
27
Whats the Problem?
API to API service creation Requirement for mobility Full IP network services
Voice Video WWW TV E-Mail SNA

55
OPT-231 2948_05_2001_c1
Complexitys an Issue Many Flows

Web Farm
FDDI FDDI
Web Farm
Internet
FDDI
Web Farm
Push Server
OPT-231 2948_05_2001_c1
Duration
56
28
IP Services: Essentials
Open standards Scalability Reliability Manageability Low latency Network services
DNS, DHCP, hosting, caching, AAA, number translation, SCP, firewall, NAT, etc
IP QoS IP traffic Eng IP VPN IP any-2-any IP multicast IP security
OPT-231 2948_05_2001_c1
57
Services: The Challenge

The optical IP network needs to meet the requirements of the applications Different services have different requirements:
Voice, videoconferencing, distance learning-low latency, low jitter Bulk data transfer-high bandwidth Email-no demanding requirements
OPT-231 2948_05_2001_c1
58
29
Services: The Challenge
To ensure service quality, each application or flow, needs to be differentiated from one another Non time critical applications, e.g. www, could impact time sensitive applications, such as voice or video
OPT-231 2948_05_2001_c1
59
The Need for QoS in IP Networks

Consider Voice
3005 OPT-231 2948_05_2001_c1 1165_05_2000_c1
2000, 2001, Cisco Cisco Systems, Systems, Inc. Inc. All rights reserved.
60
30
Traditional Voice Networks

Class 5 Switch Class 4 Switch Class 4 Switch Class 5 Switch
Cross Connect
ADM ADM ADM ADM ADM ADM
Cross Connect
ADM ADM ADM
ADM
ADM
ADM
ADM ADM
ADM
ADM
ADM
ADM
SONET/SDH Rings and or ATM Network Provides Low Delay, Low Jitter, and Protection, (BLSR/MSP Ring)
OPT-231 2948_05_2001_c1
61
Voice Quality: Compression Standards

Unacceptable
64
Utility
Business
Toll
Bandwidth (kbps)
56 48 40 32 24 16 8 0
PCM
ADPCM 32 (G.723) LD CELP 16 (G.728) LPC 4.8 ADPCM 16 (G.726) MPMLQ (G.723.1) LDCELP 16 (G.728) CS-ACELP 8 (G.729)
Quality
OPT-231 2948_05_2001_c1
62
31
Why Is It So Important to Minimise Delay?

Usability of Voice Circuit As a Function of End-to-end Delay
1
To Hit the Target:

Eliminate Eliminate PC PC delay delay Lower Lower network network latency latency Tighten Tighten network network jitter jitter
Utility
0.5 Toll Quality
Fax Relay, Fax Broadcast Satellite CB Radio I-Phone Today

300 100 200 400 500 600 700 800
180 ms End to End

OPT-231 2948_05_2001_c1
Time (msec)
63
Delay Considerations in IP Networks

Codec Packetization Output Queuing Access (Up) Link Transmission Backbone Network Transmission Access (Down) Link Transmission Input Queuing Jitter Buffer Codec
OPT-231 2948_05_2001_c1
64
32
Calculating a Delay Budget (G.729)

Encoder/decoder Delay (Algorithmic Plus Processing and VAD) Waiting and Framing (10 ms Frames) Move to Output Queue Wait in Queue (Depends on Queuing and Congestion) Access up Link -Backbone-down Link (1 ms Per 100 Miles) Move From Input Queue to DSP Jitter Buffer Coder Process Delay 30 ms 10 ms Negligible 08 ms
Variable
Negligible 4 Ms40 ms
Total: (Excluding up Link, Backbone, and Down Link) 45 ms

OPT-231 2948_05_2001_c1
65
What Is Referred to as QoS?
The following parameters are usually equated with QoS:

Bandwidth guarantees Admission control Delay Jitter
OPT-231 2948_05_2001_c1
66
33
QoS with IP Class of Service

Implemented at network Layer 3 Media independent Efficient use of available bandwidth through statistical multiplex Bandwidth guarantees, delay, and jitter limits via advanced queuing mechanisms Admission control only for applications that need certain guarantees (gatekeeper) Connectionlessno TDM
OPT-231 2948_05_2001_c1
67
Changing QoS Requirements

Changing applications change requirements Classic voice requires dedicated 64k channel in TDM network Voice over IP designed to work on IP transport networks, can tolerate delay and jitter within limits IP transport is inherently statistically multiplexed, but can limit delay and jitter to suit VoIP applications
OPT-231 2948_05_2001_c1
68
34
VoIP in the Intranet today

Edge PSTN Residential
PBX
POS I-Phone H.323 S/W PBX

QoS IP Optical Core
Branch Office
Headquarters
Larger Branch Office

OPT-231 2948_05_2001_c1
WWW
Content
VOD
69
VoIP Futures.
PSTN Residential
P UC
PBX
Branch
Optical Network Cloud
UCP
I-Phone H.323 S/W
Larger Office
PBX
Headquarters
WWW
OPT-231 2948_05_2001_c1
Content
VOD
70
35
Network Wide IP QoS
Packets are marked at the ingress or by the application and carry their classification throughout the network Core devices use this information to provide required services Easier to manage
OPT-231 2948_05_2001_c1
71
Congestion Issues
Routers by design can have congested links when an interface is offered more load than it can support for an extended period of time This can cause three things:
Packet loss due to output queue overflowsome traffic might be sensitive to it Added and varying delay-real time applications impacted Bandwidth for some important data is insufficient
OPT-231 2948_05_2001_c1
72
36
Dealing with IP Congestion

Impact can be minimized the following way:
Drop less important traffic before high priority traffic Handle delay sensitive traffic different than bulk data Ensure bandwidth for specific traffic is managed
OPT-231 2948_05_2001_c1
73
Edge Functions
Packet classification
Precedence setting with CAR
Bandwidth management
Rate limiting with CAR Traffic shaping
L3 metering
NetFlow data export
OPT-231 2948_05_2001_c1
74
37
Backbone Functions
High-speed switching and transport
Distributed switching (CEF)
QoS enforcement
Congestion avoidance (WRED) Congestion management (MDRR)
QoS interworking
IP-ATM QoS interworking (VC per CoS)
OPT-231 2948_05_2001_c1
75
Summary of Network IP QoS
L3 CAR WRED/MDRR
L3 CAR
Packet Packet Classifier Classifier
Premium Apply Ingress Rate Thresholds Determine Packet Class
Medium
Standard Apply Egress Rate Thresholds
Administer Packet Class
Traffic Metering
OPT-231 2948_05_2001_c1
76
38
Summary
We have seen that it is very feasible with careful design to deliver differentiated IP services over an optical infrastructure Different service requirements; (Delay, Jitter Etc.) can be accommodated using the tools available, CAR,WRED,MDRR Different traffic flows can be effectively marked, and differentiated from each other, enabling, Service providers to Offer billable, robust, IP services to their customers In the future the unified control plane will allow for service velocity
OPT-231 2948_05_2001_c1
77
Questions ?
OPT-231 2948_05_2001_c1
78
39
Designing Optical Infrastructures for IP Networks

Session OPT-231
OPT-231 2948_05_2001_c1
79
Please Complete Your Evaluation Form

Session OPT-231
OPT-231 2948_05_2001_c1
80
40
OPT-231 2948_05_2001_c1
81
41

Designing Optical Infrastructures For IP Networks

Uploaded by

Document Information

Original Title

Copyright

Available Formats

Share this document

Share or Embed Document

Sharing Options

Did you find this document useful?

Is this content inappropriate?

Copyright:

Available Formats

Designing Optical Infrastructures For IP Networks

Uploaded by

Copyright:

Available Formats

OPT-231 2948_05_2001_c1

2001, Cisco Systems, Inc. All rights reserved.