Results 1 to 14 of 14
  1. #1
    Join Date
    Jan 2003
    Location
    Chicago, IL
    Posts
    6,889

    Router Suggestion - Hundreds of Peers

    I was wondering if anyone had any suggestions, preferably based on experience, for a router than can handle a couple hundred BGP peers, but will not necessarily be pushing a lot of traffic. The router should be able to handle 200-400 BGP peers, but will only need to push around 2-3 Gbit/sec.

    What would anyone recommend for this specific configuration?

    I am willing to spend whatever is needed, though I also don't want to just be throwing more money at it than I need to to get the job done effectively.
    Karl Zimmerman - Steadfast: Managed Dedicated Servers and Premium Colocation
    karl @ steadfast.net - Sales/Support: 312-602-2689
    Cloud Hosting, Managed Dedicated Servers, Chicago Colocation, and New Jersey Colocation
    Now Open in New Jersey! - Contact us for New Jersey colocation or dedicated servers

  2. #2
    Join Date
    Jun 2001
    Location
    Denver, CO
    Posts
    3,301
    How many routes per peer?
    Jay Sudowski // Handy Networks LLC // Co-Founder & CTO
    AS30475 - Level(3), HE, Telia, XO and Cogent. Noction optimized network.
    Offering Dedicated Server and Colocation Hosting from our SSAE 16 SOC 2, Type 2 Certified Data Center.
    Current specials here. Check them out.

  3. #3
    Join Date
    Jan 2003
    Location
    Chicago, IL
    Posts
    6,889
    Quote Originally Posted by Jay Suds View Post
    How many routes per peer?
    On average, probably only ~500.
    Karl Zimmerman - Steadfast: Managed Dedicated Servers and Premium Colocation
    karl @ steadfast.net - Sales/Support: 312-602-2689
    Cloud Hosting, Managed Dedicated Servers, Chicago Colocation, and New Jersey Colocation
    Now Open in New Jersey! - Contact us for New Jersey colocation or dedicated servers

  4. #4
    Join Date
    Jun 2001
    Location
    Denver, CO
    Posts
    3,301
    Assuming you won't be also taking full routes from someone, you could theoretically do this on sup2-msfc2 setup. We don't run 200 peers, but we do have 40+ (two with full routes, the rest running iBGP and about 25-40 routes per peer). Only major drawback here is that you are not going to be able to pass IPv6, since it does that in software. However, for not much more money you could also do it on a sup32, which has pfc3b Neither of these are switch fabric enabled, but you would still definitely be able to move a few Gbps.
    Jay Sudowski // Handy Networks LLC // Co-Founder & CTO
    AS30475 - Level(3), HE, Telia, XO and Cogent. Noction optimized network.
    Offering Dedicated Server and Colocation Hosting from our SSAE 16 SOC 2, Type 2 Certified Data Center.
    Current specials here. Check them out.

  5. #5
    Join Date
    Jan 2003
    Location
    Chicago, IL
    Posts
    6,889
    Well, on the Cisco SUP720 we've noticed that there seem to be some odd behaviors when you start adding in a lot of peers, with sudden CPU jumps, etc. True, it doesn't seem to have any physical limits being reached, but it doesn't really seem to work that well in real life.

    Also, yes, IPv6 support is a requirement.
    Karl Zimmerman - Steadfast: Managed Dedicated Servers and Premium Colocation
    karl @ steadfast.net - Sales/Support: 312-602-2689
    Cloud Hosting, Managed Dedicated Servers, Chicago Colocation, and New Jersey Colocation
    Now Open in New Jersey! - Contact us for New Jersey colocation or dedicated servers

  6. #6
    Join Date
    Jun 2001
    Location
    Denver, CO
    Posts
    3,301
    Your experience with sup720 sounds more like an IOS bug than anything. CTAC have anything to say about it?

    sup720-3bxl supposedly can scale up to 2500 peers and these fulks running the test state Cisco recommend 1000 or less peers. http://www.eantc.com/fileadmin/eantc.../Section_5.pdf. Seems like a fairly intensive test.
    Jay Sudowski // Handy Networks LLC // Co-Founder & CTO
    AS30475 - Level(3), HE, Telia, XO and Cogent. Noction optimized network.
    Offering Dedicated Server and Colocation Hosting from our SSAE 16 SOC 2, Type 2 Certified Data Center.
    Current specials here. Check them out.

  7. #7
    Join Date
    Aug 2006
    Location
    Ashburn VA, San Diego CA
    Posts
    4,571
    You don't need anything special, the memory so the more the better though.
    Fast Serv Networks, LLC | AS29889 | Fully Managed Cloud, Streaming, Dedicated Servers, Colo by-the-U
    Since 2003 - Ashburn VA + San Diego CA Datacenters

  8. #8
    Join Date
    Jan 2003
    Location
    Chicago, IL
    Posts
    6,889
    Quote Originally Posted by Jay Suds View Post
    Your experience with sup720 sounds more like an IOS bug than anything. CTAC have anything to say about it?

    sup720-3bxl supposedly can scale up to 2500 peers and these fulks running the test state Cisco recommend 1000 or less peers. http://www.eantc.com/fileadmin/eantc.../Section_5.pdf. Seems like a fairly intensive test.
    It does seem an IOS upgrade had solved most of the issues we had had with the other configuration, but that still makes me a bit wary. That testing there makes me confident enough to at least give Cisco another shot at this, I'll just have to make sure the router is doing basically nothing else other than handling these peers.

    It is also helpful that it shows exactly the IOS and hardware config they were using to achieve those results, making it a lot easier to duplicate the results.
    Karl Zimmerman - Steadfast: Managed Dedicated Servers and Premium Colocation
    karl @ steadfast.net - Sales/Support: 312-602-2689
    Cloud Hosting, Managed Dedicated Servers, Chicago Colocation, and New Jersey Colocation
    Now Open in New Jersey! - Contact us for New Jersey colocation or dedicated servers

  9. #9
    Join Date
    Apr 2002
    Location
    North Kansas City, MO
    Posts
    2,565
    I've seen it done by a large provider on Foundry XMRs without any issues.
    Aaron Wendel
    Wholesale Internet, Inc. - http://www.wholesaleinternet.net
    Kansas City Internet eXchange - http://www.kcix.net

  10. #10
    foundry xmr with 4.0x handles upwards around 2000+ ipv4/ipv6/both/either/etc peers

    4000 chassis to save $ if you don't need a lot of slots for private interconnects, and will just go across a peering fabric

  11. #11
    Join Date
    Oct 2005
    Location
    London, UK
    Posts
    138
    We run Juniper M7i with that amount of traffic and well over 400 peers, mixture of v4/v6. CPU is doing next to nothing (and we're sampling 1:2000 packets on it):


    Code:
    myrouter!> show bgp summary | match Groups 
    Groups: 32 Peers: 441 Down peers: 11
    Code:
    Routing Engine status:
        Temperature                 28 degrees C / 82 degrees F
        CPU temperature             30 degrees C / 86 degrees F
        DRAM                      1536 MB
        Memory utilization          62 percent
        CPU utilization:
          User                       1 percent
          Background                 0 percent
          Kernel                     3 percent
          Interrupt                  1 percent
          Idle                      95 percent
        Model                          RE-850
        Serial ID                      1000703421
        Start time                     2009-01-22 00:10:30 UTC
        Uptime                         182 days, 22 hours, 1 minute, 48 seconds
        Load averages:                 1 minute   5 minute  15 minute
                                           0.13       0.09       0.08
    Goscomb Technologies Limited - www.goscomb.net / AS39326
    E: [email protected] P: +44 (0) 203 129 4400 F: +44 (0) 203 129 4410
    IP Transit :: Colocation :: Dedicated Servers :: Leased Lines :: DSL
    Registered in England and Wales No. 05672987 - VAT Registration No. 853 7954 80

  12. #12
    Join Date
    Jan 2003
    Location
    Chicago, IL
    Posts
    6,889
    Quote Originally Posted by goscombtech View Post
    We run Juniper M7i with that amount of traffic and well over 400 peers, mixture of v4/v6. CPU is doing next to nothing (and we're sampling 1:2000 packets on it):
    How many routes on that config?
    Karl Zimmerman - Steadfast: Managed Dedicated Servers and Premium Colocation
    karl @ steadfast.net - Sales/Support: 312-602-2689
    Cloud Hosting, Managed Dedicated Servers, Chicago Colocation, and New Jersey Colocation
    Now Open in New Jersey! - Contact us for New Jersey colocation or dedicated servers

  13. #13
    Join Date
    Oct 2005
    Location
    London, UK
    Posts
    138
    Code:
    stillmyrouter> show route summary | match inet | except private    
    
    inet.0: 288991 destinations, 683875 routes (287600 active, 10 holddown, 1907 hidden)
    
    inet.1: 6 destinations, 6 routes (6 active, 0 holddown, 0 hidden)
    
    inet.2: 6164 destinations, 8694 routes (5991 active, 0 holddown, 504 hidden)
    
    inet.3: 1 destinations, 1 routes (1 active, 0 holddown, 0 hidden)
    
    inet.4: 2487 destinations, 5085 routes (1954 active, 0 holddown, 977 hidden)
    
    inet6.0: 2058 destinations, 4945 routes (2021 active, 0 holddown, 955 hidden)
    Goscomb Technologies Limited - www.goscomb.net / AS39326
    E: [email protected] P: +44 (0) 203 129 4400 F: +44 (0) 203 129 4410
    IP Transit :: Colocation :: Dedicated Servers :: Leased Lines :: DSL
    Registered in England and Wales No. 05672987 - VAT Registration No. 853 7954 80

  14. #14
    We have a sup720-3bxl that has 176 peers, 10 with full tables, another 20 or so with more than 1000 prefixes, and the rest with less than 100 prefixes. Does about 3Gbps and has never had a problem.

Similar Threads

  1. router suggestion
    By linktome in forum Colocation and Data Centers
    Replies: 7
    Last Post: 04-24-2009, 11:05 AM
  2. Cogent DE-peers Telia
    By bummer6666 in forum Colocation and Data Centers
    Replies: 117
    Last Post: 03-31-2008, 04:29 PM
  3. Opinions from my peers
    By ndndixie in forum Web Design and Content
    Replies: 3
    Last Post: 08-29-2006, 07:04 AM
  4. Router suggestion
    By queensu in forum Colocation and Data Centers
    Replies: 5
    Last Post: 11-17-2005, 08:16 PM
  5. major peers site...
    By infexious in forum Dedicated Server
    Replies: 1
    Last Post: 08-07-2005, 05:37 PM

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •