LISTSERV mailing list manager LISTSERV 16.5

Help for P2P Archives


P2P Archives

P2P Archives


P2P@LISTSERV.UTK.EDU


View:

Message:

[

First

|

Previous

|

Next

|

Last

]

By Topic:

[

First

|

Previous

|

Next

|

Last

]

By Author:

[

First

|

Previous

|

Next

|

Last

]

Font:

Proportional Font

LISTSERV Archives

LISTSERV Archives

P2P Home

P2P Home

P2P  February 2001

P2P February 2001

Subject:

Univ of Texas at Ausin's ResNet Approach

From:

William Green <[log in to unmask]>

Reply-To:

Peer-to-Peer <[log in to unmask]>

Date:

Tue, 20 Feb 2001 12:16:14 -0600

Content-Type:

text/plain

Parts/Attachments:

Parts/Attachments

text/plain (105 lines)

Anna asked me to post a message describing the approach we have taken to
control bandwidth on the University of Texas at Austin residential
network.  I am not advocating this approach for others, simply explaining
what we are doing as requested (http://resnet.utexas.edu/):

Background:
UT Austin is a commuter campus with ~50K students.  About 7K live in our on
campus dormitories.  In 1996, we installed a residential network, ResNet,
which now has ~7K ports (port per pillow) and charges a monthly fee for
access.  We recognized the problems of the traditional academic Internet
model when we built our ResNet (infinite bandwidth at zero cost), but
figured we'd be able to get away with it by addressing the problem users as
they cropped up in hopes that pre-packaged affordable (free) solutions
would present themselves.  They didn't.  Thanksgiving of 1999, someone
indexed all the open netbios ports sharing out all the mp3s the tikes had
been storing up.  There were to many open hosts to address individually, so
we applied a filter, and teased ourselves that the end was near.  That
December, and following January, Napster hit our campus, and we applied yet
another filter.  The filters were applied to protect the rest of campus
from ResNet's insatiable bandwidth demands.  We knew the filters would fail
as applications and ports changed, but we had to buy time.

We had studied our ResNet traffic patterns for years, and knew that 2% of
the users were consuming 50% of the bandwidth (0.2% consuming 15%).  In
nearly all the cases we painstakingly investigated over the years, we found
the students running servers, and the users of those servers were from
outside the University.  So people unassociated with the University were
consuming the majority of the bandwidth.  Almost all the content from the
servers belonged to someone else.  So we got a lot of not so friendly
lawyers contacting the University, causing us to spend time investigating
for our Dean of Student's Office in addition to shutting ports down.  Being
in the ISP business, we were merely concerned with the amount of bandwidth
used.  All the revenues generated did not cover the amount the 2%
used.  Clearly we needed a limit.  If we limited just the ResNet system,
then those who were not consuming more than their fair share they had paid
for would suffer slow access.  Nor could the residents afford to pay the
actual costs of the 2% (which was ever increasing).  I could yammer on, but
I'm sure you have heard all the arguments.   We needed a system that fairly
allocated bandwidth amongst the residents.

Fair Access Policy:
Since 9/2000 each resident is granted a weekly bandwidth allocation-- which
they are able to monitor on our web pages.  When they exceed this
allocation, their port is deactivated until the next week.  As they
approach the limit, they are e-mailed a warning message.  When they reach
the limit, their port is deactivated, and they are e-mailed an
explanation.  Residents can contact the help desk via phone, or, from our
web site on a different machine or lab machine, may request a small
bandwidth grant for the remainder of the week.  When the second grant is
exceeded, the port is again deactivated, and they are e-mailed an
explanation.  No exceptions are made.  The system is fully automated.

Much study and thought went into the bandwidth limits we chose
initially.  The limits will change over time as usage changes.  The initial
grant is 3.5GB, warning at 3GB, with an additional grant of 500MB.  This is
oversubscribed, but works at the present.  Many things could be offered in
the future, like usage sensitive billing.

Implementation basics (I didn't write it-- just hounded the person who did):
We had an existing set of databases used to manage our ResNet that
contained a multitude of information: resident information (from the big
database in the sky), resident to room/port mappings (user registration via
web page), cable to room mappings, cable to hub/switch port mappings,
ethernet mac address to hub/switch port mappings (hub/switch traps),
hub/switch port to vlan assignments, ip to mac address mappings (router arp
table, and special sniffing software on switch span ports).  This system
already knows how to activate and deactivate ports via SNMP calls to the
hub/switches for a registration system which is how residents register
their ports.  We wrote this software in C++ running on a PC under FreeBSD
and utilizing mysql as the underlying database-- some perl for the web
front ends.

We hung a system off to the side that does accounting.  Netflow statistics
are collected from the router, summarized, and placed in the same mysql
database.  If we didn't already have a management system to be used to map
flows back to the residents based on ip address, this information would
have been pretty useless.  The bandwidth monitor cycles through that
database on a regular basis to turn ports on and off.  The residents are
presented graphs based on the same underlying database on the web page for
their registered port.  Works for us.  Unfortunately, we wrote it for
ourselves and it isn't especially portable because it relies so much on our
existing management system and our internal policies.  Again, all in C++.

We hope to package up the Netflow portion (sans ResNet database) to run
under Linux.  So someone could drop it on generic Linux machine, configure
their router to export netflow, and get traffic reports for all the hosts
handled by that router.  We already do that for the rest of our campus to
track the other 35K hosts (gives us a top N we go through manually and
investigate).  But, only if we get time-- we have very few staff for a
network of our size.

Results:
We have been able to meet our ResNet bandwidth goals.  All users share a
fair amount of high quality bandwidth.  On a typical week < 1% of the ports
are deactivated.  A number of these are repeat deactivations (their ports
are activated every Sunday at 00:01 hours and deactivated Monday evening
after using up their allocation).  We received very few complaints-- the
residents seemed to understand the reasoning and thought the allocations
were more than fair.  We are out of the content monitoring business.  My
ResNet administrator now has a life and has even taken up cooking lesson
(something not possible when up at 02:00 with a sniffer).


-William

Top of Message | Previous Page | Permalink

Advanced Options


Options

Log In

Log In

Get Password

Get Password


Search Archives

Search Archives


Subscribe or Unsubscribe

Subscribe or Unsubscribe


Archives

October 2024
September 2024
August 2024
July 2024
June 2024
May 2024
April 2024
March 2024
February 2024
January 2024
December 2023
November 2023
October 2023
September 2023
July 2023
June 2023
May 2023
April 2023
March 2023
February 2023
January 2023
December 2022
November 2022
October 2022
September 2022
August 2022
May 2022
February 2022
January 2022
December 2021
November 2021
October 2021
September 2021
July 2021
June 2021
May 2021
April 2021
March 2021
February 2021
January 2021
December 2020
November 2020
October 2020
September 2020
August 2020
July 2020
June 2020
May 2020
April 2020
March 2020
February 2020
January 2020
December 2019
November 2019
October 2019
September 2019
August 2019
July 2019
June 2019
May 2019
April 2019
March 2019
February 2019
January 2019
December 2018
October 2018
September 2018
August 2018
June 2018
August 2017
July 2017
June 2017
May 2017
April 2017
March 2017
February 2017
November 2016
October 2016
August 2016
July 2016
June 2016
May 2016
April 2016
March 2016
February 2016
January 2016
December 2015
November 2015
October 2015
July 2015
June 2015
April 2015
March 2015
February 2015
January 2015
September 2014
May 2014
April 2014
March 2014
February 2014
January 2014
December 2013
November 2013
September 2013
August 2013
July 2013
June 2013
May 2013
April 2013
March 2013
January 2013
December 2012
November 2012
September 2012
August 2012
June 2012
May 2012
March 2012
January 2012
December 2011
November 2011
October 2011
September 2011
August 2011
July 2011
April 2009
January 2009
July 2008
October 2007
July 2007
June 2007
May 2007
February 2007
October 2006
July 2006
June 2006
March 2006
January 2006
September 2005
June 2005
April 2005
March 2005
February 2005
November 2004
October 2004
September 2004
June 2004
May 2004
April 2004
March 2004
February 2004
January 2004
December 2003
November 2003
October 2003
September 2003
August 2003
July 2003
May 2003
April 2003
March 2003
February 2003
January 2003
December 2002
November 2002
October 2002
September 2002
August 2002
July 2002
June 2002
May 2002
April 2002
March 2002
February 2002
January 2002
December 2001
November 2001
October 2001
September 2001
August 2001
July 2001
June 2001
May 2001
April 2001
March 2001
February 2001
January 2001
December 2000
November 2000

ATOM RSS1 RSS2



LISTSERV.UTK.EDU

CataList Email List Search Powered by the LISTSERV Email List Manager