NFS speedup tip from Roman Drahtmueller

[Ken Yap <ken@nhj.nlc.net.au>]

>From draht@rzlin1.ruf.uni-freiburg.de Mon Sep 07 02:38:59 1998
Return-Path: <draht@rzlin1.ruf.uni-freiburg.de>
Delivered-To: ken@nlc.net.au
Received: (qmail 9697 invoked by alias); 7 Sep 1998 12:38:59 +1000
Received: (qmail 9691 invoked from network); 7 Sep 1998 12:38:57 +1000
Received: from rzlin1.ruf.uni-freiburg.de (draht@132.230.4.151)
  by nhj.nlc.net.au with SMTP; 7 Sep 1998 12:38:57 +1000
Received: (from draht@localhost)
	by rzlin1.ruf.uni-freiburg.de (8.8.5/8.8.5) id EAA02197;
	Mon, 7 Sep 1998 04:38:36 +0200
Date: Mon, 7 Sep 1998 04:38:33 +0200 (MEST)
From: Roman Drahtmueller <draht@uni-freiburg.de>
Reply-To: draht@uni-freiburg.de
To: Ken Yap <ken@nlc.net.au>
Subject: Re: Nice Job. 
In-Reply-To: <E0zFpni-0006oD-00@mailgateway1.uni-freiburg.de>
Message-ID: <Pine.LNX.3.96.980907041930.32677b-200000@rzlin1.ruf.uni-freiburg.de>
X-Organization: University of Freiburg
X-Remarks: Rechenzentrum der Uni Freiburg
X-Bogomips: 66.56 BogoMIPS
X-Beware: Having return-path problems
X-Bullshit: The header is genuine....WTF did you expect?
X-Cry: help me I'm a prisioner in a coke factory - send beer
X-Ftp-Home: ftp://ftp.warez.org/
X-Mailer: Mozarella beta (Alles Kaese) V211.2.142
X-Question: Are you bored? Just interested cause you read mail headers...
MIME-Version: 1.0
Content-Type: MULTIPART/MIXED; BOUNDARY="-427518204-944616098-905135913=:32677"

  This message is in MIME format.  The first part should be readable text,
  while the remaining parts are likely unreadable without MIME-aware tools.
  Send mail to mime@docserver.cac.washington.edu for more info.

---427518204-944616098-905135913=:32677
Content-Type: TEXT/PLAIN; charset=ISO-8859-1
Content-Transfer-Encoding: QUOTED-PRINTABLE

Hey, btw, I have something that might be of interest for you.

Some trick that speeds up nfs by a factor of 2 (it reaches 10Base-T limits
here).

Grab the latest unfsd-package from
linux.mathematik.tu-darmstadt.de:/pub/linux/people/okir
and run rpc.nfsd with something like this:

/usr/sbin/rpc.nfsd 2

This will make it fork a second daemon so that both daemons will answer
requests. By testing it turned out that more than two are no good any
more. Now comes the clue: Use the little program in the attachment
(resched) to change the scheduling policy of the daemons by doing this:=20

for i in `ps fauxw | grep rpc.nfsd | grep -v grep | awk '{print $2}'`; do
     /usr/local/bin/resched -r $i >/dev/null 2>&1 && echo -n $i" "
done

and then see how throughput has changed.

Be careful with resched because only interrupts will interrupt a process
in the runqueue that is running under SCHED_RR or SCHED_FIFO policy.
You know what I mean, the box locks up if something loops.
I usually use it to have a realtime scheduling policy shell handy if one
of my lusers hit the wrong button and the machine overloads.

Performance gets close to a Sparc sun under Solaris doing nfs-V2(UDP).

Pass the trick on to the others, if you like, and tell them greetings.

Roman.
 _                                                                   _
| Roman Drahtm=FCller              "The whole world is about three      |
  CC University of Freiburg       drinks behind."
| email: draht@uni-freiburg.de         (Humphrey Bogart)              |
 -                                                                   -

---427518204-944616098-905135913=:32677
Content-Type: TEXT/plain; name="resched.c"
Content-Transfer-Encoding: BASE64
Content-ID: <Pine.LNX.3.96.980907043833.32677c@rzlin1.ruf.uni-freiburg.de>
Content-Description: resched.c

LyoNCiAqICByZXNjaGVkIChSb21hbiBEcmFodG11ZWxsZXIgPGRyYWh0QHVu
aS1mcmVpYnVyZy5kZT4NCiAqDQogKiAgZGVsaXZlcnMgYSBwcm9jZXNzIHRv
IGFub3RoZXIgc2NoZWR1bGluZyBjbGFzcyBwb2xpY3kuDQogKg0KICogIENB
VVRJT046IEhhbmRsZSB3aXRoIGNhcmUgYW5kIHJlYWQgdGhlIG1hbnBhZ2Ug
YmVmb3JlIHlvdSB1c2UgaXQuDQogKiAgICAgICAgICAgQ1BVLWludGVzaXZl
IHByb2Nlc3NlcyB3aWxsIG5vdCByZXR1cm4gYmVmb3JlIHRoZXkgYXJlDQog
KiAgICAgICAgICAgZmluaXNoZWQgb3IgYmxvY2tlZCBvbiBJL08uIChUaGlz
IG1lYW5zIHRoYXQgaXQgY291bGQgDQogKiAgICAgICAgICAgaGFuZyB5b3Vy
IG1hY2hpbmUsIGx1c2VyISkNCiAqDQogKiAgVXNlIGFzIHlvdSB3aXNoLiBU
aGUgYXV0aG9yIGlzIG5vdCByZXNwb25zaWJsZSBmb3INCiAqICBkYW1hZ2Vz
IHRoYXQgY291bGQgcmVzdWx0IGZyb20gdXNpbmcgdGhpcyBzb2Z0d2FyZS4N
CiAqICBQZXJtaXNzaW9uIGdyYW50ZWQgdG8gZGlzdHJpYnV0ZSBhdCB3aWxs
Lg0KICoNCiAqLw0KDQojaWZkZWYgbGludXgNCiAgICAjaW5jbHVkZSA8Z2V0
b3B0Lmg+DQojZWxzZQ0KICAgIC8qIFNvbGFyaXM6IGNjIC1scG9zaXg0IC1v
IHJlc2NoZWQgcmVzY2hlZC5jICovDQogICAgI2luY2x1ZGUgPHN0ZGxpYi5o
Pg0KI2VuZGlmDQojaW5jbHVkZSA8c2NoZWQuaD4NCiNpbmNsdWRlIDxzdGRp
by5oPg0KDQpleHRlcm4gaW50IGF0b2koKTsNCnZvaWQgdXNhZ2Uodm9pZCkg
ew0KICAgICAgICAgICAgZnByaW50ZihzdGRlcnIsIlxuVXNhZ2U6IHJlc2No
ZWQgLXAgPHByaW9yaXR5PiA8LXN8LWZ8LXI+ICA8cGlkPlxuIik7DQogICAg
ICAgICAgICBmcHJpbnRmKHN0ZGVyciwiXHQtcyA9PSBTQ0hFRF9PVEhFUiwg
LWYgPT0gU0NIRURfRklGTywgLXIgU0NIRURfUlJcbiIpOw0KICAgICAgICAg
ICAgZnByaW50ZihzdGRlcnIsIkhhbmRsZSB3aXRoIGNhcmUgYW5kIHJlYWQg
dGhlIGRvY3VtZW50YXRpb25cbiIpOw0KICAgICAgICAgICAgZnByaW50Zihz
dGRlcnIsImFib3V0IHNjaGVkdWxpbmcgY2xhc3NlcyBiZWZvcmUgeW91IHVz
ZSB0aGlzIHByb2dyYW0hXG5cbiIpOw0KfQ0KDQppbnQgbWFpbihhcmdjLCBh
cmd2KQ0KICAgIGNoYXIgKiphcmd2Ow0Kew0KICAgIGNoYXIgYzsNCiAgICBz
dHJ1Y3Qgc2NoZWRfcGFyYW0gKnByaW9yaXR5Ow0KICAgIGludCBwaWQgPSAt
MSwgcG9saWN5ID0gU0NIRURfT1RIRVI7IA0KICAgIHByaW9yaXR5ID0gKHN0
cnVjdCBzY2hlZF9wYXJhbSAqKSBtYWxsb2Moc2l6ZW9mKHN0cnVjdCBzY2hl
ZF9wYXJhbSkpOw0KICAgIHByaW9yaXR5LT5zY2hlZF9wcmlvcml0eSA9IDE7
DQogICAgd2hpbGUgKChjID0gZ2V0b3B0KGFyZ2MsIGFyZ3YsICJwOmZzcmgi
KSkgIT0gRU9GKQ0KICAgICAgICBzd2l0Y2ggKGMpIHsNCiAgICAgICAgY2Fz
ZSAncCc6DQogICAgICAgICAgICBwcmlvcml0eS0+c2NoZWRfcHJpb3JpdHkg
PSBhdG9pKG9wdGFyZyk7DQogICAgICAgICAgICBicmVhazsNCiAgICAgICAg
Y2FzZSAncyc6DQogICAgICAgICAgICBwb2xpY3kgPSBTQ0hFRF9PVEhFUjsN
CiAgICAgICAgICAgIGJyZWFrOw0KICAgICAgICBjYXNlICdmJzoNCiAgICAg
ICAgICAgIHBvbGljeSA9IFNDSEVEX0ZJRk87DQogICAgICAgICAgICBicmVh
azsNCiAgICAgICAgY2FzZSAncic6DQogICAgICAgICAgICBwb2xpY3kgPSBT
Q0hFRF9SUjsNCiAgICAgICAgICAgIGJyZWFrOw0KICAgICAgICBjYXNlICdo
JzoNCiAgICAgICAgICAgIHVzYWdlKCk7DQogICAgICAgICAgICBleGl0ICgx
KTsNCiAgICAgICAgZGVmYXVsdDoNCiAgICAgICAgICAgIHBvbGljeSA9IFND
SEVEX09USEVSOw0KICAgICAgICAgICAgYnJlYWs7DQogICAgICAgIH0NCiAg
ICBpZiAoYXJnYy1vcHRpbmQgPT0gMSkNCiAgICAgICAgcGlkID0gYXRvaShh
cmd2W29wdGluZF0pOw0KICAgIGVsc2UgaWYgKGFyZ2Mtb3B0aW5kICE9IDAp
IHsNCiAgICAgICAgICAgIHVzYWdlKCk7DQogICAgICAgICAgICBleGl0KDEp
Ow0KICAgICAgICB9DQogICAgaWYgKHBvbGljeSA9PSBTQ0hFRF9PVEhFUiAp
IHByaW9yaXR5LT5zY2hlZF9wcmlvcml0eSA9IDA7DQogICAgcHJpbnRmKCJj
YWxsaW5nIHNjaGVkX3NldHNjaGVkdWxlcjogcGlkOiAlaSBwcmlvcml0eTog
JWkgcG9saWN5ID0gJWkgXG4iDQogICAgICAgICAgICAgICAgLHBpZCxwcmlv
cml0eS0+c2NoZWRfcHJpb3JpdHkscG9saWN5KTsNCiAgICBpZiAoMCA+IHNj
aGVkX3NldHNjaGVkdWxlcihwaWQscG9saWN5LHByaW9yaXR5KSkgew0KICAg
ICAgICBwZXJyb3IoInNjaGVkX3NldHNjaGVkdWxlciIpOw0KICAgICAgICB1
c2FnZSgpOw0KICAgICAgICBleGl0KC0xKTsNCiAgICB9DQogICAgZXhpdCAo
MCk7DQp9DQo=
---427518204-944616098-905135913=:32677--