[bmwg] logic problem in RFC 3918

David Newman <dnewman@networktest.com> Wed, 19 December 2007 22:17 UTC

Return-path: <bmwg-bounces@ietf.org>
Received: from [127.0.0.1] (helo=stiedprmman1.va.neustar.com) by megatron.ietf.org with esmtp (Exim 4.43) id 1J57E9-0006PT-5W; Wed, 19 Dec 2007 17:17:21 -0500
Received: from [10.91.34.44] (helo=ietf-mx.ietf.org) by megatron.ietf.org with esmtp (Exim 4.43) id 1J57E7-0006Jy-Qz for bmwg@ietf.org; Wed, 19 Dec 2007 17:17:19 -0500
Received: from mail.networktest.com ([207.181.8.134]) by ietf-mx.ietf.org with esmtp (Exim 4.43) id 1J57E6-0001ON-AR for bmwg@ietf.org; Wed, 19 Dec 2007 17:17:19 -0500
Received: by mail.networktest.com (Postfix, from userid 1002) id 3B99C78C69; Wed, 19 Dec 2007 14:17:17 -0800 (PST)
X-Spam-Checker-Version: SpamAssassin 3.2.3 (2007-08-08) on mail.networktest.com
X-Spam-Level:
X-Spam-Status: No, score=-2.5 required=5.0 tests=AWL,BAYES_00 autolearn=ham version=3.2.3
Received: from dhcp254.eng.networktest.com (ns.networktest.com [207.181.8.130]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (No client certificate requested) by mail.networktest.com (Postfix) with ESMTP id 342DC78C54 for <bmwg@ietf.org>; Wed, 19 Dec 2007 14:17:11 -0800 (PST)
Message-ID: <47699866.70206@networktest.com>
Date: Wed, 19 Dec 2007 14:17:10 -0800
From: David Newman <dnewman@networktest.com>
Organization: Network Test Inc.
User-Agent: Thunderbird 2.0.0.9 (Macintosh/20071031)
MIME-Version: 1.0
To: bmwg@ietf.org
X-Enigmail-Version: 0.95.5
Content-Type: text/plain; charset="ISO-8859-1"
Content-Transfer-Encoding: 7bit
X-Spam-Score: 0.0 (/)
X-Scan-Signature: 7baded97d9887f7a0c7e8a33c2e3ea1b
Subject: [bmwg] logic problem in RFC 3918
X-BeenThere: bmwg@ietf.org
X-Mailman-Version: 2.1.5
Precedence: list
List-Id: Benchmarking Methodology Working Group <bmwg.ietf.org>
List-Unsubscribe: <https://www1.ietf.org/mailman/listinfo/bmwg>, <mailto:bmwg-request@ietf.org?subject=unsubscribe>
List-Post: <mailto:bmwg@ietf.org>
List-Help: <mailto:bmwg-request@ietf.org?subject=help>
List-Subscribe: <https://www1.ietf.org/mailman/listinfo/bmwg>, <mailto:bmwg-request@ietf.org?subject=subscribe>
Errors-To: bmwg-bounces@ietf.org

The multicast group capacity test (RFC 3918, section 7.1) says an
iteration passes if "at least one frame for each multicast group is
forwarded properly by the DUT/SUT on each participating egress interface."

That word "properly" is a problem; as the test is currently written,
there's no way to verify it.

Most (though perhaps not all) switches will flood multicast traffic when
the test instrument attempts to join more groups than the DUT/SUT can
handle.

A flooded frame looks exactly the same as a non-flooded one. Since an
RFC-compliant test can be performed with as little equipment as one
ingress and one egress interface (indeed, that's explicitly stated in at
least one commercial implementation), the test instrument cannot detect
that the DUT/SUT is flooding, and will still pass that iteration.

A test with 1000 egress interfaces also will incorrectly pass if
receivers on all 1000 interfaces join the same groups and flooding occurs.

Two possible fixes:

1. Add one or more monitor ports to the test, and fail any iteration in
which the test instrument receives multicast test traffic on the monitor
port(s). This is conceptually similar to the setup in RFC 2889's address
caching capacity test.

2. Configure the test instrument so that each egress interface joins a
different set of multicast groups. Fail any iteration in which multicast
traffic is not forwarded properly (in this case, shows up on the wrong
egress interface).

Of these two, I strongly prefer option 1. It allows for tests with more
fan-out and, in L3 scenarios, more mroutes. Both of these are more
stressful on the DUT/SUT.

dn




_______________________________________________
bmwg mailing list
bmwg@ietf.org
https://www1.ietf.org/mailman/listinfo/bmwg