
From nobody Wed Jun 10 03:20:45 2020
Return-Path: <olivier.tilmans@nokia-bell-labs.com>
X-Original-To: tcpprague@ietfa.amsl.com
Delivered-To: tcpprague@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 9C19B3A08D5 for <tcpprague@ietfa.amsl.com>; Wed, 10 Jun 2020 03:20:43 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -1.903
X-Spam-Level: 
X-Spam-Status: No, score=-1.903 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIMWL_WL_HIGH=-0.001, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, RCVD_IN_MSPIKE_H2=-0.001, SPF_PASS=-0.001] autolearn=ham autolearn_force=no
Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (1024-bit key) header.d=nokia.onmicrosoft.com
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id r-mvsfhSntrb for <tcpprague@ietfa.amsl.com>; Wed, 10 Jun 2020 03:20:42 -0700 (PDT)
Received: from EUR03-AM5-obe.outbound.protection.outlook.com (mail-eopbgr30117.outbound.protection.outlook.com [40.107.3.117]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id 091103A08D1 for <tcpprague@ietf.org>; Wed, 10 Jun 2020 03:20:41 -0700 (PDT)
ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=kgafbjkgIGY4+leaHSPyq5OXK4vG5yajaGWgN6Y8RnUh1XR4HvKJNKrSxzqkCDYsXXLosiDsYSh3nhFYgeYjEsej78TDaEuZdDr0zsBXDB7wuDgnAgRmgCosCJqp8xv8rCC7hAdMkV8DMhairqSY958WXoU2lpKFvLnSrydXWSUNy3e6TaNHtqXE45sK9XXLMD147T57V26MasQeKbXx+zQbYKC537ECR16CLKJ+sBsepfT1a5l2DbM2a2HgpLb3c47UUxkORlNVKzoj0/Vx3V7D2VY98EkCBgtw11b36Y5WsRrFygFQY4WsdJrIJccIOXpoiJbqDKwZ3YmhHkjunQ==
ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com;  s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=ZvS0u2EVN+GeYC79NfmurhqsxZMdXvQpfTi4w7MxuFA=; b=T7H0eEHS6llS40TT4Usk3VoxToqqOhAS8xcVsTpK7O8BfkEPZoEl7q7imWQwn+LGanRO2oDxzphcXcgDclwui6Sniq4Gct2BiOoQmZ3URreBwFGYeeq92uXnsss8tjBR2po7XNmCqliyNl/tZyCKz7SglS7xPeQ7ripqgBZIVG6xXW00Yh3g4BgGgFSEUNWjgPqKxPMjYB5Okl30o3jm2XH78Mbb2UzquWDF92Y8C8FsBwOCkvCZXf5x61LdlQK41+XLulhCBMe67A8ysliaCi+Cl1q0NdVbp1RU/LCrJjsGSsSJpyEJZWhpuZkALHXxOA4busf1zAtqwrBHUXf/Ag==
ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=nokia-bell-labs.com; dmarc=pass action=none header.from=nokia-bell-labs.com; dkim=pass header.d=nokia-bell-labs.com; arc=none
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=nokia.onmicrosoft.com;  s=selector1-nokia-onmicrosoft-com; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=ZvS0u2EVN+GeYC79NfmurhqsxZMdXvQpfTi4w7MxuFA=; b=d4H0cb33BoBYiu/RTw4hIYC/V6hrOzO3mX7+6PnATcmIms5dbrRLjxXMXbvNvd7GzGmRtfoVTGkmCfSrYUQRSMUzHgGq7Slfg8lRb4M6BRwCkkvqswbsUW975GD7lyWKP28o1xScMjoFIwLPqYzFpPjdr4tnxVfzjnYJm4B7pbk=
Received: from AM0PR07MB4641.eurprd07.prod.outlook.com (2603:10a6:208:79::26) by AM0PR07MB4497.eurprd07.prod.outlook.com (2603:10a6:208:7a::20) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.3088.13; Wed, 10 Jun 2020 10:20:38 +0000
Received: from AM0PR07MB4641.eurprd07.prod.outlook.com ([fe80::8d0b:d9d6:884a:85e1]) by AM0PR07MB4641.eurprd07.prod.outlook.com ([fe80::8d0b:d9d6:884a:85e1%3]) with mapi id 15.20.3088.019; Wed, 10 Jun 2020 10:20:38 +0000
From: "Tilmans, Olivier (Nokia - BE/Antwerp)" <olivier.tilmans@nokia-bell-labs.com>
To: Ashutosh Srivastava <as12738@nyu.edu>, "tcpprague@ietf.org" <tcpprague@ietf.org>
Thread-Topic: [tcpPrague] TSO burst sizing causing TCP Prague unfairness on high capacity links ?
Thread-Index: AQHWNSUH83Z7Omx81kOVidBZY8jg36jRsmAw
Date: Wed, 10 Jun 2020 10:20:38 +0000
Message-ID: <AM0PR07MB46418F029644832BBC06D260E0830@AM0PR07MB4641.eurprd07.prod.outlook.com>
References: <CAJyCXab5M=hUaORAeQs5NO3W-rDYPe6r5j6Wyx6q=Bxz4GEzvA@mail.gmail.com>
In-Reply-To: <CAJyCXab5M=hUaORAeQs5NO3W-rDYPe6r5j6Wyx6q=Bxz4GEzvA@mail.gmail.com>
Accept-Language: en-US
Content-Language: en-US
X-MS-Has-Attach: 
X-MS-TNEF-Correlator: 
authentication-results: nyu.edu; dkim=none (message not signed) header.d=none;nyu.edu; dmarc=none action=none header.from=nokia-bell-labs.com;
x-originating-ip: [2a02:1811:3820:100:fd8e:d206:899:753d]
x-ms-publictraffictype: Email
x-ms-office365-filtering-ht: Tenant
x-ms-office365-filtering-correlation-id: c9123099-956a-4190-595c-08d80d27ebc6
x-ms-traffictypediagnostic: AM0PR07MB4497:
x-microsoft-antispam-prvs: <AM0PR07MB449756D41CDC7240120163B3E0830@AM0PR07MB4497.eurprd07.prod.outlook.com>
x-ms-oob-tlc-oobclassifiers: OLM:10000;
x-forefront-prvs: 0430FA5CB7
x-ms-exchange-senderadcheck: 1
x-microsoft-antispam: BCL:0;
x-microsoft-antispam-message-info: PwRA3WcKdl4bquvPEykT8bvnsvyczo3fDf3DEg/KVCfXRpU26530Ps2xGGa/YrfSrWSYfjCIvGznCxcbvZvqAMHxK+Z2tyQqZ7H09NU9AHYzBUmXOTF5pMDHGG0yMox3/XyYgRpyyZhdunV2KEk3p4VmHBdAOqND7JOusSJgjWjvOekQ7xZq0L76KnI2ovK77n6BcWt3w0af0RX/aUO314f35agf+JQTq2TCzz0o0IzkhLq5oIKBPIsWNTSE6Mz8HVfQlpSvnWZqq40pxtjjxEqO5jLFAHMil/Csbd4nfr3zpChfyPEyBpyDAlieBFFHpvfAyJBdnQGSucGj55kD0ww/OugvOcQucyMI06+9RyvDdHkBGJNqdXh/KW9NAfESf7p3sXTdO4q43DNK0DK7zg==
x-forefront-antispam-report: CIP:255.255.255.255; CTRY:; LANG:en; SCL:1; SRV:;  IPV:NLI; SFV:NSPM; H:AM0PR07MB4641.eurprd07.prod.outlook.com; PTR:; CAT:NONE;  SFTY:; SFS:(4636009)(366004)(396003)(346002)(376002)(39860400002)(136003)(52536014)(2906002)(71200400001)(6506007)(186003)(966005)(86362001)(76116006)(7696005)(5660300002)(66946007)(33656002)(478600001)(316002)(8676002)(83380400001)(55016002)(66556008)(9686003)(8936002)(66446008)(64756008)(66476007)(110136005); DIR:OUT; SFP:1102; 
x-ms-exchange-antispam-messagedata: cBboPkVjTjZja4G3MBTlau+9c7+cQBDertQBci/r+fs7+7uBYPHyRCgpjUUM7o060uYHXkiyj2a3hiF1QTiQ/c6Wwv8wHy/ISCEIT4CKJefJVE6wuBr+5SIGxbSAmOl1t7feHlXZhLr/EqKToAexCBfWihNEY+35d+FnbuXdU3grC8KQXi1qRDiJxCv4PkxM/nrMwPj2Rjw4EzG/biJRhs24uS1VA9qotsPqUPAUULrt3y0/YPVP3HYJqu645+bwBAFqqpqz2q7Gnb8hZcerVvDNLRzdKwewGSaSTqTr/9XUbgy5DzgJmtGU9AuXYtLRp22XwFRuk6Seg2GczfsT069IvYmDgSx/HgJLupNtsFmFxkx/mcq9jCiH+PbnyRnHU44Nq9ZGkLNEvjEwP5KHX7yMVH7fg7KRUIqexjTLCpoNbZWgSfCfc4b+tdWFTBWvIHr6v/gnXvEG/e9CeROIi9lKRPtJPybAGg8BQt3ghvtHY/66q8okRL3seJOwaarjW1wvJXkrBFawApSQnVcXl7JB8QSu92AyExUgte8Qn30=
x-ms-exchange-transport-forked: True
Content-Type: text/plain; charset="utf-8"
Content-Transfer-Encoding: base64
MIME-Version: 1.0
X-OriginatorOrg: nokia-bell-labs.com
X-MS-Exchange-CrossTenant-Network-Message-Id: c9123099-956a-4190-595c-08d80d27ebc6
X-MS-Exchange-CrossTenant-originalarrivaltime: 10 Jun 2020 10:20:38.2855 (UTC)
X-MS-Exchange-CrossTenant-fromentityheader: Hosted
X-MS-Exchange-CrossTenant-id: 5d471751-9675-428d-917b-70f44f9630b0
X-MS-Exchange-CrossTenant-mailboxtype: HOSTED
X-MS-Exchange-CrossTenant-userprincipalname: QYBPC338LFy6HGcQbGxPpq7wRYeMbHTJzXf+8gbR49kV0x8XRIiaLo6A8iZzDNPRNMlPtHM/LxlEVoJm86Oh5LhXWDt4baRV3CpR1BhL1VGB5BcF9xz9JWdo0uJNwn/K
X-MS-Exchange-Transport-CrossTenantHeadersStamped: AM0PR07MB4497
Archived-At: <https://mailarchive.ietf.org/arch/msg/tcpprague/OR-P5jJQdagFUrOZKhApnrAaH_c>
Subject: Re: [tcpPrague] TSO burst sizing causing TCP Prague unfairness on high capacity links ?
X-BeenThere: tcpprague@ietf.org
X-Mailman-Version: 2.1.29
Precedence: list
List-Id: "To coordinate implementation and standardisation of TCP Prague across platforms. TCP Prague will be an evolution of DCTCP designed to live alongside other TCP variants and derivatives." <tcpprague.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/tcpprague>, <mailto:tcpprague-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/tcpprague/>
List-Post: <mailto:tcpprague@ietf.org>
List-Help: <mailto:tcpprague-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/tcpprague>, <mailto:tcpprague-request@ietf.org?subject=subscribe>
X-List-Received-Date: Wed, 10 Jun 2020 10:20:44 -0000

SGkgQXNodXRvc2gsDQoNCiA+IFdlIG9ic2VydmVkIHVuZmFpcm5lc3MNCiA+IGJldHdlZW4gVENQ
IFByYWd1ZSBmbG93cyB3aGVuIHJ1bm5pbmcgb3ZlciBoaWdoIGNhcGFjaXR5IGxpbmtzICggbm90
IGp1c3QNCiA+IHdpcmVsZXNzIGJ1dCBpbiBnZW5lcmFsICkgYW5kIEkgd291bGQgbGlrZSB0byBz
aGFyZSBzb21lIG9mIG91ciBmaW5kaW5ncw0KID4gaGVyZS4NCg0KVGhhbmtzIGZvciBzaGFyaW5n
IHRoZXNlIQ0KDQogPiBBcyB5b3UgY2FuIG9ic2VydmUsIHRoZSBzZWNvbmQgZmxvdyBncmFicyBh
bG1vc3QgYWxsIHRoZSBhdmFpbGFibGUNCiA+IGJhbmR3aWR0aCBhbmQgdGhlIGZpcnN0IG9uZSBp
cyBzdGFydmVkLiANCg0KVGhhdCdzIGRlZmluaXRlbHkgbm90IHRoZSBleHBlY3RlZCBiZWhhdmlv
ciwgYXMgaXQgc2VlbXMgdGhlIGZpcnN0IHNlbmRlcg0Kc29tZWhvdyBtaXMtZGV0ZWN0IGEgZW5v
cm1vdXMgYW1vdW50IG9mIENFIG1hcmtzLCBtYWtpbmcgaXQgc3RheSBhdCBtaW4tY3duZC4NCg0K
SSBoYXZlIHVuZm9ydHVuYXRlbHkgbm90IGJlZW4gYWJsZSB0byByZXByb2R1Y2UgdGhpcyAobmVp
dGhlciBvbiBhIHZpcnR1YWwNCm5vciBhIHBoeXNpY2FsIDEwRyB0ZXN0YmVkKSwgc28gd291bGQg
bmVlZCBzb21lIGFkZGl0aW9uYWwgaGVscC9kZXRhaWxzIHRvDQpkaWFnbm9zZSB0aGlzLg0KDQog
PiBUaGlzIGV4cGVyaW1lbnQgd2FzIGRvbmUgdXNpbmcgY29tbWl0IG51bWJlciBlNzQxZjVhDQog
PiA8aHR0cHM6Ly9naXRodWIuY29tL0w0U1RlYW0vbGludXgvY29tbWl0L2U3NDFmNWFjNzU2NTAz
ZTI3YmU5YzE4M2RkMTA3ZWFkYmUNCiA+IGE0MGM1YyNkaWZmLTM4Y2U5MzMyNTU4M2YwMmQ3OTAy
NzZmNWNhZmQxYzQyPiAgb2YgdGhlIFRDUCBQcmFndWUgbGludXgNCiA+IGtlcm5lbCBpbXBsZW1l
bnRhdGlvbiAoIEFwciA4ICwgMjAyMCApLiBBZnRlciBzb21lIGludmVzdGlnYXRpb24sIHdlIGZv
dW5kDQogPiB0aGF0IHRoZXJlIG1pZ2h0IGJlIHNvbWV0aGluZyBicm9rZW4gd2l0aCB0aGUgVFNP
IGJ1cnN0IHNpemluZyB1cGRhdGVzDQogPiBkb25lcyBieSBUQ1AgUHJhZ3VlLiBJIGRpc2FibGVk
IHRoZSBUU08gYnVyc3Qgc2l6ZSB1cGRhdGVzIGFuZCByYW4gdGhlDQogPiBleHBlcmltZW50IHdp
dGggdGhlIGV4YWN0IHNhbWUgc2V0dGluZ3MgYW5kIGZvdW5kIHRoYXQgdGhlIGZhaXJuZXNzIC8N
CiA+IGNvbnZlcmdlbmNlIHRoaXMgdGltZSB3YXMgbXVjaCBiZXR0ZXIuICggU2VlIG5leHQgcGxv
dCApLg0KDQpDb3VsZCB5b3UgY29uZmlybSB0aGF0IHRoaXMgaXMgYWxzbyBoYXBwZW5pbmcgd2l0
aCB0aGUgdGlwIG9mIHRoZSBjdXJyZW50DQpCcmFuY2g/IEkuZS4sIDNiNjNjYzANCg0KID4gQWxz
bywgaWYgaW50ZXJlc3RlZCB5b3UgY2FuIGxvb2sgaW50byB0aGUgc3MgZGF0YSBwbG90cyAoIHNy
dHQgYW5kIGN3bmQgKQ0KID4gZm9yIHRoZXNlIHR3byBleHBlcmltZW50cyBhdCB0aGlzIGxpbmsg
Og0KID4gaHR0cHM6Ly9kcml2ZS5nb29nbGUuY29tL2RyaXZlL2ZvbGRlcnMvMXBMQzBkY01GMC1N
MWNndHc5SWhvRmlZT012RkotDQogPiBjYzc/dXNwPXNoYXJpbmcNCg0KSW4gYWRkaXRpb24gdG8g
dGhlc2UsIGNvdWxkIHlvdToNCi0gQ29uZmlybSB0aGF0IHRoaXMgaGFwcGVucyB3aXRoIGJvdGgg
dGhlIGludGVybmFsIFRDUCBwYWNpbmcgYW5kIHRoZSBmcQ0KcWRpc2MgYXMgcGFjZXIgb24gdGhl
IGRhdGEgc2VuZGVyDQotIENvbmZpcm0gdGhhdCB0aGlzIGhhcHBlbnMgYm90aCB3aXRoIGFuZCB3
aXRob3V0IGdyby9nc28vdHNvL2xybyBvbiB0aGUNCmVuZGhvc3RzIChkYXRhIHNlbmRlciBhbmQg
cmVjZWl2ZXIsIGFuZCBhbHNvIHRoZSBhcW0gbm9kZSBhcyBmcSBkb2VzIG5vdCBkbw0KZ3JvIHNw
bGl0dGluZyBwcmlvciB0byBlbnF1ZXVlKT8NCi0gQ29uZmlybSB0aGF0IHRoZSBwcm9ibGVtIHBl
cnNpc3RzIGlmIHlvdSBpbmNyZWFzZSB0aGUgYmFzZSBSVFQtLWEgc2ltcGxlDQpuZXRlbSBxZGlz
YyBvbiB0aGUgcmV2ZXJzZSBwYXRoIHRvIGFkZCAyLTVtcyBzaG91bGQgYmUgc3VmZmljaWVudCwg
ZG8gbm90DQpmb3JnZXQgdG8gZGlzYWJsZSBncm8vZ3NvIGFzIHRoYXQgcG9vcmx5IGludGVyYWN0
cyB3aXRoIG5ldGVtLg0KLSBMb2cgdGhlIHJlcG9ydGVkIENFIG1hcmtzIGJ5IHRoZSBBUU0sIGFz
IHdlbGwgYXMgdGhlDQpkZWxpdmVyZWRfY2UvcmVjZWl2ZWRfY2UgY291bnRlcnMgdGhyb3VnaG91
dCB0aGUgZXhwZXJpbWVudCBvbiB0aGUgZGF0YQ0Kc2VuZGVyL3JlY2VpdmVyPw0KDQpBbGwgb2Yg
dGhlc2Ugd291bGQgaGVscCB0byBwaW5wb2ludCB3aGljaCBjb21wb25lbnQgaXMgYXQgZmF1bHQu
DQoNCg0KVGhhbmtzIQ0KDQoNCkJlc3QsDQpPbGl2aWVyDQoNCg0KDQogPiANCiA+IFRoYW5rIHlv
dSwNCiA+IA0KID4gQXNodXRvc2ggU3JpdmFzdGF2YQ0KID4gRmlyc3QgeWVhciBQaEQgc3R1ZGVu
dA0KID4gRGVwYXJ0bWVudCBvZiBFbGVjdHJpY2FsIGFuZCBDb21wdXRlciBFbmdpbmVlcmluZw0K
ID4gTllVIFRhbmRvbiBTY2hvb2wgb2YgRW5naW5lZXJpbmcNCg==


From nobody Wed Jun 10 03:27:48 2020
Return-Path: <olivier.tilmans@nokia-bell-labs.com>
X-Original-To: tcpprague@ietfa.amsl.com
Delivered-To: tcpprague@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 4C0883A08DE for <tcpprague@ietfa.amsl.com>; Wed, 10 Jun 2020 03:27:47 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -1.902
X-Spam-Level: 
X-Spam-Status: No, score=-1.902 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIMWL_WL_HIGH=-0.001, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, RCVD_IN_MSPIKE_H2=-0.001, SPF_PASS=-0.001, URIBL_BLOCKED=0.001] autolearn=ham autolearn_force=no
Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (1024-bit key) header.d=nokia.onmicrosoft.com
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id Ufl20rqPQLUX for <tcpprague@ietfa.amsl.com>; Wed, 10 Jun 2020 03:27:45 -0700 (PDT)
Received: from EUR03-AM5-obe.outbound.protection.outlook.com (mail-eopbgr30104.outbound.protection.outlook.com [40.107.3.104]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id 866543A08DD for <tcpprague@ietf.org>; Wed, 10 Jun 2020 03:27:45 -0700 (PDT)
ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=nlMQvX41k9nmPaXSuYBBRtOys6YNF1u7HKc2a2Z5YEMlQ3APWGO94d2xk1PU804JplssklmCAlP0CgTrhII+QRgust+K+ybnVv7VJhvEefg2n4W2n9/fxfUanm0KTRZRPp5RF/xzlXS0eQJFI5n+Bd54ou67Z+vfUKeu+p9sXASUWqLkkm0SzBS18Akau5TBsjxKlmw15uFuDuEQ0uIGbo193zx+vXYXkOtmtz7OfvGWkb8R4L39EtFb/I552157PFPklfjUdWJGNbp1HiP0TQw3X4RbxH/QN1+pAQFh+SQJtQgay+6Ys8moNXZXCozYt5M4cGmlVXbN2bdxVyxbCw==
ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com;  s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=jHXnM8EeM2NDXz/9y7+S1CJBTHFo+YPhPqG8z865DmU=; b=lZi3/gYu24YteY5qYkhIzYpN2b4YNvQKa7e/woUBauMl21JjhLlmV0nyAMq2X+qUCRtMrXkQ6EkQ5XXJgiivsW8SMkb2d1R3HIYgaulyH80XQeuk7wN7dLxBsya1igJDuNSU9d+4PKRatNVw4NhZ4zn6OcpJ2NC7ddtoI7O+UaBb3HNRREeuj9Oa9w8pT0jt49ZCE0jk7t0O6Rm55tWiMkcKalU4RPb8EK6VhipBtLF416Lhnh46Ekik+QXNw7dmlrNXaPkZrVFj2VlKgNoYGHQKn1vT2N3LXPrHPDuNkMWhpQIqSHLVH9S879mMUwho3w0Z6hv/j+adQq5pCHM6yQ==
ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=nokia-bell-labs.com; dmarc=pass action=none header.from=nokia-bell-labs.com; dkim=pass header.d=nokia-bell-labs.com; arc=none
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=nokia.onmicrosoft.com;  s=selector1-nokia-onmicrosoft-com; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=jHXnM8EeM2NDXz/9y7+S1CJBTHFo+YPhPqG8z865DmU=; b=K2vLZt6+AaN0ACu7feV9sfQ3qJ7oaMa7QLcoyFmAlLwYaygzhBA17b39HsqCDQybUR8WYfAIXCLI8wEC2DuBs10xOh9ZJbK+mXI1XGo2PBZcgLw5/OWn9tQum1XOsbgKTx3X0CGbbdYqXb9asTWVSBoiVp4LmsxDXszKaj7Vsls=
Received: from AM0PR07MB4641.eurprd07.prod.outlook.com (2603:10a6:208:79::26) by AM0PR07MB4497.eurprd07.prod.outlook.com (2603:10a6:208:7a::20) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.3088.13; Wed, 10 Jun 2020 10:27:43 +0000
Received: from AM0PR07MB4641.eurprd07.prod.outlook.com ([fe80::8d0b:d9d6:884a:85e1]) by AM0PR07MB4641.eurprd07.prod.outlook.com ([fe80::8d0b:d9d6:884a:85e1%3]) with mapi id 15.20.3088.019; Wed, 10 Jun 2020 10:27:43 +0000
From: "Tilmans, Olivier (Nokia - BE/Antwerp)" <olivier.tilmans@nokia-bell-labs.com>
To: Ashutosh Srivastava <as12738@nyu.edu>, "tcpprague@ietf.org" <tcpprague@ietf.org>
Thread-Topic: [tcpPrague] TCP Prague under-utilising capacity when RTT scaling turned on
Thread-Index: AQHWNSUkO2PTw4jZfk6qjXs2GgQ/eqjRt38A
Date: Wed, 10 Jun 2020 10:27:42 +0000
Message-ID: <AM0PR07MB46414BF56843D476FCB4FA12E0830@AM0PR07MB4641.eurprd07.prod.outlook.com>
References: <CAJyCXaYXbMwrejcNTLv6bxSmf3L0hGekqF4Ddui8=yxba2b-iA@mail.gmail.com>
In-Reply-To: <CAJyCXaYXbMwrejcNTLv6bxSmf3L0hGekqF4Ddui8=yxba2b-iA@mail.gmail.com>
Accept-Language: en-US
Content-Language: en-US
X-MS-Has-Attach: 
X-MS-TNEF-Correlator: 
authentication-results: nyu.edu; dkim=none (message not signed) header.d=none;nyu.edu; dmarc=none action=none header.from=nokia-bell-labs.com;
x-originating-ip: [2a02:1811:3820:100:fd8e:d206:899:753d]
x-ms-publictraffictype: Email
x-ms-office365-filtering-ht: Tenant
x-ms-office365-filtering-correlation-id: 99e6f308-36f3-4905-5a6b-08d80d28e8f3
x-ms-traffictypediagnostic: AM0PR07MB4497:
x-microsoft-antispam-prvs: <AM0PR07MB4497C1CE95CA315A1DAB4CB6E0830@AM0PR07MB4497.eurprd07.prod.outlook.com>
x-ms-oob-tlc-oobclassifiers: OLM:10000;
x-forefront-prvs: 0430FA5CB7
x-ms-exchange-senderadcheck: 1
x-microsoft-antispam: BCL:0;
x-microsoft-antispam-message-info: siV7EIK5Acz7rI1RRofAjVnJl+cNde048W918969pZQxEY/BsdtQmZgvD4dBis4Zc4hEshWmkQYvM/g06XcKPH4I7ZvjA3ovJhROLIXDgdA+ucIvKRiEaplefsdoa44T3Rb+pzxkHx6481tG2riTsajk58sT0jtaHijlJM0KaxfN/T01lN3r39C3NIW++XAbO0P6zmIzkZ76ck0yswC9gFZj7nsP7RoyZ0gjMTUWJ7G36IC5xhzC06Vl+JOhdYH8Rq6Bz7d2ZFtTaLpdGyb9Z8NJvBYxk8tISj2rjYdZEh5mqNbg9kEnViHZQQRuF7A4FrRLopeVX+u6pSzLYL7DTw3i3bwakT7JSuBQgrB7EF8ELFd8Gmd/sdk+H2bbMl6R8hvz0wZWJqGUpYpImmWD7Q==
x-forefront-antispam-report: CIP:255.255.255.255; CTRY:; LANG:en; SCL:1; SRV:;  IPV:NLI; SFV:NSPM; H:AM0PR07MB4641.eurprd07.prod.outlook.com; PTR:; CAT:NONE;  SFTY:; SFS:(4636009)(136003)(39860400002)(376002)(396003)(346002)(366004)(8676002)(83380400001)(64756008)(66476007)(110136005)(8936002)(66446008)(66574014)(55016002)(9686003)(66556008)(86362001)(966005)(76116006)(186003)(52536014)(2906002)(6506007)(71200400001)(33656002)(478600001)(316002)(7696005)(5660300002)(66946007); DIR:OUT; SFP:1102; 
x-ms-exchange-antispam-messagedata: YwL99hHBNw0LZwtSIn/Ydq4Z0yGRhX9nmvgYy+ns02Zd4asKr7wSlbVUXW4LwGFj4K8fjPqahycsQYQnXxZHehw7lzLzye5q80a835L+50koXEl9ISR0QTO6q/F8dSCn2r7jqnvYqx/uJ73ytT5rcArYGV4xhhNBHfNaPG+l0jFZrSZMXQEwZltyLJoOUai7ouJjO9L6fNFkHdR/MywX7tH2liFg72bT3RMU+f7/juD6HMv0cP1WXQIOzu4f4CzMWHWOHqcWrffJlHzx3dqWPBE1S9HdeLmyJuKm992iYAY5Fr3NRdRg5+0gZTESAPWJTor8CJDWf+Mh/k8KQhzzshxtsVZfmttCUHbIyZ1aOlkZJuhmqNpwWCFLLsuy4qNQmoajcV1EDmh1U9bMJoBCkNk8UvLHF2KBWnK21/5hT2A1UVJsPHQqd0kZoi2/Rz73dU/RQgrzt9CVD6gjLRuYFjk2W7a11SEPpLG9xis6H/ppU3j3E9EQLMfmvRXPPeuRmVaB0ztWwM5i+gn3Wm2oB1nN2KKNa1iIFTVrlyW82jo=
x-ms-exchange-transport-forked: True
Content-Type: text/plain; charset="utf-8"
Content-Transfer-Encoding: base64
MIME-Version: 1.0
X-OriginatorOrg: nokia-bell-labs.com
X-MS-Exchange-CrossTenant-Network-Message-Id: 99e6f308-36f3-4905-5a6b-08d80d28e8f3
X-MS-Exchange-CrossTenant-originalarrivaltime: 10 Jun 2020 10:27:42.9371 (UTC)
X-MS-Exchange-CrossTenant-fromentityheader: Hosted
X-MS-Exchange-CrossTenant-id: 5d471751-9675-428d-917b-70f44f9630b0
X-MS-Exchange-CrossTenant-mailboxtype: HOSTED
X-MS-Exchange-CrossTenant-userprincipalname: aApS2p1F+sLD3YFCfEELe4pH4PDWx3dtFhNwxdUHOTc+5hsD/TLALvYS3rVYZofDrx6MdVv2hhFIN/BUKyh4xzSu32bZKeWpr+OI5ELr7XrLCUk9S4GUUuwUM2/5TsHU
X-MS-Exchange-Transport-CrossTenantHeadersStamped: AM0PR07MB4497
Archived-At: <https://mailarchive.ietf.org/arch/msg/tcpprague/v1vPL3wuc1MJ1pCxGtPCxHmH2JE>
Subject: Re: [tcpPrague] TCP Prague under-utilising capacity when RTT scaling turned on
X-BeenThere: tcpprague@ietf.org
X-Mailman-Version: 2.1.29
Precedence: list
List-Id: "To coordinate implementation and standardisation of TCP Prague across platforms. TCP Prague will be an evolution of DCTCP designed to live alongside other TCP variants and derivatives." <tcpprague.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/tcpprague>, <mailto:tcpprague-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/tcpprague/>
List-Post: <mailto:tcpprague@ietf.org>
List-Help: <mailto:tcpprague-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/tcpprague>, <mailto:tcpprague-request@ietf.org?subject=subscribe>
X-List-Received-Date: Wed, 10 Jun 2020 10:27:47 -0000

SGkgQXNodXRvc2gsDQoNCiA+IFRoaXMgaXMgYWJvdXQgYW4gaXNzdWUgSSBmb3VuZCB3aXRoIHRo
ZSByZWNlbnRseSBhZGRlZCBSVFQgc2NhbGluZyBmZWF0dXJlDQogPiBvZiBUQ1AgUHJhZ3VlIGxp
bnV4IGtlcm5lbCBpbXBsZW1lbnRhdGlvbi4gVGhpcyB3YXMgZmlyc3Qgb2JzZXJ2ZWQgd2l0aA0K
ID4gY29tbWl0IG51bWJlciA3ZjI2N2JkDQogPiA8aHR0cHM6Ly9naXRodWIuY29tL0w0U1RlYW0v
bGludXgvY29tbWl0LzdmMjY3YmQ1OTFjMjQ5Njk3ZjYzZjgxYjIxYTE3NTUyMDINCiA+IGU4NmNj
MiNkaWZmLTM4Y2U5MzMyNTU4M2YwMmQ3OTAyNzZmNWNhZmQxYzQyPiAgKCBNYXIgMTYsIDIwMjAg
KSB3aGVyZSBSVFQNCiA+IHNjYWxpbmcgd2FzIHR1cm5lZCBvbiBieSBkZWZhdWx0IGFuZCBhbHNv
IHdpdGggZnV0dXJlIGNvbW1pdHMgd2hlbiB3ZQ0KID4gZXhwbGljaXRseSBlbmFibGUgUlRUIHNj
YWxpbmcuDQogPiANCiA+IFRoZSBwbG90IGJlbG93IHNob3dzIHRoZSB0aHJvdWdocHV0IG9mIGEg
c2luZ2xlIFRDUCBQcmFndWUgZmxvdy4gQWx0aG91Z2gNCiA+IHRoZSBhdmFpbGFibGUgY2FwYWNp
dHkgd2FzIDFHYnBzLCBUQ1AgUHJhZ3VlIGlzIG5vdCBhYmxlIHRvIHJlYWNoIHRoYXQNCiA+IHBv
aW50IGFueXRpbWUgZHVyaW5nIHRoZSBleHBlcmltZW50Lg0KDQpUaGFua3MgYWdhaW4gZm9yIHRo
aXMgcmVwb3J0LiBUaGUgbW9zdCBpbmV4cGxpY2FibGUgYmVoYXZpb3IgaGVyZSBhcmUgdGhlDQph
cHBhcmVudCBjd25kIHJlZHVjdGlvbnMgdGhhdCBhcmUgaGFwcGVuaW5nIHdoaWxlIHRoZSBjb25u
ZWN0aW9uIGlzDQp1bmRlci11dGlsaXppbmcgdGhlIGxpbmsgKHNvIHNob3VsZCBub3QgYmUgcmVj
ZWl2aW5nIENFIG1hcmtzKS4NCg0KSSBhbSB1bmZvcnR1bmF0ZWx5IHVuYWJsZSB0byByZXByb2R1
Y2UgdGhpcyBiZWhhdmlvciBvbiBhIHBoeSBvciBlbXVsYXRlZA0KdGVzdGJlZCwgc28gd291bGQg
bmVlZCBhZGRpdGlvbmFsIGluZm9ybWF0aW9uIHRvIHdvcmsgdGhyb3VnaCB0aGlzIGlzc3VlLg0K
DQpDb3VsZCB5b3UgY29uZmlybSB0aGF0IHRoaXMgaXMgYWxzbyBoYXBwZW5pbmcgd2l0aCB0aGUg
dGlwIG9mIHRoZSBjdXJyZW50DQpCcmFuY2g/IEkuZS4sIDNiNjNjYzAgaXMgdGhlICJmdXR1cmUg
Y29tbWl0cyIgeW91IGFyZSByZWZlcnJpbmcgdG8gYWJvdmU/DQoNCkluIGFkZGl0aW9uIHRvIHRo
ZSBzcyBwbG90cywgY291bGQgeW91Og0KLSBDb25maXJtIHRoYXQgdGhpcyBoYXBwZW5zIHdpdGgg
Ym90aCB0aGUgaW50ZXJuYWwgVENQIHBhY2luZyBhbmQgdGhlIGZxDQpxZGlzYyBhcyBwYWNlciBv
biB0aGUgZGF0YSBzZW5kZXINCi0gQ29uZmlybSB0aGF0IHRoaXMgaGFwcGVucyBib3RoIHdpdGgg
YW5kIHdpdGhvdXQgZ3JvL2dzby90c28vbHJvIG9uIHRoZQ0KZW5kaG9zdHMgKGRhdGEgc2VuZGVy
IGFuZCByZWNlaXZlciwgYW5kIGFsc28gdGhlIGFxbSBub2RlIGFzIGZxIGRvZXMgbm90IGRvDQpn
cm8gc3BsaXR0aW5nIHByaW9yIHRvIGVucXVldWUpPw0KLSBDb25maXJtIHRoYXQgdGhlIHByb2Js
ZW0gcGVyc2lzdHMgaWYgeW91IGluY3JlYXNlIHRoZSBiYXNlIFJUVC0tYSBzaW1wbGUNCm5ldGVt
IHFkaXNjIG9uIHRoZSByZXZlcnNlIHBhdGggdG8gYWRkIDItNW1zIHNob3VsZCBiZSBzdWZmaWNp
ZW50LCBkbyBub3QNCmZvcmdldCB0byBkaXNhYmxlIGdyby9nc28gYXMgdGhhdCBwb29ybHkgaW50
ZXJhY3RzIHdpdGggbmV0ZW0uDQotIExvZyB0aGUgcmVwb3J0ZWQgQ0UgbWFya3MgYnkgdGhlIEFR
TSwgYXMgd2VsbCBhcyB0aGUNCmRlbGl2ZXJlZF9jZS9yZWNlaXZlZF9jZSBjb3VudGVycyB0aHJv
dWdob3V0IHRoZSBleHBlcmltZW50IG9uIHRoZSBkYXRhDQpzZW5kZXIvcmVjZWl2ZXI/DQotIExv
ZyBldmVudHVhbCBkcm9wcyAoZHJvcHBlZCBjb3VudGVyIG9uIEFRTSwgYW5kIHJldHJhbnNtaXNz
aW9uDQpjb3VudGVycyBvbiB0aGUgZGF0YSBzZW5kZXIpLg0KDQoNClRoYW5rcyENCg0KDQpCZXN0
LA0KT2xpdmllcg0KDQoNCiA+IA0KID4gVGhlIGV4cGVyaW1lbnQgc2V0dGluZ3Mgd2VyZSBhcyBm
b2xsb3dzDQogPiANCiA+ICoJVGhpcyBleHBlcmltZW50IHdhcyBkb25lIG9uIHRoZSBDbG91ZGxh
YiA8aHR0cHM6Ly93d3cuY2xvdWRsYWIudXMvPg0KID4gdGVzdGJlZCB3aXRoIGEgMy1ub2RlIHRv
cG9sb2d5ICggc291cmNlLCByb3V0ZXIsIHJlY2VpdmVyKS4NCiA+IA0KID4gKglUaGUgYm90dGxl
bmVjayBiZXR3ZWVuIHRoZSByb3V0ZXIgYW5kIHJlY2VpdmVyIHdhcyBhIDEgR2JwcyB3aXJlZA0K
ID4gbGluayAoIDEwIEdpZyBpbnRlcmZhY2VzICwgY2FwYWNpdHkgcmVzdHJpY3RlZCB0byAxR2Jw
cyB1c2luZyBsaW51eCB0cmFmZmljDQogPiBzaGFwaW5nIHRvb2xzICh0YykgKS4NCiA+IA0KID4g
KglUaGUgZmxvdyB3YXMgc2VudCB1c2luZyBpcGVyZjMuDQogPiANCiA+ICoJVGhlIEFRTSBhdCB0
aGUgcm91dGVyIHdhcyBhIEZRIHFkaXNjIHdpdGggYSBzaW5nbGUgYnVja2V0IGFuZCB3YXMNCiA+
IG1hcmtpbmcgcGFja2V0cyB3aXRoIEVDTiBhdCBhIG1hcmtpbmcgdGhyZXNob2xkIG9mIDUgbXMu
IFlvdSBjYW4gdXNlIHRoZQ0KID4gZm9sbG93aW5nIHBhcmFtZXRlcnMgd2l0aCB0aGUgdGMtZnEg
cWRpc2MgdG8gcmVwbGljYXRlIHRoaXMgc2V0dGluZyA6ICBmcQ0KID4gbGltaXQgNTAwMHAgZmxv
d19saW1pdCA1MDAwcCBvcnBoYW5fbWFzayAwIGNlX3RocmVzaG9sZCA1bXMNCiA+ICoJVGhlICJF
Q04gZmFsbGJhY2sgb24gZGV0ZWN0aW9uIG9mIGNsYXNzaWMgRUNOIEFRTSIgZmVhdHVyZSBvZiBU
Q1ANCiA+IFByYWd1ZSB3ZXJlIGRpc2FibGVkIGZvciB0aGlzIHNldCBvZiBleHBlcmltZW50cy4N
CiA+ICoJVGhlIHByb3BhZ2F0aW9uIC8gYmFzZSBkZWxheSBvZiB0aGUgc2V0dXAgd2FzIHZlcnkg
bG93ICggYXJvdW5kIDAuNA0KID4gbXMgKSBhbmQgbm8gZGVsYXkgd2FzIGFkZGVkIG9uIHRvcC4N
CiA+IA0KID4gSWYgaW50ZXJlc3RlZCwgeW91IGNhbiBsb29rIGF0IHRoZSBzcyBkYXRhIHBsb3Rz
IGZvciB0aGVzZSBleHBlcmltZW50cyBhdCA6DQogPiBodHRwczovL2RyaXZlLmdvb2dsZS5jb20v
ZHJpdmUvZm9sZGVycy8xTzZ1RW5neHJEWDVpcFk3MXNqcXIzNmxYQ1FCb1pWLS0NCiA+ID91c3A9
c2hhcmluZw0KID4gPGh0dHBzOi8vZHJpdmUuZ29vZ2xlLi5jb20vZHJpdmUvZm9sZGVycy8xTzZ1
RW5neHJEWDVpcFk3MXNqcXIzNmxYQ1FCb1pWLS0NCiA+ID91c3A9c2hhcmluZz4NCiA+IA0KID4g
TG9va2luZyBmb3J3YXJkIHRvIHlvdXIgY29tbWVudHMgYW5kIHF1ZXN0aW9ucyByZWdhcmRpbmcg
dGhlc2UgcmVzdWx0cy4NCiA+IA0KID4gVGhhbmsgeW91LA0KID4gDQogPiBBc2h1dG9zaCBTcml2
YXN0YXZhDQogPiBGaXJzdCB5ZWFyIFBoRCBzdHVkZW50LA0KID4gRGVwYXJ0bWVudCBvZiBFbGVj
dHJpY2FsIGFuZCBDb21wdXRlciBFbmdpbmVlcmluZw0KID4gTllVIFRhbmRvbiBTY2hvb2wgb2Yg
RW5naW5lZXJpbmcNCg==


From nobody Tue Jun 16 20:10:23 2020
Return-Path: <as12738@nyu.edu>
X-Original-To: tcpprague@ietfa.amsl.com
Delivered-To: tcpprague@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id 08D9B3A0DF0 for <tcpprague@ietfa.amsl.com>; Tue, 16 Jun 2020 20:10:23 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -2.099
X-Spam-Level: 
X-Spam-Status: No, score=-2.099 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, HTML_MESSAGE=0.001, RCVD_IN_MSPIKE_H2=-0.001, SPF_HELO_NONE=0.001, SPF_PASS=-0.001, URIBL_BLOCKED=0.001] autolearn=ham autolearn_force=no
Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (2048-bit key) header.d=nyu.edu header.b=lbcgM+oA; dkim=pass (2048-bit key) header.d=nyu-edu.20150623.gappssmtp.com header.b=jpc8BYxm
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id s16I-hTURaXk for <tcpprague@ietfa.amsl.com>; Tue, 16 Jun 2020 20:10:21 -0700 (PDT)
Received: from mx0b-00256a01.pphosted.com (mx0b-00256a01.pphosted.com [67.231.153.242]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id 4BEBE3A0D0F for <tcpprague@ietf.org>; Tue, 16 Jun 2020 20:10:21 -0700 (PDT)
Received: from pps.filterd (m0119691.ppops.net [127.0.0.1]) by mx0b-00256a01.pphosted.com (8.16.0.42/8.16.0.42) with SMTP id 05H3AK2l057498 for <tcpprague@ietf.org>; Tue, 16 Jun 2020 23:10:20 -0400
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=nyu.edu; h=mime-version : references : in-reply-to : from : date : message-id : subject : to : content-type; s=20180315; bh=H5rB0huhLu7F5RWFTl+/ju7UCTO9+5SIRxX/i5Hnoh4=; b=lbcgM+oACPXsmCcYqhpMuOv7WIlryAatGoLFLAOTylOD6dQYlUF+7IYmPotVLFev6LTv joccVVxh9vjrC2log5N8ia7vz7ITE/M7AGI2ze5Y1WFThZd+v9SMghLkvdMD4k2/9ziH amInoa75Kd4iurM2L0C0gyojY4AVm++YSzy3k8ICZ7N1JI9PUThr6IBIJ/6GmhTlG0Qn BBV4zVcFagEcZWgsgD1DuHLiScmhDOLVEFNEmqPCjPX/RcUbbFwz97uVX6ZkFJpCk/I/ MXU8OpaiS2PN6Mbl3kiti4e6CGwF0wnL+4gCfU3+WDhsngw2m6NHWdcxSyz0Y1bj7v0o Fw== 
Received: from mail-io1-f71.google.com (mail-io1-f71.google.com [209.85.166.71]) by mx0b-00256a01.pphosted.com with ESMTP id 31q64ju4vg-1 (version=TLSv1.2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128 verify=NOT) for <tcpprague@ietf.org>; Tue, 16 Jun 2020 23:10:20 -0400
Received: by mail-io1-f71.google.com with SMTP id b30so847657ioc.8 for <tcpprague@ietf.org>; Tue, 16 Jun 2020 20:10:19 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=nyu-edu.20150623.gappssmtp.com; s=20150623; h=mime-version:references:in-reply-to:from:date:message-id:subject:to; bh=H5rB0huhLu7F5RWFTl+/ju7UCTO9+5SIRxX/i5Hnoh4=; b=jpc8BYxmuBO8ipEW+95yTuCiIO8wxwnMmsFX9rUDhfS131Vfov5ob4uCYTj03B+8l4 ha4vRAML3ca4FfDbrR/wURn/yik0RpX3Uxe4p9P2oWxwdySCYo5Mt2YCt5aj/4o9ZHcy jYFAsHB/GJyJBH1Dzxu9lyX8YGAQAsDk8S+TQUAESYflqaNKbG+ADR0Q4NGjp47VOZ9P IBgZQ3WCv0xswCzWMGAgAI8n33N2wNqxIZmBJ7lzyj7QtmPyuxGWtZa17NIsvORWvmtC A0g+LzqHJfQ45jbF8H2SclZMkq/vMx645VtJYhXOENb2n73zA4/fVz8uci4hEzIltRxr Y9ug==
X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to; bh=H5rB0huhLu7F5RWFTl+/ju7UCTO9+5SIRxX/i5Hnoh4=; b=NXzitc0LhDJYVJgXShCj8xFgQx4EIke6xZ1YoKl5UunCCnpwpC8p6/HnrtGHZfomeG DoO7+DxTf6FAiCAIgJ0Hi04ZLsCAKAVsju+zTakMFjF55S/pKJdeG6Fp/migK/fbjdKc uTYY/eZYCeetGTqy7z+pzSOsJv5J7VtJoXKEws1cSGKAh4jnVgiEjmXebGIdvkIt08NK bFZQSDYjsi0xT33hMM3vsvcrIZPCohV1G/4Jnj8ZIpmt/9PXPM3lziMR79lt5t73+iub +jK37GTSO4U+sA5ZQ7s6HQLoQO8gf7IFYvu3CN/8vZSBeqQkNi7GPVhBT7oSewlgITf2 CfrQ==
X-Gm-Message-State: AOAM530DAdS7yoL2kGUn+ONG2qs8dZNUFdbrtFz7uWNPMdrnSpQIFEAk LFY0gwQh7IKCryH/fiLtRS0rIBmDatAjIl9/hDEkYRfliJDkbYgB7LWnw3LwZi3qAX3X4By4f6j qKbdXtJJ1mtD4jaBhtP1vWOuQtg==
X-Received: by 2002:a02:380d:: with SMTP id b13mr28770126jaa.107.1592363418843;  Tue, 16 Jun 2020 20:10:18 -0700 (PDT)
X-Google-Smtp-Source: ABdhPJxoOGrl8zc8Z79mgBiyNj1V7KUlAF9/8bcfhXkaO16jlrwnZQKLl8SbJKsHSgpqcK3b3+RgqIZQL+6GGgvtQZc=
X-Received: by 2002:a02:380d:: with SMTP id b13mr28770104jaa.107.1592363418393;  Tue, 16 Jun 2020 20:10:18 -0700 (PDT)
MIME-Version: 1.0
References: <CAJyCXaYXbMwrejcNTLv6bxSmf3L0hGekqF4Ddui8=yxba2b-iA@mail.gmail.com> <AM0PR07MB46414BF56843D476FCB4FA12E0830@AM0PR07MB4641.eurprd07.prod.outlook.com>
In-Reply-To: <AM0PR07MB46414BF56843D476FCB4FA12E0830@AM0PR07MB4641.eurprd07.prod.outlook.com>
From: Ashutosh Srivastava <as12738@nyu.edu>
Date: Tue, 16 Jun 2020 23:10:07 -0400
Message-ID: <CAJyCXabTZpi7zRw9erdUtJUpuSSs4Ho8MiSUNT_0u=Y_3yD9PQ@mail.gmail.com>
To: "Tilmans, Olivier (Nokia - BE/Antwerp)" <olivier.tilmans@nokia-bell-labs.com>,  tcpprague@ietf.org
Content-Type: multipart/alternative; boundary="000000000000e855ef05a83effd4"
X-Orig-IP: 209.85.166.71
X-Proofpoint-Spam-Details: rule=outbound_notspam policy=outbound score=0 phishscore=0 mlxlogscore=999 spamscore=0 suspectscore=0 mlxscore=0 adultscore=0 bulkscore=0 clxscore=1015 impostorscore=0 cotscore=-2147483648 malwarescore=0 priorityscore=1501 lowpriorityscore=0 classifier=spam adjust=0 reason=mlx scancount=1 engine=8.12.0-2004280000 definitions=main-2006170025
Archived-At: <https://mailarchive.ietf.org/arch/msg/tcpprague/qOs2Dgga3_fiemL12Ai_Vrx_p-A>
Subject: Re: [tcpPrague] TCP Prague under-utilising capacity when RTT scaling turned on
X-BeenThere: tcpprague@ietf.org
X-Mailman-Version: 2.1.29
Precedence: list
List-Id: "To coordinate implementation and standardisation of TCP Prague across platforms. TCP Prague will be an evolution of DCTCP designed to live alongside other TCP variants and derivatives." <tcpprague.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/tcpprague>, <mailto:tcpprague-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/tcpprague/>
List-Post: <mailto:tcpprague@ietf.org>
List-Help: <mailto:tcpprague-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/tcpprague>, <mailto:tcpprague-request@ietf.org?subject=subscribe>
X-List-Received-Date: Wed, 17 Jun 2020 03:10:23 -0000

--000000000000e855ef05a83effd4
Content-Type: text/plain; charset="UTF-8"

Hi Olivier,


>
> Could you confirm that this is also happening with the tip of the current
> Branch? I.e., 3b63cc0 is the "future commits" you are referring to above?
>

Yes, this is also happening with the tip of the current branch.

>
> In addition to the ss plots, could you:
> - Confirm that this happens with both the internal TCP pacing and the fq
> qdisc as pacer on the data sender
>

Yes, this happens with both internal TCP pacing and with the fq qdisc as
pacer at the sender.


> - Confirm that this happens both with and without gro/gso/tso/lro on the
> endhosts (data sender and receiver, and also the aqm node as fq does not do
> gro splitting prior to enqueue)?
>

There is still underutilisation after I turn off offloading (gro/gso/tso)
on all interfaces on all hosts but it does not look as bad as earlier.

- Confirm that the problem persists if you increase the base RTT--a simple
> netem qdisc on the reverse path to add 2-5ms should be sufficient, do not
> forget to disable gro/gso as that poorly interacts with netem.
>

At higher RTTs, there is some underutilisation at the beginning but TCP
Prague slowly reaches full bandwidth  and operates as expected thereafter.

- Log the reported CE marks by the AQM, as well as the
> delivered_ce/received_ce counters throughout the experiment on the data
> sender/receiver?
>

I do not observe any CE marks / delivered_ce packets as the link always
remains underutilised.

- Log eventual drops (dropped counter on AQM, and retransmission
> counters on the data sender).
>
>
I have uploaded additional data for experiments with commit 3b63cc0 on the
google drive I shared  earlier :
https://drive.google.com/drive/folders/1O6uEngxrDX5ipY71sjqr36lXCQBoZV--?usp=sharing

The columns of the AQM csv file are : timestamp, dropped packets, queue
backlog (bytes), queue backlog (packets)
Columns of the ss.csv file at the sender are : timestamp, ID, cwnd, SRTT
(ms), delivered, delivered_ce, pacing rate (Mbps)

I have also added the raw data files. The experiment settings were the same
as in my last mail.

Thank you,
Ashutosh.

--000000000000e855ef05a83effd4
Content-Type: text/html; charset="UTF-8"
Content-Transfer-Encoding: quoted-printable

<div dir=3D"ltr"><div class=3D"gmail_quote"><div><br></div><div>Hi Olivier,=
</div><div>=C2=A0</div><blockquote class=3D"gmail_quote" style=3D"margin:0p=
x 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex">
<br>
Could you confirm that this is also happening with the tip of the current<b=
r>
Branch? I.e., 3b63cc0 is the &quot;future commits&quot; you are referring t=
o above?<br></blockquote><div><br></div><div>Yes, this is also happening wi=
th the tip of the current branch.=C2=A0</div><blockquote class=3D"gmail_quo=
te" style=3D"margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204=
);padding-left:1ex">
<br>
In addition to the ss plots, could you:<br>
- Confirm that this happens with both the internal TCP pacing and the fq<br=
>
qdisc as pacer on the data sender<br></blockquote><div><br></div><div>Yes, =
this happens with both internal TCP pacing and with the fq qdisc as pacer a=
t the sender.</div><div>=C2=A0<br></div><blockquote class=3D"gmail_quote" s=
tyle=3D"margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);pad=
ding-left:1ex">
- Confirm that this happens both with and without gro/gso/tso/lro on the<br=
>
endhosts (data sender and receiver, and also the aqm node as fq does not do=
<br>
gro splitting prior to enqueue)?<br></blockquote><div><br></div><div>There =
is still underutilisation after I turn off offloading (gro/gso/tso) on all =
interfaces on all hosts but it does not look as bad as earlier.=C2=A0<br></=
div><div><br></div><blockquote class=3D"gmail_quote" style=3D"margin:0px 0p=
x 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex">
- Confirm that the problem persists if you increase the base RTT--a simple<=
br>
netem qdisc on the reverse path to add 2-5ms should be sufficient, do not<b=
r>
forget to disable gro/gso as that poorly interacts with netem.<br></blockqu=
ote><div><br></div><div>At higher RTTs, there is some underutilisation at t=
he beginning but TCP Prague slowly reaches full bandwidth=C2=A0 and operate=
s as expected thereafter.<br></div><div><br></div><blockquote class=3D"gmai=
l_quote" style=3D"margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,20=
4,204);padding-left:1ex">
- Log the reported CE marks by the AQM, as well as the<br>
delivered_ce/received_ce counters throughout the experiment on the data<br>
sender/receiver?<br></blockquote><div><br></div><div>I do not observe any C=
E marks / delivered_ce packets as the link always remains underutilised.=C2=
=A0</div><div><br></div><blockquote class=3D"gmail_quote" style=3D"margin:0=
px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex">
- Log eventual drops (dropped counter on AQM, and retransmission<br>
counters on the data sender).<br>
<br></blockquote><div><br></div><div>I have uploaded additional data for ex=
periments with commit 3b63cc0 on the google drive I shared=C2=A0 earlier :=
=C2=A0<a href=3D"https://drive.google.com/drive/folders/1O6uEngxrDX5ipY71sj=
qr36lXCQBoZV--?usp=3Dsharing">https://drive.google.com/drive/folders/1O6uEn=
gxrDX5ipY71sjqr36lXCQBoZV--?usp=3Dsharing</a></div><div><br></div><div>The =
columns of the AQM csv file are : <font face=3D"monospace">timestamp, dropp=
ed packets, queue backlog (bytes), queue backlog (packets)</font></div><div=
>Columns of the ss.csv file at the sender are : <font face=3D"monospace">ti=
mestamp, ID, cwnd, SRTT (ms), delivered, delivered_ce, pacing rate (Mbps)</=
font></div><div><br></div><div>I have also added the raw data files.=C2=A0T=
he experiment settings were the same as in my last mail.</div><div><br></di=
v><div>Thank you,</div><div>Ashutosh.</div></div></div>

--000000000000e855ef05a83effd4--


From nobody Tue Jun 16 20:24:29 2020
Return-Path: <as12738@nyu.edu>
X-Original-To: tcpprague@ietfa.amsl.com
Delivered-To: tcpprague@ietfa.amsl.com
Received: from localhost (localhost [127.0.0.1]) by ietfa.amsl.com (Postfix) with ESMTP id F0BDD3A0D94 for <tcpprague@ietfa.amsl.com>; Tue, 16 Jun 2020 20:24:27 -0700 (PDT)
X-Virus-Scanned: amavisd-new at amsl.com
X-Spam-Flag: NO
X-Spam-Score: -2.099
X-Spam-Level: 
X-Spam-Status: No, score=-2.099 tagged_above=-999 required=5 tests=[BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, HTML_MESSAGE=0.001, RCVD_IN_MSPIKE_H2=-0.001, SPF_HELO_NONE=0.001, SPF_PASS=-0.001, URIBL_BLOCKED=0.001] autolearn=ham autolearn_force=no
Authentication-Results: ietfa.amsl.com (amavisd-new); dkim=pass (2048-bit key) header.d=nyu.edu header.b=fgiI8rRP; dkim=pass (2048-bit key) header.d=nyu-edu.20150623.gappssmtp.com header.b=EcvB/QfS
Received: from mail.ietf.org ([4.31.198.44]) by localhost (ietfa.amsl.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id q8Wkb1HgIsD8 for <tcpprague@ietfa.amsl.com>; Tue, 16 Jun 2020 20:24:26 -0700 (PDT)
Received: from mx0b-00256a01.pphosted.com (mx0a-00256a01.pphosted.com [148.163.150.240]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by ietfa.amsl.com (Postfix) with ESMTPS id 3FDE63A0E05 for <tcpprague@ietf.org>; Tue, 16 Jun 2020 20:24:19 -0700 (PDT)
Received: from pps.filterd (m0094546.ppops.net [127.0.0.1]) by mx0b-00256a01.pphosted.com (8.16.0.42/8.16.0.42) with SMTP id 05H3OJJ7063002 for <tcpprague@ietf.org>; Tue, 16 Jun 2020 23:24:19 -0400
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=nyu.edu; h=mime-version : references : in-reply-to : from : date : message-id : subject : to : content-type; s=20180315; bh=n4wFB9UO/rnyXbwxdCAfpnoxz5Gu24F8YdBmVJaW5As=; b=fgiI8rRP3nbdMQ7YRGtoIkbNrDdACbOx1QHu6qehMP+6pLw4m1yqZHmPW0JY5UqcYbdW 0O8kgtGyXHXo9Z5XrF1C0sJwZ6sV7QU62pTeGbziBEGQnbbJdY3CX6rQK9+O9/1iXt8o TlErlif4OzR9ATnl27/LSmujTusLXnr15FZ5byhYJ4HU7vAIfj5Bm+GLS43C62/U7gMc kO1B0e3aeB4eyq2NrtIp7+6sqOC7XQ7oPAVPp414wr3m0Qr0pjDlNEMteD8b5pGLybiz PyaRZNpMmXVpziR4v61oGP3etg61pKBEHNvRc2v4fBXHHx8uEpBLvEbKDyWqR95PU94i 6Q== 
Received: from mail-io1-f72.google.com (mail-io1-f72.google.com [209.85.166.72]) by mx0b-00256a01.pphosted.com with ESMTP id 31q64kk81w-1 (version=TLSv1.2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128 verify=NOT) for <tcpprague@ietf.org>; Tue, 16 Jun 2020 23:24:18 -0400
Received: by mail-io1-f72.google.com with SMTP id l204so874816ioa.4 for <tcpprague@ietf.org>; Tue, 16 Jun 2020 20:24:18 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=nyu-edu.20150623.gappssmtp.com; s=20150623; h=mime-version:references:in-reply-to:from:date:message-id:subject:to; bh=n4wFB9UO/rnyXbwxdCAfpnoxz5Gu24F8YdBmVJaW5As=; b=EcvB/QfSJN5EFeZyH9CIi2Tm5nqWcH4Ln00woX4x/2VAVvYzkyXoRLiSaSdC4ca2wb WygQHPo3iTK8AiCjw7NyiHVQB2AkNQ21hTlM66vyW8lYfamO0nEvOoy0ooHI1Ghfy+cv jjnoRa2qxnL9/1gwp195gr33iOmDHdzdx8yaQasaLkkTxjAJbuI1pBFiIMOayo0SUR8+ loo1NQ+iUhdkJmme0vrzUDXXMq/sXfUWPfUe+Fyd5lx49MZh8q/XNmNTf6yceDo9Tdst GoOz7sMnKl1P7KyVLcwQ0zXpLfnLmVBeiXo5t0e2OtrDc+rI8NL3Xwzo+9Fthnjin1LD NwdA==
X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to; bh=n4wFB9UO/rnyXbwxdCAfpnoxz5Gu24F8YdBmVJaW5As=; b=bTKy/cZP8/z3wMLF0pOg7U8Bkam9VwisTyiwCzJmeYRwDbCEcTPfhNwM6kcVyYQiJQ SxDvXPg5KHhb2UJgmF6a9+Nuw0wlzH1fsts7rPrVFZJ3wB5OiqLK0DdGdoZKdEJY6NHq 8qJzGoAEncw2qosnFbIzK3V3A8ewNv9fpMS2+1KF4N78ijo5xe5jGEgYR4+dhPw4s2Jb VwbfsYmOKZ/R+2RELJkGPbse2LwOuRkumC60QkTFkwPZhbP9J3B++lyuSUkPAyuShsAC 8HIDXnyMZIwR6tMqaecQVpcuydulDfZ+hXx2bAuNjPpYutAzHmGzvRLaLFo0mKuGhIwg aA1Q==
X-Gm-Message-State: AOAM533JQYSw/z1fhjNzsj0TyMPHfpwpn5xPzEKjKSN6qMpRSjrWOhhp uZT9xOTsp7wKcBCZy3/klQt35Zhhzh6zkBCuwHqnf7+D5YFRbMHQNjuQRZWNNsxZHt9nfBGN6Fr 1cFnbGCYQ3JxzchtV5n6L32zruA==
X-Received: by 2002:a05:6e02:c62:: with SMTP id f2mr6524648ilj.43.1592364257895;  Tue, 16 Jun 2020 20:24:17 -0700 (PDT)
X-Google-Smtp-Source: ABdhPJwREUnsEh5knZIKtbUIUXlvSdYhMlus/cvFcpTFUNSyD8HorsEkLbtUek/9WngxgQKJxTDzT5bhg3lFZZDB+/4=
X-Received: by 2002:a05:6e02:c62:: with SMTP id f2mr6524632ilj.43.1592364257677;  Tue, 16 Jun 2020 20:24:17 -0700 (PDT)
MIME-Version: 1.0
References: <CAJyCXab5M=hUaORAeQs5NO3W-rDYPe6r5j6Wyx6q=Bxz4GEzvA@mail.gmail.com> <AM0PR07MB46418F029644832BBC06D260E0830@AM0PR07MB4641.eurprd07.prod.outlook.com>
In-Reply-To: <AM0PR07MB46418F029644832BBC06D260E0830@AM0PR07MB4641.eurprd07.prod.outlook.com>
From: Ashutosh Srivastava <as12738@nyu.edu>
Date: Tue, 16 Jun 2020 23:24:06 -0400
Message-ID: <CAJyCXaafO_uzoBBd0z6pWupqNeSsJMoUHgBVNhtev9Fg1Hh6cg@mail.gmail.com>
To: "Tilmans, Olivier (Nokia - BE/Antwerp)" <olivier.tilmans@nokia-bell-labs.com>,  tcpprague@ietf.org
Content-Type: multipart/alternative; boundary="000000000000eeabdb05a83f3177"
X-Orig-IP: 209.85.166.72
X-Proofpoint-Spam-Details: rule=outbound_notspam policy=outbound score=0 suspectscore=0 spamscore=0 clxscore=1015 phishscore=0 impostorscore=0 mlxlogscore=999 mlxscore=0 malwarescore=0 bulkscore=0 adultscore=0 lowpriorityscore=0 cotscore=-2147483648 priorityscore=1501 classifier=spam adjust=0 reason=mlx scancount=1 engine=8.12.0-2004280000 definitions=main-2006170026
Archived-At: <https://mailarchive.ietf.org/arch/msg/tcpprague/usJHTaVYtVu3feScH4XMC-CxMQc>
Subject: Re: [tcpPrague] TSO burst sizing causing TCP Prague unfairness on high capacity links ?
X-BeenThere: tcpprague@ietf.org
X-Mailman-Version: 2.1.29
Precedence: list
List-Id: "To coordinate implementation and standardisation of TCP Prague across platforms. TCP Prague will be an evolution of DCTCP designed to live alongside other TCP variants and derivatives." <tcpprague.ietf.org>
List-Unsubscribe: <https://www.ietf.org/mailman/options/tcpprague>, <mailto:tcpprague-request@ietf.org?subject=unsubscribe>
List-Archive: <https://mailarchive.ietf.org/arch/browse/tcpprague/>
List-Post: <mailto:tcpprague@ietf.org>
List-Help: <mailto:tcpprague-request@ietf.org?subject=help>
List-Subscribe: <https://www.ietf.org/mailman/listinfo/tcpprague>, <mailto:tcpprague-request@ietf.org?subject=subscribe>
X-List-Received-Date: Wed, 17 Jun 2020 03:24:28 -0000

--000000000000eeabdb05a83f3177
Content-Type: text/plain; charset="UTF-8"

Hi Olivier,

Please find comments inline.

Could you confirm that this is also happening with the tip of the current
> Branch? I.e., 3b63cc0
>

Yes, I observe these unfairness issues with the tip of the current branch (
3b63cc0). This happens both in the case of a flow entering after some gap
or with multiple flows starting together.

- Confirm that this happens with both the internal TCP pacing and the fq
> qdisc as pacer on the data sender
>
Yes , it happens with both  with internal TCP pacing and fq pacing.

- Confirm that this happens both with and without gro/gso/tso/lro on the
> endhosts (data sender and receiver, and also the aqm node as fq does not do
> gro splitting prior to enqueue)?
>

This *does not happen* when I turn off gro/gso/tso on all the nodes (end
hosts, AQM) in my experiment.

- Confirm that the problem persists if you increase the base RTT--a simple
> netem qdisc on the reverse path to add 2-5ms should be sufficient, do not
> forget to disable gro/gso as that poorly interacts with netem.
>

The problem persists even with some added delay.


> - Log the reported CE marks by the AQM, as well as the
> delivered_ce/received_ce counters throughout the experiment on the data
> sender/receiver?
>

I have uploaded  additional data for experiments with commit 3b63cc0 on the
google drive I shared earlier :
https://drive.google.com/drive/folders/1pLC0dcMF0-M1cgtw9IhoFiYOMvFJ-cc7?usp=sharing

The columns of the AQM csv file are : timestamp, dropped packets, queue
backlog (bytes), queue backlog (packets) , CE_marks
Columns of the ss data file at the sender are : timestamp, ID, cwnd, SRTT
(ms), delivered, delivered_ce, pacing rate (Mbps)

I have also added the raw data files. The experiment settings were the same
as in my last mail.

Thank you,
Ashutosh.

--000000000000eeabdb05a83f3177
Content-Type: text/html; charset="UTF-8"
Content-Transfer-Encoding: quoted-printable

<div dir=3D"ltr"><div class=3D"gmail_quote"><div>Hi Olivier,</div><div>=C2=
=A0</div><div>Please find comments inline.</div><div><br></div><blockquote =
class=3D"gmail_quote" style=3D"margin:0px 0px 0px 0.8ex;border-left:1px sol=
id rgb(204,204,204);padding-left:1ex">
Could you confirm that this is also happening with the tip of the current<b=
r>
Branch? I.e., 3b63cc0<br></blockquote><div><br></div><div>Yes, I observe th=
ese unfairness issues with the tip of the current branch ( 3b63cc0). This h=
appens both in the case of a flow entering=C2=A0after some gap or with mult=
iple flows starting together.</div><div><br></div><blockquote class=3D"gmai=
l_quote" style=3D"margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,20=
4,204);padding-left:1ex">
- Confirm that this happens with both the internal TCP pacing and the fq<br=
>
qdisc as pacer on the data sender<br></blockquote><div>Yes , it happens wit=
h both=C2=A0 with internal TCP pacing and fq pacing.</div><div><br></div><b=
lockquote class=3D"gmail_quote" style=3D"margin:0px 0px 0px 0.8ex;border-le=
ft:1px solid rgb(204,204,204);padding-left:1ex">
- Confirm that this happens both with and without gro/gso/tso/lro on the<br=
>
endhosts (data sender and receiver, and also the aqm node as fq does not do=
<br>
gro splitting prior to enqueue)?<br></blockquote><div><br></div><div>This <=
b>does not happen</b> when I turn off gro/gso/tso on all the nodes (end hos=
ts, AQM) in my experiment.=C2=A0</div><div><br></div><blockquote class=3D"g=
mail_quote" style=3D"margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204=
,204,204);padding-left:1ex">
- Confirm that the problem persists if you increase the base RTT--a simple<=
br>
netem qdisc on the reverse path to add 2-5ms should be sufficient, do not<b=
r>
forget to disable gro/gso as that poorly interacts with netem.<br></blockqu=
ote><div><br></div><div>The problem persists even with some added delay.</d=
iv><div>=C2=A0</div><blockquote class=3D"gmail_quote" style=3D"margin:0px 0=
px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex">
- Log the reported CE marks by the AQM, as well as the<br>
delivered_ce/received_ce counters throughout the experiment on the data<br>
sender/receiver?<br></blockquote><div><br></div><div>I have uploaded=C2=A0 =
additional data for experiments with commit 3b63cc0 on the google drive I s=
hared earlier :=C2=A0<a href=3D"https://drive.google.com/drive/folders/1pLC=
0dcMF0-M1cgtw9IhoFiYOMvFJ-cc7?usp=3Dsharing" target=3D"_blank">https://driv=
e.google.com/drive/folders/1pLC0dcMF0-M1cgtw9IhoFiYOMvFJ-cc7?usp=3Dsharing<=
/a></div><div><br></div><div>The columns of the AQM csv file are : timestam=
p, dropped packets, queue backlog (bytes), queue backlog (packets) , CE_mar=
ks=C2=A0=C2=A0</div><div>Columns=C2=A0of the ss data file at the sender are=
 : timestamp, ID, cwnd, SRTT (ms), delivered, delivered_ce, pacing rate (Mb=
ps)</div><div><br></div><div>I have also added the raw data files. The expe=
riment settings were the same as in my last mail.</div><div><br></div><div>=
Thank you,</div><div>Ashutosh.</div></div></div>

--000000000000eeabdb05a83f3177--

