Subject: [dtn-users] 1 Hour Data Flow Test Results - DTN2.8.0 Changeset 3550 plus BundleList patch

From: "Zoller, David A. (MSFC-EO60)[HOSC SERVICES CONTRACT]" <[email-masked]>
Date: Thu, 19 Jul 2012 16:37:58 -0500

Greetings all yet again,
I am providing some performance test results focused mainly on ingest to go along with the patches I recently uploaded.
This run is using the DTN2 code with the patches up to and including the BundleList patch (3) which basically provides a better ingest capability.
Best regards,
DZ

DTN2 - One Hour Data Flow with the Receiver (Node2) Brought Online After 30 Minutes

Test 1 - the latest code available on Sourceforge

*         DTN2 changeset 3550 plus patches up to and including the BundleList patch plus some statistics collection code.

*         OASYS changeset 2298 with all patches applied.

*         Data flow is 160 non-custody bundles per second for 60 minutes

*         576,000 UDP packets were transmitted (1316 byte payload)

*         313,745 packets were processed into bundles  (1316 byte payload)

*         262,255 packets were lost due to UDP socket buffer overflow

o   40MB socket buffer holds ~30k packets or ~187 seconds of data

Timeline Highlights
Seconds after Node1 started

21

Data flow started at 160 packets/sec

21 - 1845

Successfully received 292,322 bundles at 160 bundles/sec

1845

Node1 establishes connection to Node2 - very lucky timing on the retry link! - ingest processing stops - reroute_all_bundles entered

1858

reroute_all_bundles finished

1858

Node2 makes contact (link-0 created) - reroute_all_bundles entered

1866

6,419 bundles transmitted to Node2 (& BundleTransmit events posted but not processed) in 10 second period

1871

reroute_all_bundles finished - and re-entered yet again

1890

reroute_all_bundles finished

3621

Data flow terminated

1846 - 4188

all 292,322 bundles received so far transmitted to Node 2 (all but ~7000 after the reroute_all_bundles)

4188 - 4239

a blip of 6,643 BundleTransmit events processed and BUndleFree events posted

4239 - 6361

Processing crawls for 35+ minutes - only 7 BundleTransmit events processed each 10 seconds

6361 - 6441

284,188 BundleTransmit events processed and BundleFree events posted in 80 seconds

6441 - 6491

282,902 BundleFree events processed in 50 seconds

6491 - 6541

21,422 bundles received in 50 seconds (avg 428 bundles/sec) while processing packets from the full UDP socket buffer

6541

13,084 bundles transmitted to Node2 and Xmt events processed

6541 - 6732

Processing crawls for 3+ minutes - only 309 BundleTransmit events processed each 10 seconds

6742

6,027 BundleTransmit events processed in 10 seconds

6743

Processing complete in 1 hour 32 minutes

* This was a great run I believe because Node1 happened to connect to Node2 first

* I killed one run after 7.5 hours - it was stuck in the first crawl for 6.5 hours by then

Notice when the BundleTransmit events were posted (BunXmtPost) vs. when they were processed (BunXmtPro) and also notice the event queue size growing massively.

David Zoller
COLSA Corporation
Marshall Space Flight Center