Beftigre Documentation

  1. Home
  2. Documentation
Current version 1.0. Release date: 2016-12-03

Results :: Please refer to our journal publication for the explanation of the results.

Bandwidth and Latency - Linpack

Cloud CPU and Memory Availability - Linpack

Mobile CPU and Memory availability - Linpack

Beftigre API Performance

Non-BDD Evaluation and Comparison (based on mean values of samples)

Architecture Scenarios Scheme1 (3G, WLAN, Outlier) Scheme2 (3G, WLAN, Outlier)
Elapsed Time (ms) Used Energy (mJ) Elapsed Time (ms) Used Energy (mJ)
Linpack
Local 21952.50 3168.23 21952.50 3168.23
Server 21948.67 2539.87 21948.67 2539.87
Schemes: 21953.33 2206.08 21945.33 3102.39
Local % diff. -0.0038 35.8055 0.0327 2.1
Server % diff. -0.0212 14.0663 0.0152 -19.9395
MatCalc
Local 6313.22 492.48 6313.22 492.48
Server 8340.03 711.17 8340.03 711.17
Schemes: 6403.33 517.07 7009.98 583.10
Local % diff. -1.42 -4.87 -10.46 -16.85
Server % diff. 26.27 31.61 17.33 19.79
NQueen
Local 17123.02 2702.13 17123.02 2702.13
Server 16980.88 2009.89 16980.88 2009.89
Schemes: 15707.00 2609.05 15689.52 1898.99
Local % diff. 8.63 3.51 8.74 34.91
Server % diff. 7.79 25.94 7.91 5.67
Note: Local % diff. and Server % diff. is the percentage difference of the scheme in comparison to Local and Server scenarios respectively. A negative value is used to signify a loss in energy savings or performance.

Replication capability of Beftigre Evaluation (verified using Outlier parameters)

@Given: mobile @When: cloud/network
CPU    Memory CPU    Memory Bandwidth Latency
Linpack
Scheme1 Mean 92.54 18.50 41.30 67.30 560.12 243.03
Scheme1 Deviation 1.13 0.84 0.65 1.30 11.25 5.43
Scheme1 5% range 4.63 0.93 2.03 3.37 28.01 12.15
Scheme2 Mean 84.25 42.01 41.50 63.40 558.31 247.80
Scheme2 Deviation 1.25 1.03 0.55 1.44 9.96 4.04
Scheme2 5% range 4.21 2.10 2.08 3.17 27.92 12.39
MatCalc
Scheme1 Mean 92.91 23.20 38.06 56.85 506.45 217.00
Scheme1 Deviation 1.21 0.77 0.71 0.82 5.00 2.01
Scheme1 5% range 4.65 1.16 1.90 2.84 25.32 10.85
Scheme2 Mean 91.44 22.31 38.42 56.10 517.66 220.60
Scheme2 Deviation 2.22 0.90 0.74 1.31 4.02 6.03
Scheme2 5% range 4.57 1.12 1.92 2.81 25.88 11.03
NQueen
Scheme1 Mean 84.60 24.84 43.44 68.70 550.98 245.31
Scheme1 Deviation 1.01 1.09 0.58 2.77 9.03 3.93
Scheme1 5% range 4.23 1.24 2.17 3.44 27.55 12.27
Scheme2 Mean 86.08 25.06 42.02 65.22 548.40 249.16
Scheme2 Deviation 2.30 1.02 0.99 2.40 7.72 3.20
Scheme2 5% range 4.30 1.25 2.10 3.26 27.42 12.91

Beftigre Evaluation and Comparison/Assertion (between Scheme1 vs. Scheme2) showing Full-tier Results (i.e. Then clauses) - Outlier simulation parameters used.

Label @Given:
mobile		 @When:
cloud/network		 @Then:
mobile		 @Then:
cloud		 Final
Assert
CPU    Memory CPU    Memory Bandwidth Latency Time Energy CPU    Memory
Linpack Evaluation
Scheme1 93 18 41 67 560 243 22208 3008 58 28 -
Scheme2 81 41 41 62 557 247 21887 3181.08 60 32 -
Linpack Compare: Scheme2 expected on Scheme1 actual
Expected 81 41 41 62 557 247 21887 3181.08 60 32 -
Actual 92 17 41 68 559 241 22304 3029.44 58 29 -
Assert - - - - - - 1.91% more 4.77% less 3.33% less 9.38% less Different
Linpack Compare: Scheme1 expected on Scheme1 actual
Expected 93 18 41 67 560 243 22208 3008 58 28 -
Actual 92 16 41 68 563 240 22233 3031 58 29 -
Assert - - - - - - 0.11% more 0.76% more 0% 3.57% more Similar system
MatCalc Evaluation
Scheme1 90 23 38 56 505 211 7033 613.41 55 26 -
Scheme2 92 22 38 56 512 224 6442 537.07 55 26 -
MatCalc Compare: Scheme2 expected on Scheme1 actual
Expected 92 22 38 56 512 224 6442 537.07 55 26 -
Actual 94 21 38 58 507 209 7075 625.12 55 26 -
Assert - - - - - - 9.37% more 15.15% more 0% 0% Different
MatCalc Compare: Scheme1 expected on Scheme1 actual
Expected 90 23 38 56 505 211 7033 613.41 55 26 -
Actual 91 22 38 56 501 217 7085 609.91 55 24 -
Assert - - - - - - 0.75 more 0.57% less 0% 0% Similar system
NQueen Evaluation
Scheme1 84 25 43 67 552 246 16344 2810.11 59 29 -
Scheme2 89 25 42 65 540 244 15702 1908.09 59 30 -
NQueen Compare: Scheme2 expected on Scheme1 actual
Expected 89 25 42 65 540 244 15702 1908.09 59 30 -
Actual 85 25 42 68 553 241 16289 2797.42 59 30 -
Assert - - - - - - 3.67% more 37.80% more 0% 0% Different
NQueen Compare: Scheme1 expected on Scheme1 actual
Expected 84 25 43 67 552 246 16344 2810.11 59 29 -
Actual 85 25 43 68 553 243 16302 2785.90 59 30 -
Assert - - - - - - 0.26% less 0.87% less 0% 3.39% more Similar system
Key: Given: mobile CPU and memory availability (%), When: cloud CPU and memory availability (%), bandwidth (bps) and latency (ms), Then: mobile elapsed time (ms), mobile used energy (mJ), cloud used CPU (%) and cloud used memory (%).