A formal test was carried out for Alberta TraceTogether v2.0 just prior to release. With the agreement of Alberta Health the Herald project are publishing the results here.
The test consisted of ten phones. One phone (iPhone7+) failed during the test and has been discounted from the results. The likelihood is that the true results are, therefore, better than quoted here.
It should be noted that the results on this page are tuned for mobile phone use in Canada whereas all other standard Herald tests are for the UK.
|Traceable Interaction Fraction||83.77%||Used as input to OpenABM simulation|
(Canada MAX 55.20%)
|Probability of detection||87.95%||Formal RISK detection|
|Phone Detection||100%||Includes iOS in the background|
|Completeness RT2||TBD||Not yet calculated from data|
|Longevity||100%||8 hour test|
|Have BLE Phones||83.75%||Statista|
|PhoneId||Phone Make and Model||OS and version||Known issues|
|1||Pixel 3XL||Android 19|
|2||Samsung A10 (SM-A105FN)||Android 28||A10s knowingly rotate their BLE MAC address with every request. Herald uses an ephemeral ID that rotates every 15 minutes as a performance improvement.|
|3||Samsung A40 (SM-A405FN)||Android 29||Same issue as A10 above|
|4||Samsung A70 (SM-A705FN)||Android 29|
|5||Samsung S10-lite (SM-G770F)||Android 29|
|6||iPhone 6||iOS 12.4.2|
|7||iPhone 7||iOS 13.6||Phone’s name is Adam’s work iPhone|
|8||iPhone SE 1st gen||iOS 13.6|
|9||iPhone X||iOS 13.7|
|Phones||Max Pairs||Pairs Detected||Detection Percent||Max 30 second windows||30 second windows achieved||Missed windows percentage||Longevity change over 8 hours|
The below shows the effect on COVID-19 spread of 100% adoption of the application under test, and 80% conformance to self-isolation advice. Note: The simulation still shows a control effect on COVID-19 spread with lower app uptake.
Initial seed data:-
The below 9 charts show discoveries, ID (data payload) reads, and RSSI (distance estimation) readings as individual dots.
The below charts show RSSI variation over time. In a formal test these will mostly be static.