- Reproducible bug reports are located in the
reportsfolder. - Reproduction metadata is located in the
metadatafolder and encoded in JSON files. - The relevant APKs are in the
apksfolder. - The reproduction scripts are located in the
scriptsfolder here and the instructions for running the scripts are also located in thescriptsfolder here. - The code utilized for data collection can be found in the
codefolder. - A ZIP file of JSON containing the 82,455 issues can be found in
database.
- ID = identifier of the bug report in this dataset
- GitHub Issue = link to the bug report on GitHub
- Commit ID = commit ID identifying the app version used to reproduce the bug report
- Android OS Version = Android version used to reproduce the bug report
- Failure Type = type of failure associated with the bug report. crash identifies a crash in the app, output represents an error in the output of the app, gui identifies an error in the properties of the GUI of the app
- S2Rs = number of textual S2Rs in the bug report
- GUI Actions = number of GUI actions necessary to reproduce the failure described in the bug report
- Setup GUI Actions = setup GUI actions (SGAs). Number of GUI actions that need to be performed before the first GUI action mentioned in the S2Rs can be performed
- RS GUI actions = report-specific GUI actions (RSGAs). Number of GUI actions that are necessary to reproduce the bug reports starting from the first the GUI action associated with the first S2R
- RS Missing GUI Actions = report-specific and missing GUI actions. Number of GUI actions that are not mentioned by the S2Rs but are necessary to reproduce the failure described in the bug report
- Multiple GUI Action S2Rs = multiple-GUI-action S2Rs (MGAS2Rs). S2Rs that lead to execution of multiple GUI actions.
- GUI Actions in MGAS2Rs = number of GUI actions in multiple-GUI-action S2Rs.
- SGAs in Android OS = Whether a setup GUI action has been involved that requires the Android OS
- SGAs Outside App = Whether a setup GUI action has been performed outside of the app and not in Android OS
- RSGAs in the Android OS = Whether a report-specific GUI action has been involved that requires the Android OS
- RSGAs Outside App = Whether a report-specific GUI action has been performed outside of the app and not in Android OS
| ID | Github Issue | Commit ID | Android OS Version | Failure Type | S2Rs | GUI Actions | Setup GUI Actions | RS GUI Actions | RS Missing GUI Actions | Multiple GUI Action S2Rs | GUI Actions in MGAS2Rs | SGAs in Android OS | SGAs Outside App | RSGAs in Android OS | RSGAs Outside App |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| 2 | Link | d365188d7c7b9d9eb0021e73e0c6dc37aba79a3f | 6.1 | crash | 6 | 6 | 0 | 6 | 0 | 0 | 0 | 1 | 0 | 0 | 0 |
| 7 | Link | 2adbfce4039a6501bf2512a765ced223c53da315 | 8.1 | crash | 2 | 5 | 0 | 5 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| 8 | Link | 7ef227ada3454529c7def79e41f48f6fa7b7463c | 6 | crash | 3 | 11 | 6 | 5 | 0 | 1 | 4 | 0 | 0 | 0 | 0 |
| 10 | Link | 003408bb61478c32f3119f7cb5e301db44caa199 | 6 | output | 5 | 10 | 1 | 9 | 3 | 2 | 2 | 0 | 0 | 0 | 0 |
| 11 | Link | d3ab226c2d0e67b597a4d2cde1d652ceff6c1f52 | 6.1 | crash | 4 | 2 | 0 | 2 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| 18 | Link | 6f0dcf6070cd132eba51824ebbfa743eb22b0568 | 8 | crash | 2 | 19 | 15 | 4 | 0 | 1 | 3 | 0 | 0 | 0 | 0 |
| 19 | Link | 8a2cb5df10f4aea90c79a2d111c989ae1830544a | 7.1.1 | gui | 3 | 5 | 1 | 4 | 0 | 1 | 2 | 1 | 0 | 0 | 0 |
| 21 | Link | 394ccfc0c04223a263411e8af4487458e848d319 | 8.0.0 | gui | 3 | 8 | 1 | 7 | 0 | 1 | 5 | 0 | 0 | 0 | 0 |
| 22 | Link | 394ccfc0c04223a263411e8af4487458e848d319 | 7.1.1 | gui | 3 | 11 | 7 | 4 | 0 | 1 | 2 | 0 | 0 | 0 | 0 |
| 23 | Link | de7d145b82ae5e06991ba1b9a598d8ec6647f1f9 | 7 | crash | 4 | 4 | 3 | 1 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| 35 | Link | e1c5681e628efd895d6f513047d94b618c00a144 | 8 | output | 4 | 21 | 12 | 9 | 0 | 2 | 7 | 1 | 0 | 0 | 0 |
| 43 | Link | 5cc16b32eb5e65e6f8381d7ca097a3a8aabea57e | 7.1.2 | crash | 2 | 31 | 28 | 3 | 1 | 1 | 0 | 1 | 0 | 0 | 0 |
| 44 | Link | 8d09f7ab504d520f9c456c2a12a5aa0067be0d90 | 9.0.0 | output | 3 | 18 | 7 | 11 | 5 | 2 | 5 | 0 | 0 | 0 | 0 |
| 45 | Link | 68d074acc7e3e8acda7709b88f007820e81923cd | 8.1.0 | output | 7 | 27 | 15 | 12 | 1 | 0 | 0 | 1 | 1 | 0 | 0 |
| 50 | Link | d61672a19c538250f305352d35dace108c3594cd | 9 | crash | 1 | 1 | 0 | 1 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| 51 | Link | 2542c42b677b77620d170bb89bc68da767b4d65e | 7 | output | 3 | 10 | 4 | 6 | 1 | 2 | 4 | 1 | 0 | 1 | 0 |
| 53 | Link | 73c73f21ffecbdec2d35bae8e0472980572af8e5 | 3 | output | 6 | 15 | 7 | 8 | 3 | 1 | 3 | 1 | 0 | 1 | 0 |
| 54 | Link | 1a5478a490eb569551f4e30f2d668e28a9f95559 | 8 | output | 6 | 10 | 4 | 6 | 1 | 1 | 2 | 1 | 0 | 1 | 0 |
| 55 | Link | 395e94bf62312dfd3df66fdbad75412aacf733a2 | 10 | gui | 3 | 26 | 6 | 20 | 0 | 3 | 20 | 1 | 0 | 0 | 0 |
| 56 | Link | 68912f28ed6408d65198fecbb80e16e75d1c3532 | 10 | output | 4 | 18 | 6 | 12 | 0 | 3 | 12 | 1 | 0 | 0 | 0 |
| 62 | Link | e5ec9ddbf335cffb226f4d82fac4f48b6c756667 | 8 | output | 5 | 16 | 2 | 14 | 4 | 4 | 10 | 1 | 0 | 1 | 0 |
| 71 | Link | 3102b83a3c6208f7ba36a235d71254f1c8c8a9ff | 10 | gui | 5 | 6 | 1 | 5 | 0 | 0 | 0 | 0 | 1 | 1 | 0 |
| 73 | Link | d26d2126072654ba95f31f2bb638479bc2f199c4 | 8 | gui | 3 | 9 | 6 | 3 | 0 | 1 | 2 | 0 | 0 | 0 | 0 |
| 76 | Link | bea5ce3bce36cccf5a34d833ac6d8fc2e237984d | Fire OS 5.2.6.9 | gui | 3 | 6 | 6 | 0 | 6 | 0 | 0 | 0 | 0 | 0 | 0 |
| 84 | Link | 95496eb1200e892600b60d5048248e893b339af3 | 4.4.4 API 19 | output | 8 | 8 | 0 | 8 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| 91 | Link | b5433c0e9a7e86f234915d409abe2d46c62363bb | 7 | output | 2 | 3 | 1 | 2 | 1 | 0 | 0 | 1 | 0 | 0 | 0 |
| 92 | Link | cffde47fb60e1f030e0ba1665813af91ca057976 | 6.0.1 | output | 4 | 5 | 1 | 4 | 1 | 1 | 1 | 0 | 0 | 0 | 0 |
| 96 | Link | 3715e4fed61d0f5d28ff9fc91919f3381c98e551 | 10 | output | 4 | 13 | 10 | 3 | 0 | 1 | 2 | 0 | 0 | 0 | 0 |
| 97 | Link | 4ef81ae0d68bd3f062f4c763f9653300bc3ef2f1 | 6.0.1 | crash | 7 | 10 | 6 | 4 | 0 | 2 | 4 | 0 | 0 | 0 | 0 |
| 101 | Link | 4ef81ae0d68bd3f062f4c763f9653300bc3ef2f1 | 6.0.1 | gui | 4 | 8 | 6 | 2 | 0 | 0 | 0 | 0 | 0 | 1 | 0 |
| 106 | Link | b18e0559b9fdd8eabd8504eaa4927708e7b80216 | 8 | output | 2 | 5 | 2 | 3 | 1 | 1 | 2 | 1 | 0 | 0 | 0 |
| 107 | Link | deac585a029850463ea92a5c5291c5f45d0b6518 | 9 | gui | 3 | 6 | 2 | 4 | 0 | 1 | 4 | 1 | 0 | 0 | 0 |
| 110 | Link | 9971a70093f6b0c2c325ae5afda91c30fe96e54f | 11 | gui | 3 | 4 | 2 | 2 | 0 | 1 | 2 | 1 | 1 | 0 | 0 |
| 117 | Link | fb45dce67c0756eb710a776ea940e243e21b94e6 | 8.1 | gui | 2 | 10 | 4 | 6 | 0 | 1 | 5 | 0 | 0 | 0 | 0 |
| 121 | Link | ec7a257fba6e0ba29a793eeaebb1179aaf4f343f | 9 | gui | 12 | 15 | 6 | 9 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| 122 | Link | bf39d2825b5ff831ee515570e06bfd1afc95d13d | 8 | gui | 3 | 16 | 8 | 8 | 5 | 3 | 8 | 0 | 0 | 0 | 0 |
| 123 | Link | bf39d2825b5ff831ee515570e06bfd1afc95d13d | 9 | output | 2 | 20 | 8 | 12 | 6 | 1 | 4 | 0 | 0 | 1 | 0 |
| 125 | Link | 118fd15d4ca830ce1953f079cc20b25020856546 | 8 | gui | 4 | 16 | 8 | 8 | 5 | 2 | 7 | 0 | 0 | 0 | 0 |
| 128 | Link | 30b0b5747e728b9515ac36ca9c471c824854aaf1 | 6 | output | 2 | 14 | 10 | 4 | 4 | 0 | 0 | 0 | 0 | 0 | 0 |
| 129 | Link | b8b9834f06cf28686be5874923607f677b094df6 | 9 | crash | 3 | 19 | 9 | 10 | 0 | 2 | 9 | 0 | 0 | 0 | 0 |
| 130 | Link | 7c34318c407c4677d3afdf27bdeb998244759720 | 8 | gui | 2 | 2 | 2 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| 132 | Link | d7b956e5ac8d4ea3b590a929a8176975afd86422 | 7 | output | 4 | 22 | 15 | 7 | 1 | 1 | 4 | 1 | 1 | 0 | 1 |
| 135 | Link | 83d1d1ee402dbd680192691a777aa3e4b10e5c55 | 8.1.0 | output | 4 | 12 | 8 | 4 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| 137 | Link | 9709dfaeee4cd9e2d6a51a2d44de67682b3811d6 | 8 | crash | 4 | 4 | 0 | 4 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| 139 | Link | e8f99a323b82a0323eb3ffcff8907429797522ab | 5 | gui | 2 | 5 | 0 | 5 | 0 | 2 | 4 | 0 | 0 | 0 | 0 |
| 142 | Link | 4e4a72cafdba463b571610a0ccd401153594dd71 | 6.0.1 | output | 3 | 10 | 4 | 6 | 0 | 2 | 5 | 0 | 0 | 0 | 0 |
| 144 | Link | 71deb2dfd033d940aa7d91794322618ba39abf4d | sdk v27 | gui | 3 | 17 | 13 | 4 | 0 | 0 | 0 | 0 | 1 | 0 | 0 |
| 145 | Link | 3fbf6dfa3ae8f536c3b6d6537d5cb1133634d59c | 6.0.1 | gui | 3 | 11 | 3 | 8 | 2 | 2 | 6 | 0 | 0 | 0 | 1 |
| 151 | Link | cc55a6dacb02cde5528fbab400de716ca3b10c11 | 7 | gui | 3 | 15 | 10 | 5 | 0 | 0 | 0 | 0 | 0 | 0 | 1 |
| 152 | Link | 10c206270a567052acd13f48e484332bb02e3a05 | 7 | output | 2 | 12 | 4 | 8 | 0 | 1 | 4 | 0 | 0 | 0 | 0 |
| 155 | Link | 6e54497492cf0b8329f423bae5e1879b2ede4fd9 | 9 | output | 3 | 8 | 4 | 4 | 0 | 1 | 4 | 0 | 0 | 0 | 0 |
| 157 | Link | 679229d7c8c5e9a4f9e1425ddf521d7d83ae08a5 | 10 | output | 2 | 8 | 2 | 6 | 0 | 2 | 6 | 1 | 0 | 0 | 0 |
| 158 | Link | 5c7ef543d2ac9233ba6818e43b1d1a097f7332a8 | 11 | gui | 3 | 10 | 7 | 3 | 1 | 1 | 2 | 1 | 0 | 0 | 0 |
| 159 | Link | 2948dfbb88bf535a6099245dfd5bc1432f9c8914 | 11 | crash | 3 | 37 | 2 | 35 | 0 | 3 | 35 | 1 | 0 | 0 | 0 |
| 160 | Link | abd1db25de96a2f11fb08291e56aa6728bd7de61 | 11 | gui | 3 | 14 | 8 | 6 | 0 | 1 | 4 | 1 | 0 | 0 | 0 |
| 162 | Link | 6e392f62b78689f7a05bdb728ce81955dcebb8e1 | 6 | crash | 4 | 6 | 1 | 5 | 0 | 1 | 5 | 0 | 0 | 0 | 0 |
| 164 | Link | 6ff1b67a7f1f5b270eb7c8c7e0b60c9ba47f2d33 | 7 | gui | 3 | 7 | 1 | 6 | 0 | 1 | 6 | 0 | 0 | 0 | 0 |
| 165 | Link | a903bd6f81e929bdd486b12e24afe851d06b7dcf | 10 | output | 3 | 28 | 23 | 5 | 0 | 2 | 4 | 0 | 0 | 1 | 1 |
| 168 | Link | 31240dd2fc63d91aef6fd71a4e09b50d1d169599 | 10 | crash | 3 | 3 | 2 | 1 | 0 | 0 | 0 | 1 | 0 | 0 | 0 |
| 174 | Link | 892b1ee0cfdbdd747a37e413e205258f46970972 | 10 | crash | 3 | 6 | 1 | 5 | 1 | 2 | 4 | 0 | 0 | 1 | 1 |
| 178 | Link | 1d950d187fae89396ce6b1d0f78f6e44dd095440 | 4.4.2 | crash | 1 | 1 | 1 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| 186 | Link | dbed34ce37ffda535833cccd81b4d576961038b1 | 8 | crash | 4 | 2 | 0 | 2 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| 188 | Link | 204365adfb400b8ef098c4d9fa4f6852b9b4eb98 | 8 | gui | 4 | 6 | 0 | 6 | 2 | 2 | 4 | 0 | 0 | 0 | 0 |
| 191 | Link | 6e925f1e60796c2f1623a1514e9d9192ab3bfd1e | 8 | output | 2 | 2 | 0 | 2 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| 192 | Link | 7214fc661e79f0a9cb18344a2be14d169f212889 | 8 | gui | 3 | 12 | 8 | 4 | 0 | 1 | 2 | 1 | 0 | 1 | 0 |
| 193 | Link | a6cd4f2a11b78135e4d9884fc6b18c1d96a8ca94 | 8 | gui | 6 | 5 | 3 | 5 | 0 | 0 | 0 | 1 | 0 | 0 | 0 |
| 198 | Link | 5a84332a1679f179777404ccd541e00541512efb | 8 | crash | 4 | 12 | 0 | 12 | 0 | 2 | 9 | 1 | 0 | 0 | 0 |
| 199 | Link | 64d685e530715186fdb4cfecfce01ee79328f166 | 7 | output | 4 | 15 | 6 | 4 | 2 | 1 | 1 | 0 | 0 | 0 | 1 |
| 200 | Link | 10337dac94ee9631ec560718a8d85c033681b23d | 8 | output | 3 | 10 | 6 | 3 | 0 | 0 | 0 | 1 | 0 | 0 | 0 |
| 201 | Link | 1ae5ed05e9b4c5927db5a4daa9307695beb8c286 | 7 | gui | 3 | 12 | 6 | 3 | 2 | 1 | 1 | 0 | 0 | 0 | 0 |
| 205 | Link | a8646bb730cced3bf552297d5560ea2c12d3b77e | 8 | output | 4 | 9 | 1 | 8 | 4 | 3 | 7 | 1 | 0 | 1 | 0 |
| 206 | Link | d1c31033366ae7044e4b115b9ac021060660ef18 | 8 | output | 2 | 11 | 9 | 3 | 1 | 1 | 2 | 1 | 0 | 1 | 0 |
| 208 | Link | d1c31033366ae7044e4b115b9ac021060660ef18 | 8 | crash | 2 | 12 | 9 | 4 | 2 | 0 | 0 | 1 | 0 | 1 | 0 |
| 209 | Link | 52f72970eada423f10ed11359f628c5755545b24 | 8 | gui | 5 | 12 | 7 | 5 | 3 | 0 | 0 | 1 | 0 | 1 | 0 |
| 217 | Link | 9e11cc15cc6f7c8636f4fd3e0f9e8578811949d9 | 7 | gui | 2 | 7 | 5 | 2 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| 226 | Link | 89a045c612ab6b130572697a3e2e827c6277d2ee | 9 | output | 5 | 8 | 2 | 6 | 0 | 1 | 3 | 0 | 0 | 0 | 0 |
| 227 | Link | 3c26b278edd14dd909894bbe4346965e77013245 | 7.1 | gui | 5 | 31 | 7 | 24 | 19 | 3 | 22 | 0 | 0 | 0 | 0 |
| 228 | Link | bcdab71c58f2ade300aa4cea23f0c9f728f26d88 | 4.2.2 | output | 1 | 11 | 1 | 10 | 0 | 1 | 4 | 0 | 0 | 0 | 0 |
| 248 | Link | b4cb65b22c26c071734ede460adf4e6d001edbcd | 9 | gui | 5 | 8 | 1 | 7 | 0 | 2 | 7 | 1 | 0 | 0 | 0 |
| 250 | Link | 0f39237e8e00957827762642b0c19347578ca421 | 6 | gui | 5 | 9 | 1 | 8 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| 253 | Link | fc44c9ee767d747699b0e80883974e14e9bd5a29 | 10 | crash | 2 | 5 | 1 | 4 | 0 | 1 | 3 | 0 | 0 | 0 | 0 |
| 256 | Link | 5a644f09aae5f7017369e69720486910082da11a | 7.1 | crash | 5 | 22 | 7 | 15 | 11 | 3 | 14 | 0 | 0 | 0 | 0 |
| 266 | Link | fc44c9ee767d747699b0e80883974e14e9bd5a29 | 10 | output | 6 | 14 | 10 | 4 | 0 | 0 | 0 | 1 | 1 | 0 | 0 |
| 271 | Link | 6e54497492cf0b8329f423bae5e1879b2ede4fd9 | 7.1.1 | crash | 2 | 12 | 4 | 8 | 0 | 2 | 8 | 0 | 0 | 0 | 0 |
| 272 | Link | 9e11cc15cc6f7c8636f4fd3e0f9e8578811949d9 | 10 | output | 6 | 9 | 1 | 8 | 0 | 1 | 4 | 0 | 0 | 0 | 0 |
| 273 | Link | 6d006a30219a3a1b42dd835119d08cb797ed6203 | 10 | gui | 3 | 15 | 8 | 7 | 4 | 0 | 0 | 1 | 0 | 0 | 0 |
| 274 | Link | 9e11cc15cc6f7c8636f4fd3e0f9e8578811949d9 | 7.1.1 | output | 9 | 7 | 0 | 7 | 3 | 1 | 2 | 0 | 0 | 0 | 0 |
| 275 | Link | e19f6343624348dcb01486c4c70502004005583c | 8.1 | output | 3 | 14 | 4 | 10 | 2 | 3 | 5 | 0 | 0 | 0 | 0 |
| 276 | Link | b6957df14c7631f28f2ca38b38dcbb76ca0d370b | 5 | crash | 5 | 5 | 1 | 4 | 1 | 0 | 0 | 1 | 1 | 1 | 0 |
| 277 | Link | edac117922de5b278b2447df32d48c2d5d4a6a0b | 5 | gui | 1 | 2 | 1 | 1 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |