firmware/testing
2024-02-28 08:42:47 -05:00
..
data bugfix: prevent yikes in clone coldcard - creating backup with bypass_tmp=True on master secret 2023-12-21 08:36:42 -05:00
debug New feature: press 4 to show QR for address shown via USB protocol (mk3) 2020-02-25 09:39:08 -05:00
devtest always use SettingsObject class for master data 2024-02-16 08:47:33 -05:00
.gitignore Validate TRNG using dieharder test suite 2021-03-16 14:06:36 -04:00
api.py use h to represent hardened derivation component 2024-02-22 09:13:40 -05:00
authproxy.py bitcoin regtest 2022-05-23 15:19:48 +02:00
bech32.py Support for P2TR cases 2022-05-03 11:37:22 -04:00
bip39-vectors.json BIP39 passphrase additions, no UX yet 2019-03-27 11:00:43 -04:00
charcodes.py remove version.has_fatram, add version.supports_hsm 2023-12-05 12:30:39 +01:00
ckcc_protocol Making whole firmware public with single, signed commit. 2018-07-24 14:07:33 -04:00
conftest.py Login Settings Tests 2024-02-27 11:00:36 -05:00
constants.py Seed Vault 2023-10-04 08:54:29 -04:00
helpers.py use h to represent hardened derivation component 2024-02-22 09:13:40 -05:00
login_settings_tests.py test wrong pin (login_settings_tests) 2024-02-28 08:42:47 -05:00
Makefile dev squashed 2020-11-18 14:19:14 -05:00
msg.py verify digest for detached signature files 2023-02-21 09:21:20 -05:00
objstruct.py dev squashed 2020-11-18 14:19:14 -05:00
psbt.py PSBTv2 2023-09-21 10:17:44 -04:00
pytest.ini review comments; importstyle; dissolve complex expression; ad test_ms_sign_simple to veryslow tests 2022-05-24 22:50:04 +02:00
README.md initial test fixing 2022-05-13 14:05:54 +02:00
requirements.txt improved QR reading, BBQr tests 2024-01-22 17:07:49 -05:00
run_sim_tests.py incorporate new login tests into test runner 2024-02-27 12:31:45 -05:00
sigheader.py Support firmware limiting itself to specific hardware revs 2020-01-21 09:53:56 -05:00
test_addr.py use h to represent hardened derivation component 2024-02-22 09:13:40 -05:00
test_address_explorer.py use h to represent hardened derivation component 2024-02-22 09:13:40 -05:00
test_attended.py fix test_multisig.py; proper handling of buttons 2024-02-09 08:46:34 -05:00
test_backup.py Remove upper limit for backup file size 2024-02-15 09:50:11 -05:00
test_bbqr.py add segwit cases 2024-02-23 11:38:29 -05:00
test_bip39pw.py kill file_picker annoying file count UI 2024-02-21 09:05:32 -05:00
test_change_pins.py fix test_multisig.py; proper handling of buttons 2024-02-09 08:46:34 -05:00
test_decoders.py WIF scan 2024-02-16 11:29:06 -05:00
test_drv_entro.py use h to represent hardened derivation component 2024-02-22 09:13:40 -05:00
test_ephemeral.py kill file_picker annoying file count UI 2024-02-21 09:05:32 -05:00
test_export.py use h to represent hardened derivation component 2024-02-22 09:13:40 -05:00
test_hsm.py fix test_multisig.py; proper handling of buttons 2024-02-09 08:46:34 -05:00
test_msg.py use h to represent hardened derivation component 2024-02-22 09:13:40 -05:00
test_multisig.py use h to represent hardened derivation component 2024-02-22 09:13:40 -05:00
test_nfc.py Remove upper limit for backup file size 2024-02-15 09:50:11 -05:00
test_notes.py make test_notes pass without failures 2024-02-23 08:42:32 -05:00
test_paper.py kill file_picker annoying file count UI 2024-02-21 09:05:32 -05:00
test_pincodes.py mk4 se1 cases 2022-03-02 12:40:19 -05:00
test_pwsave.py Direct route to BIP-39 passwords on Q 2024-02-20 11:00:17 -05:00
test_rng.py initial test fixing 2022-05-13 14:05:54 +02:00
test_rolls.py add root to path for pytest to find dice rolls code 2023-01-20 15:59:31 -05:00
test_se2.py fix 0.0.5 tests 2024-02-19 09:05:43 -05:00
test_seed_xor.py Add CANCEL to xor; fix test_seed_xor.py 2024-02-09 08:46:34 -05:00
test_sign.py kill file_picker annoying file count UI 2024-02-21 09:05:32 -05:00
test_unit.py use h to represent hardened derivation component 2024-02-22 09:13:40 -05:00
test_upgrades.py kill file_picker annoying file count UI 2024-02-21 09:05:32 -05:00
test_usb.py improve test_usb.py::test_xpub_good 2024-02-22 09:57:46 -05:00
test_ux.py kill file_picker annoying file count UI 2024-02-21 09:05:32 -05:00
test_vdisk.py kill file_picker annoying file count UI 2024-02-21 09:05:32 -05:00
txn.py Seed Vault 2023-10-04 08:54:29 -04:00
xfp-miner.py dev squashed 2020-11-18 14:19:14 -05:00
xor.py Fluff 2023-03-31 11:12:14 -04:00
xpub.py Useful helper 2020-12-10 10:35:58 -05:00

Testing Code

None of this code ships on the product itself, but it does get used for testing purposes.

Dependencies

  • 7z

Background

  • pytest is used to track test cases and fixtures, etc
  • most test code is desktop (simulator), but it can also validate stuff from/to the device
  • some tests might only be possible in 'devmode': a unit that has booted w/ non-standard bootrom
  • some tests may be destructive for funds/seeds/wallets
  • most unit tests will work only on simulator because the useful hooks are too dangerous in product
  • you need a testnet bitcoind running for some tests (will be skipped if not present)

Command line args

  • pass argument "--sim" or "--dev" to select simulator or real device

  • will skip tests that are inappropriate

  • and/or use "marker" for bitcoind interaction: "-m bitcoind"

  • with "--dev" include "--manual" to require operator to press X/OK at times (also needs -s), so:

    --dev --manual -s

Marked Test Cases

  • test all QR code related cases with:

    py.test -m qrcode

  • txn signing where an unfinalized PSBT is created (low-R tests)

    py.test -m unfinalized

  • "bitcoind" which means test would be skipped if you don't have bitcoin core running locally (on testnet)

PSBT reference files

  • examples with IN_REDEEM_SCRIPT:

    data/2-of-2.psbt data/failed-ex.psbt data/filled_scriptsig.psbt data/multisig-single.psbt data/p2pkh+p2sh+outs.psbt data/p2pkh-p2sh-p2wpkh.psbt data/p2sh_p2wpkh.psbt data/worked-*.psbt