0xB10C @0xb10c@x0f.org

Ran full-IBD benchmarks for PR #20827.

Measured a ~4% IBD speed-up with -prune=550 and default dbcache and a whooping 17.4% (!!) speed-up using -prune=8800 and -dbcache=4000.

Full results:
https://github.com/bitcoin/bitcoin/pull/20827#issuecomment-1023108273

I solved @robot__dreams first Bitcoin-flavored cryptography challenge (https://gist.github.com/robot-dreams/669c13bc724fdeb9af8460c9b64d5665) with the help of @kalle Schnorr Basics explainer (https://popeller.io/schnorr-basics).

Here's a write-up (and spoiler).

https://b10c.me/blog/009-schnorr-nonce-reuse-challenge/

I'm currently running IBD benchmarks for @lukedashjr 's #20827 on a dedicated benchmarking machine. I expect them to finish next week.

https://github.com/bitcoin/bitcoin/pull/20827#issuecomment-1009016428

I've rented the machine till end of the month. Any other PRs that need IBD benchmarks?

@kalle Thanks for writing this up!

I've dm'd you a few days ago on the birdsite, but I think it doesn't show a notification for you. Would you be interested in cross-posting your Schnorr Basics post to https://bitcoin-dev.blog ?

@jb55 IIRC you were working on a self-hostable LN+on-chain payment processor in Rust a few months ago? I'm looking for something more lightweight than BTCPayServer for my nix-bitcoin node... It's overkill for just receiving the occasional donation. Is project an option?

@jb55 no way 😱

All pools that mined ten or more blocks since taproot activation have now included at least one P2TR spend.

I'm streaming the Bitcoin Taproot soft-fork activation.

Join me for sound notifications and a real-time feed of blocks and taproot transactions!

Twitter: https://twitter.com/i/broadcasts/1MnxnkVapdeKO
Twitch: https://www.twitch.tv/0xb10c
YouTube: https://www.youtube.com/watch?v=YihYNYFdXsQ

We have been working on making reorgs on SigNet a reality and are looking for feedback on approach and parameters. If you want to test the reorg handling of your app, please let us know!

https://lists.linuxfoundation.org/pipermail/bitcoin-dev/2021-September/019413.html

@michaelfolkson Yes, debugging is definitely one of the USDT applications. Also developers can be use the tracepoints to evaluate/review changes like I do with the erlay vs master nodes dashboard. Or for general monitoring, anomaly detection, benchmarking, and testing.

@michaelfolkson
Additionally, I think 'tracing' via USDT and debugging are two very different things. You can use tracing via USDT as part of the search for a bug, but you can't replace debugging with tracing.

Sometimes debugging, as in stepping through code and looking at state with e.g. GDB, is something you do manually.

The tracing done with USDT allows you to use internal state programatically. You can automatically react to some state.

@michaelfolkson I'm not sure if I'd see reading "BPF Performance Tools" as a requirement. The tools are very specific for tracepoints in the Linux kernel. We don't use any of these tools or tracepoints.

We just implement our own tracepoints in our userspace application (Bitcoin Core) and write custom scripts to get insights into the parts we find important.

@michaelfolkson Yes! I've been thinking about some kind of USDT workshop for CoreDev too.

A Socratic might be better once we have more tracepoints merged and people building tools/using the tracepoints? Maybe sometime between CoreDev and 23.0. release?

I've summarized my work on Userspace, Statically Defined Tracing support for Bitcoin Core in my Coinbase grant half-time report.

https://b10c.me/blog/008-bitcoin-core-usdt-support/

If future tracepoints for e.g. peer dis / connections, addrman, UTXO set changes, etc get merged, this might be an alternative to
@lopp
's Statoshi.info which requires a rebase on each Bitcoin Core release. I'd also argue that the bitcoind-observer setup is easier.

And block connection timings during IBD and data about validated blocks/second, transactions/second, inputs/second, and sigops/second.

https://bitcoind.observer/d/V5pGXBW7k/block-validation-during-idb?orgId=1&from=1627333200000&to=1627390800000

While limited by the three trancepoints added in #22006, it is already showing real time P2P message count and traffic per message type.

https://bitcoind.observer/d/Z3_pFfZnz/p2p-network-traffic?refresh=30s&var-msg_types=All