All typing errors found with --check-untyped-defs have been fixed, so let's make mypy stricter now to avoid regressing this.

Depends on and thus includes !2425 (merged). Once it's merged, this can be undrafted and merged.