In order to speed up your linking stage, you can use a linker that takes advantage of multiple CPU cores.
Such linkers are lld and mold.
mold is considered more cutting edge, but it works for me.
Just add
[build]
rustflags = ["-C", "link-arg=-fuse-ld=mold"]