I can definitely perceive a difference in swing characteristics, but I don't perceive it as a difference in swing speed.
On the heavier frame, the hand will naturally swing slower from the shoulder, but the head will naturally swing faster from the wrist to cancel it out.
If I had to vote, I'd vote "the same speed."
BLX Blade 98. 26.75". 13.195 oz., 12.55", 357 SW. 16x20 (outer mains skipped)
Pre-Stretched Ashaway Kevlar 16g/ZX Monogut Natural 16g, 90/40 lbs