Put it this way: If you don't use a Wacom tablet and you've either got some time to spare to re-setup some stuff or you're using something like GNOME or KDE, I'd absolutely recommend it. If you aren't on those DEs, you'll need to spend some time getting stuff set back up, but with the improvements Wayland is supposed to have, especially security-wise, I'd say it's probably worth it.
Like, if you're on i3, you can *mostly* use your existing i3 config with Sway. Some things will need to be changed, you'll have to switch some programs out (e.g. Scrot), you'll probably want to switch others out (e.g. bemenu for dmenu), and if you're doing multimonitor, you'll have to migrate from Xrandr to, get this, just putting it in your Sway config, but I'd say the maybe an hour that'd take (assuming no major problems) is worth it.