Precisely! Wind and Lightning are elements that are quite formless, especially wind. Their speed easily outmatches the other elements, especially lightning.
Indeed, the Boar handseal is a hindrance and can alert an experience opponent to what you're about to do, but you're still missing some major points.
1. When using Swift release, you can only move in a straight line. Furthermore, your execution of moves must be fairly simple. Knowing this, how might you try to use Swift in a battle despite this downside?
2. When you reach close range of your opponent to execute Taijutsu or even a short range jutsu, you are required to slow down and become visible to the naked eye. How might you use this to your advantage?
3. It is very hard to execute Swift release on unsolid grounds, especially on water, ice, mud, sand, etc. However, you are able to use the Swift ability in mid-air. What is a good way to prevent the opponent from taking advantage of the "unsteady ground" weakness?