Brown Dwarfs are essentially high mass gas giants though. That's the issue, we don't have enough knowledge about them and the limit to which they transition to stars to properly classify them better. They are difficult to find and observe because they don't shine bright comparatively and we only have hypothetical limits to what mass is necessary to ignite.

But yes, lower end mass gas giants like what is in our solar system are definitely not close enough to be considered failed stars in any regard.