Oh for sure they would, but it would just slowly influence it a tiny bit over huge time spans(unless it is jupiter size and closer to earth than mars or venus). The star is going to be a much more powerful pull than even that would be.

Hahaha maybe one of the planets woulf eventually find a home as a moon of it though