Yes, it's what I've been doing over the last few years. I don't like to leave jigs attached to rods when motoring on the ski, so am constantly taking jigs on/off. I use a robust clip on the kingfish gear. I have a split ring on the jig which goes on the clip first, and a solid ring on the assist hooks which goes on the clip afterwards. If you can visualise this, it means that the assist hooks aren't directly attached to the jig. This is convenient because it means that the hook or jig can easily be swapped out independently. Don't be tempted to attach the jig to the clip without a split ring. It enables the fish to gain leverage on the hooks and doesn't end well!
I'm undecided about the swivel. Most of the time, I remove the swivel. It's another failure point and straight jigs don't cause much line twist.
Disclaimer: I use relatively light gear for inshore kingfish over clean ground. If you're chasing donkeys over foul with heavy gear, then it might be better to skip the clip.