Haven’t followed football in decades, but I’d think that as long as they initied the manouver in a legal place and they never dropped the ball or changed the players “holding” the ball, the other team couldn’t force an offside.

I.e. If the opposing team crossed the field to be behind the players doing this, it wouldn’t change anything because it’s still the same players carrying the ball. The opossing team would have to move once they saw them setup this, but then it could also be a fakeout, to have the entire defense away and they’d attack normally.