But if anyone has caused grief, he has not done it to me [only], but to nearly all of you [or, "only partially to all of you"] for I do not want to overstate the case.

For we [apostles] have no power [to act] against the truth, but [only] for the truth. [Note: Paul here alludes to his gifts and ministry being intended only to promote what was right according to God's truth].