I’ve tested this further.
New document, one contact is checked as recipient, one contact is not checked as recipient.
Like this:
If NONRecipient Joe Smith clicks the “View” button inside the client portal (no email sent to him) - system will not register this. Document will not be marked as viewed.