Unfortunately, we don’t support negative search for metadata at this time.
My recommendation would be to fetch the data first and then filter it server-side. From a user experience perspective, I’d suggest using infinite scroll with slight over-fetching or automatically fetching the next batch if all items are filtered out, to avoid displaying empty pages.
We recommend filing a feature request with our Product team to express your interest and use case here: https://feedback.nylas.com.