This is a summary of how to solve your issue, which we mostly discussed in comments above. This is how I do it myself on my Android phone for thousands of contacts:
I use the native contacts App in ...
I use Nextcloud for this with its Contacts app and the native addressbook/contacts app that ships with my ROM (LineageOS). On Android, I can select via my labels when tapping the Hamburger menu at the ...
Trello is the finest substitute, and it's free. Some of it's features include:
Search by tags
Support for @mentions