Get transactions for address

I develop an application (BitBook, https://github.com/C-Otto/BitBook) that helps users track their coins. For this, whenever I reason about some address, I need to consider all transactions that take funds out of the address, or pay into the address.

With bitcoin-cli I could use the block details (possibly with getblockfilter) to find all transactions that pay into the address. By adding quite a bit of logic and scanning the complete blockchain, I could then also find addresses that take funds out of the address. However, the whole process seems rather involved and slow.

APIs like Blockchair offer convenient endpoints that give me exactly the required information, but considering that I need to keep this information up-to-date (for all addresses that are relevant to the user), I'd like to avoid using such APIs that only offer a limited number of free requests. Aside from that, there's the obvious privacy issue.

My question:

What are other ways to get the necessary information?

• Input: address
• Output: list of transactions paying into the address or taking out of the address

You can get bonuses upto $100 FREE BONUS when you:
💰 Install these recommended apps:
💲 SocialGood - 100% Crypto Back on Everyday Shopping
💲 xPortal - The DeFi For The Next Billion
💲 CryptoTab Browser - Lightweight, fast, and ready to mine!
💰 Register on these recommended exchanges:
🟡 Binance🟡 Bitfinex🟡 Bitmart🟡 Bittrex🟡 Bitget
🟡 CoinEx🟡 Crypto.com🟡 Gate.io🟡 Huobi🟡 Kucoin.