You mean the telephone contacts / contact list stored in iCloud and Google cloud?
Probably it’s a hard problem to solve and this, using the sgx is signals best guess of an acceptable approach.
I think the nsa has simpler ways to access the data in question than through signal.