SPEAKER_01 considers it frightening if all labor is performed by fiduciary AIs that obey instructions without whistleblowing, because society may not be robust to that arrangement.

“is pretty scary to get to a point where like all of the labor is on the like fiduciary side of the spectrum where like it doesn't whistle blow it does exactly what you say and whatever like our society is maybe just not robust to that where a central example might be the executive where like a concern that we might have is that if the executive if the U.S. executive or if other governments had access to AI systems which have the property of you know they do whatever”