What LLMs Know About Their Users

The piece examines how a prompt leveraging ChatGPT’s chat history can produce an extraordinarily detailed user profile—summarizing response preferences, past conversation highlights, personal interests, location clues, device and usage metadata, and subscription status—and argues that, despite potential errors, this synthesis capability signals a new era of intimate surveillance enabled by LLMs.