Extracting Concepts from GPT-4

OpenAI Blog
June 6, 2024
Using new techniques for scaling sparse autoencoders, we automatically identified 16 million patterns in GPT-4's computations.
Verticals
airesearch
Originally published on OpenAI Blog on 6/6/2024