Transformers & Probes