Transformers and Generators