Pregunta de entrevista de Agolo

transformer architecture based questions , MoE, Encoder vs Decoder architecture. state of the art models.