• Seattle Skeptics on AI
Seattle Skeptics on AI

Tag: LLM design

How Transformer Architecture Evolved: Key Innovations Since 2017
How Transformer Architecture Evolved: Key Innovations Since 2017

Tamara Weed, May, 15 2026

Explore how transformer architecture evolved since 2017. From RoPE embeddings to SwiGLU activation, discover the key innovations driving modern LLM efficiency and accuracy.

Categories:

Enterprise Technology

Tags:

transformer architecture RoPE embeddings SwiGLU activation LLM design AI model efficiency

Recent post

  • Memory Footprint Reduction: Hosting Multiple Large Language Models on Limited Hardware
  • Memory Footprint Reduction: Hosting Multiple Large Language Models on Limited Hardware
  • Privacy by Design Prompts: How to Instruct AI to Limit Data Collection
  • Privacy by Design Prompts: How to Instruct AI to Limit Data Collection
  • Efficient Sharding and Data Loading for Petabyte-Scale LLM Datasets
  • Efficient Sharding and Data Loading for Petabyte-Scale LLM Datasets
  • Infrastructure Requirements for Serving Large Language Models in Production
  • Infrastructure Requirements for Serving Large Language Models in Production
  • Data Classification Rules for Vibe Coding Inputs and Outputs: A Governance Guide
  • Data Classification Rules for Vibe Coding Inputs and Outputs: A Governance Guide

Categories

  • Enterprise Technology
  • Science & Research

Archives

  • September 2026
  • August 2026
  • July 2026
  • June 2026
  • May 2026
  • April 2026
  • March 2026
  • February 2026
  • January 2026
  • December 2025
  • November 2025
  • October 2025

Tags

vibe coding prompt engineering large language models generative AI transformer architecture LLM security AI governance Large Language Models prompt injection data privacy AI coding tools responsible AI AI compliance multimodal generative AI LLM optimization transformer models AI code generation enterprise AI AI development AI coding assistants

© 2026. All rights reserved.