To design a highly available architecture on AWS, I would use multiple Availability Zones (AZs) for EC2 instances and RDS databases. An Elastic Load Balancer (ELB) would distribute incoming traffic across these instances to improve fault tolerance and ensure uptime, while leveraging Auto Scaling Groups to handle variable load and maintain performance.