Tear tortillas into pieces, and arrange half of the pieces in one overlapping layer across the bottom of the slow cooker. Arrange half of the chicken, half of the soup, and half of the cheese on top. Repeat with remaining tortillas, chicken, soup, and cheese. Top with black olives.