At WWDC, Apple Unveils Apple Intelligence and Previews New OS Features

ByEmily Dolloff

Apple’s Worldwide Developer Conference keynote was a lightning-fast (even in the full 1:44-long video—or try the 3-minute recap) look at what Apple is bringing to the software side of the Apple experience in the next year. Although some past keynotes have introduced hardware like new Macs and the Vision Pro, this year’s keynote stuck to new operating system features before previewing a suite of AI features collected under the umbrella term “Apple Intelligence.”

Apple previewed a boatload of new features and listed even more on its website. We’ll focus on those we think will make the biggest splash in your Apple experience, but we recommend that you scroll through Apple’s pages for each operating system to see more of what’s coming. Those are linked below, along with basic hardware requirements so you can see if your devices will be eligible to upgrade (not all features will be available on all devices):

  • macOS 15 Sequoia: iMac Pro from 2017, MacBook Pro and Mac mini from 2018 and later, iMac and Mac Pro from 2019 and later, MacBook Air from 2020 and later, and Mac Studio from 2022 and later
  • iOS 18: Second-generation iPhone SE, iPhone XR, and later (same as iOS 17)
  • iPadOS 18: Seventh-generation iPad and later, fifth-generation iPad mini and later, third-generation iPad Air and later (including M2 models), first-generation 11-inch iPad Pro and later, and third-generation 12.9-inch iPad Pro and later, and all M4 iPad Pro models
  • watchOS 11: Second-generation Apple Watch SE, Apple Watch Series 6 and later, and Apple Watch Ultra and later
  • tvOS 18: Apple TV HD (with fewer features), Apple TV 4K
  • visionOS 2: All Vision Pro headsets

Here are a handful of new features we think Apple users will find most interesting. Then we’ll look at Apple Intelligence.

Personalize Your iPhone and iPad Home Screen

iOS 18 and iPadOS 18 introduce significantly enhanced Home Screen customization options aimed at letting your creativity shine through. You can leave blank spaces between icons and arrange icons and widgets however you like. Additionally, you can change the size of icons and widgets and apply color tints.

Screenshot

Tile Windows Automatically in Sequoia

macOS has long had a subtle window alignment effect that makes it easy to line up windows, but in macOS 15 Sequoia, when you drag a window to the side of the screen, macOS suggests a tiled position on your desktop, intelligently sizing it for the window’s content. Window tiling makes it easy to put windows side-by-side and fill the screen without wasting space. Keyboard jockeys will appreciate new keyboard shortcuts for window tiling as well. (If you don’t want to wait for Sequoia, numerous utilities offer similar features now, including  Amethyst, BetterTouchTool, Magnet, Moom, Rectangle, and Yabai.)

Notes and Phone Gain Audio Recording and Transcription

If you find yourself wanting to revisit what was said in a lecture, appointment, or phone call, a pair of upcoming features can boost your recall. The Notes app on all platforms will record audio and create live transcriptions, allowing you to pay attention during a talk rather than furiously taking notes. Plus, the Phone app in iOS 18 will let you record and transcribe a live call—when you start recording, participants are automatically notified so everyone knows it’s happening.

Mirror Your iPhone on Your Mac

If you frequently pull out your iPhone while working on your Mac, you’ll appreciate Sequoia’s new iPhone mirroring feature. It lets you use your Mac’s pointing device and keyboard to interact with all your iPhone apps in a window on your Mac while the iPhone remains locked or in StandBy. Audio from the iPhone plays through your Mac, and you can share data between devices with drag and drop. A related Continuity feature displays iPhone notifications on your Mac—when mirroring your iPhone, clicking those notifications opens the associated iPhone app.

Passwords Breaks Free of Settings

At long last, Apple has given us a dedicated Passwords app in Sequoia, iOS 18, iPadOS 18, and visionOS 2. The company’s password management features have become quite good over the past few years, but they are awkward to access in Settings on the iPhone and iPad and System Settings on the Mac. We don’t anticipate significant feature changes beyond the addition of categories, but the Passwords app should make managing your logins even easier. Passwords still won’t fully match up to the likes of 1Password, but you won’t go wrong with Apple’s built-in solution. Remember that if you use a Web browser other than Safari, you’ll need the iCloud Passwords extension we’ve mentioned previously. You can also share your passwords with a Windows PC using iCloud for Windows.

Five More Welcome Features

For more reasons to upgrade once these new operating systems are out and stable, consider the following additional features:

  • Customize Control Center: iOS 18 and iPadOS 18 feature a thoroughly revamped Control Center, accessible with a continuous swipe down on the Home Screen. You can create custom groups of controls—some from third-party apps—with resizing and mixing options.
  • iPad Calculator app and Math Notes: Not only does the iPad finally get a Calculator app, but it also introduces Math Notes. You handwrite an equation with an Apple Pencil, and when you write an equals sign, Calculator solves the equation. Math Notes works with keyboards, too, and you can also find it in the Notes app.
  • Lock and hide iPhone apps: New privacy features in iOS 18 and iPadOS 18 let you lock apps with Face ID or Touch ID so the friend who’s scrolling through your vacation photos can’t also read your journal. You can also move apps to a hidden folder in the App Library that can’t be opened without biometric authentication.
  • More tapbacks: In Messages, when you want to use a tapback to acknowledge a message without typing out a reply, you’ll be able to use any emoji or sticker, or a new AI-powered Genmoji.
  • Vitals app collects overnight data: When you wear your Apple Watch to sleep, a new Vitals app in watchOS 11 collects and displays your overnight health metrics on your wrist, including heart rate, respiratory rate, temperature, blood oxygen, and sleep duration. It might help you rest up to fight off that cold that’s going around.

Apple usually releases its new operating systems in September or October; we’ll write more about them as we get closer. Generally speaking, it’s OK to upgrade to everything but macOS shortly after release; with macOS, we recommend caution to ensure your existing apps and workflows won’t be impacted.

Apple Intelligence

Apple devoted a large chunk of the keynote to introducing Apple Intelligence, a collection of AI-powered features coming to the Apple ecosystem over the next year. These features will enable your iPhone, iPad, and Mac to understand language and create both text and images, plus take actions aimed at simplifying your interactions with apps. What sets Apple Intelligence apart from AI efforts from other companies is its focus on—and understanding of—your personal context. Apple Intelligence will know about your contacts, schedule, email, messages, photos, and much more.

The most significant use of Apple Intelligence will come with Siri, which will let us speak more naturally and understand what we mean if we make mistakes. We’ve trained ourselves to say only things Siri is likely to be able to handle, but that won’t be necessary when Siri gains Apple Intelligence capabilities. You’ll be able to search for photos of your child holding a fishing rod, for instance, or ask Siri to find something when you can’t remember if it was in Mail or Messages. Siri will also gain context awareness, so you can ask what the weather will be like at the beach tomorrow, and if the response is good enough, have it schedule a trip there. Siri will even know a lot more about your Apple devices and can help you use them. For the most part, though, Siri won’t have global knowledge. If Siri can’t answer your query directly, it will offer to send it to ChatGPT for free.

Apple Intelligence also includes writing tools, but unlike ChatGPT, it’s not aimed at creating text from scratch. Instead, it can rewrite text you’ve written to help you fine-tune the wording or adjust the tone to be more appropriate. It can also proofread text, helping you with grammar, word choice, and sentence structure (if you need this now, check out Grammarly). Even when Apple Intelligence does create text, such as the Smart Reply feature coming to Mail, it asks you questions to guide its response.

Text summarization powered by Apple Intelligence shows up repeatedly. In Notes, you’ll be able to summarize a transcription. If you save a long article to Safari’s Reader, it can provide a table of contents and summary. In Mail, instead of the first few sentences appearing in the message list, you’ll get a short summary. Apple Intelligence can even prioritize and summarize notifications.

Unsurprisingly, Apple Intelligence lets you create and edit images, but it’s a far cry from the AI artbots that let you create photo-realistic images. Instead, Apple Intelligence lets you create custom emoji, called Genmoji, which let you express yourself graphically in ways that standard emoji can’t support. Image Playground lets you create images for inclusion in conversations and documents, but it limits you to three styles: Sketch, Illustration, and Paint. Apple doesn’t want anyone making deepfakes with Apple Intelligence. A new Image Wand feature in Notes even turns your rough sketches into polished images.

Apple took great pains to emphasize the privacy aspects of Apple Intelligence. Most Apple Intelligence tasks will take place entirely on your device, hence the need for powerful Apple silicon chips with their Neural Engines and Secure Enclaves. Some tasks require more processing power; to handle those, Apple has developed a highly secure system called Private Cloud Compute. It relies on Apple silicon servers, transfers only the data necessary to the task, and stores nothing.

Apple Intelligence features will start arriving in the fall and continue to roll out in feature-release updates over the next 6–8 months. They will run only on the iPhone 15 Pro, iPhone 15 Pro Max, and iPads and Macs with M1 or later chips. Intel-based Macs and less-powerful iPads and iPhones need not apply. Apple Intelligence will also require Siri and the device language to be set to US English in the early releases, with other languages to follow.

Overall, Apple appears to have put a great deal of thought and effort into integrating AI into the Apple experience in focused, helpful ways that offer new capabilities while preserving user privacy. We won’t know how well these features will work until they ship, but we look forward to seeing how they can improve interactions with our Apple devices.

(Featured image by Apple)

Social Media: At yesterday’s Worldwide Developer Conference, Apple announced a treasure trove of new features in its upcoming operating system upgrades, including practical, everyday improvements and impressive AI-based capabilities.

Similar Posts

  • Get Organized!

    I have tried a lot of apps over the years for keeping ideas organized, assigning tasks or just keeping track of my goals. The problem I’ve found with many of the organizational applications is that I don’t find them easy to access. If you’re not on your phone or at your computer, often these applications can’t be utilized easily or have widely varied interfaces depending on which device your using.

    “**Trello**”:https://trello.com/ has become my new favorite go-to app for keeping ideas and tasks organized. Trello is a free app with the ability to also pay for upgraded features for minimal fees. Why do I love Trello so much? It’s simple, I can easily use it on my computer, my iPhone or my iPad. There is an app for all three of my devices, and each version works seamlessly with the others. Working with several staff members in different departments here at Small Dog can make keeping track of tasks and to-do lists a bit of a challenge, but this simple application has really helped to streamline things.

    I easily and quickly create what they call “boards”, each board then allows you to create individual categories to which you can then add individual tasks. Within my lists I can upload photos, files, web links, assign due dates and add notes. Once I have created a board, I can also easily share that board with co-workers or whomever I choose to share them with. Anyone I have shared a board with can also be granted access to update and add to the boards, add notes or more files.

    A feature many of us have come to really rely on are the updates that you get from Trello notifying you that someone has made a change. I have found just one complaint thus far about the application. There appears to be no feature to mark a task as completed while still leaving it on your board. You can easily archive tasks and even entire boards, but I prefer to still be able to see those tasks while clearly seeming them marked as completed. However, all in all, I find this to be an invaluable app and one that I utilize all of the time. I have tried and do use google docs and google drive, and I’ve installed those on my devices as well, but for me nothing beats the ease and convenience of Trello.

  • Reminders (Finally) Adds Time Zone Support

    Apple’s latest operating systems have eliminated a longstanding annoyance for frequent travelers: the lack of time zone support in Reminders. If you had…

  • Get yourself some Dux

    What is a Dux you ask? Dux is a really great product line from STM and one that we are really excited to begin carrying here at Small Dog. This product line up has cases for your iPad and your computer and for the last week or so I have been testing out the Dux case for Macbook Air.

    My first impression is that it gives my computer a sharp new look. I feel as though my computer is highlighted more in this case. It features a primarily clear case and then a border that comes in an assortment of colors. The one I am using is black and it really looks sharp and sleek on the computer.

    I will be the first to admit that I am not a huge fan of hardshell cases for computers. They do add weight to your computer and they can be hard to put on and take off. However, this case did stand out to me as soon as I saw it and I immediately asked for a sample so that I could test it out. It’s the reinforced border that caught my eye. The plastic is slightly different from that of the clear case and really gives you a feeling of protection for your computer.

    Customers ask me all the time why someone might want a hard shell case, it’s a combination of accessorizing and protection. Hard shell cases are great for those who might like to sticker their computers. You can sticker all you want on a removable case and not damage your computer. For people who bring their computers everywhere it’s a great way to protect them from the dings and scratches that can happen just by pulling your computer in and out, especially those whom might fly a lot. One piece of advice I will give users of hardshell cases is that you still need to remove them! The idea and concept of hard shell cases is to provide added protection to your computer, to keep it looking like new under the case. However, if you don’t remove the case from time to time and clean the case and computer from dust and debris your computer will still get scratches. I have seen countless computers get just as scratched up with these kinds of cases than those without and the cause is always the same: dirt build up. This particular case comes on and off much easier than some others on the market making my recommended occasional cleanings much easier to perform. After all you’ve probably purchased a hard shell case to keep your computer looking new.

    Overall I am very happy with this case, but the biggest test is yet to come. I am flying to Arizona next week for an event with one of our vendors, and I’ll be keeping this case on my computer for my travels. The real test will be if I notice the added weight while making my way through airports, so far I haven’t really noticed the increased weight in my daily travels.

    P.S. Hadley, even if it means burpees and laps in an airport terminal I plan to maintain my lead in our competition. It’s ON!

  • Businesses, Don’t Overlook Email Backup

    Cloud-based email services such as Google Workspace and Microsoft 365 dominate the market for organizational email for good reason. Dealing with the constant…

  • _Dear Friends,_

    New data from Piper Jaffray’s teen survey show that Apple is dominating that market at least as far as mobile devices are concerned. They have 71% of the teen market for smart watches and almost 70% for iPhones and 64% for iPad. Another survey has Apple Mac sales showing positive growth while literally the entire PC market is in decline.

    I have been playing around with Amazon’s Echo and I have to say that I like it a lot. I wake up each morning and say “Alexa, what’s new?” and I get the news reports from NPR, CNN, Huffington Post and BBC as well as ESPN Sports and the local weather report. During the day, I ask Alexa to “play the blues” or “play some classical music” and while the speaker is not as good as my Sonos system it does fill the room. I can be around the corner or across the room and the Echo can hear me. Apple needs to step it up a bit and get Siri on the Mac or even better yet, integrated into their networking gear. I would love to be able to tell my Sonos app to play my music from my iTunes library!

    Speaking of networking here’s a Kibbles & Bytes exclusive! This isn’t for everyone but if you have a big house and your Wi-Fi signal isn’t reaching that far corner of the house this could solve three problems for you! I am bundling the Apple Factory Refurbished 3TB Time Capsule with an Apple Factory Refurbished Airport Express. Both have the same 1-year Apple warranty as new but you can save some bucks. The 3TB Time Capsule gives you the Airport Extreme wireless access point and automatic wireless back-ups to the integrated 3 terabyte drive. The Airport Express allows you to extend that wireless network. Normally “**this bundle**”:http://www.smalldog.com/wag900002195/extend-your-network-and-back-up-your-data-for-only-325-99? is around $500 new, but this week for Kibbles & Bytes readers, while supplies last you can buy this refurbished bundle for only “**$325.99!**”:http://www.smalldog.com/wag900002195/extend-your-network-and-back-up-your-data-for-only-325-99?