At WWDC, Apple Unveils Apple Intelligence and Previews New OS Features

ByEmily Dolloff

Apple’s Worldwide Developer Conference keynote was a lightning-fast (even in the full 1:44-long video—or try the 3-minute recap) look at what Apple is bringing to the software side of the Apple experience in the next year. Although some past keynotes have introduced hardware like new Macs and the Vision Pro, this year’s keynote stuck to new operating system features before previewing a suite of AI features collected under the umbrella term “Apple Intelligence.”

Apple previewed a boatload of new features and listed even more on its website. We’ll focus on those we think will make the biggest splash in your Apple experience, but we recommend that you scroll through Apple’s pages for each operating system to see more of what’s coming. Those are linked below, along with basic hardware requirements so you can see if your devices will be eligible to upgrade (not all features will be available on all devices):

  • macOS 15 Sequoia: iMac Pro from 2017, MacBook Pro and Mac mini from 2018 and later, iMac and Mac Pro from 2019 and later, MacBook Air from 2020 and later, and Mac Studio from 2022 and later
  • iOS 18: Second-generation iPhone SE, iPhone XR, and later (same as iOS 17)
  • iPadOS 18: Seventh-generation iPad and later, fifth-generation iPad mini and later, third-generation iPad Air and later (including M2 models), first-generation 11-inch iPad Pro and later, and third-generation 12.9-inch iPad Pro and later, and all M4 iPad Pro models
  • watchOS 11: Second-generation Apple Watch SE, Apple Watch Series 6 and later, and Apple Watch Ultra and later
  • tvOS 18: Apple TV HD (with fewer features), Apple TV 4K
  • visionOS 2: All Vision Pro headsets

Here are a handful of new features we think Apple users will find most interesting. Then we’ll look at Apple Intelligence.

Personalize Your iPhone and iPad Home Screen

iOS 18 and iPadOS 18 introduce significantly enhanced Home Screen customization options aimed at letting your creativity shine through. You can leave blank spaces between icons and arrange icons and widgets however you like. Additionally, you can change the size of icons and widgets and apply color tints.

Screenshot

Tile Windows Automatically in Sequoia

macOS has long had a subtle window alignment effect that makes it easy to line up windows, but in macOS 15 Sequoia, when you drag a window to the side of the screen, macOS suggests a tiled position on your desktop, intelligently sizing it for the window’s content. Window tiling makes it easy to put windows side-by-side and fill the screen without wasting space. Keyboard jockeys will appreciate new keyboard shortcuts for window tiling as well. (If you don’t want to wait for Sequoia, numerous utilities offer similar features now, including  Amethyst, BetterTouchTool, Magnet, Moom, Rectangle, and Yabai.)

Notes and Phone Gain Audio Recording and Transcription

If you find yourself wanting to revisit what was said in a lecture, appointment, or phone call, a pair of upcoming features can boost your recall. The Notes app on all platforms will record audio and create live transcriptions, allowing you to pay attention during a talk rather than furiously taking notes. Plus, the Phone app in iOS 18 will let you record and transcribe a live call—when you start recording, participants are automatically notified so everyone knows it’s happening.

Mirror Your iPhone on Your Mac

If you frequently pull out your iPhone while working on your Mac, you’ll appreciate Sequoia’s new iPhone mirroring feature. It lets you use your Mac’s pointing device and keyboard to interact with all your iPhone apps in a window on your Mac while the iPhone remains locked or in StandBy. Audio from the iPhone plays through your Mac, and you can share data between devices with drag and drop. A related Continuity feature displays iPhone notifications on your Mac—when mirroring your iPhone, clicking those notifications opens the associated iPhone app.

Passwords Breaks Free of Settings

At long last, Apple has given us a dedicated Passwords app in Sequoia, iOS 18, iPadOS 18, and visionOS 2. The company’s password management features have become quite good over the past few years, but they are awkward to access in Settings on the iPhone and iPad and System Settings on the Mac. We don’t anticipate significant feature changes beyond the addition of categories, but the Passwords app should make managing your logins even easier. Passwords still won’t fully match up to the likes of 1Password, but you won’t go wrong with Apple’s built-in solution. Remember that if you use a Web browser other than Safari, you’ll need the iCloud Passwords extension we’ve mentioned previously. You can also share your passwords with a Windows PC using iCloud for Windows.

Five More Welcome Features

For more reasons to upgrade once these new operating systems are out and stable, consider the following additional features:

  • Customize Control Center: iOS 18 and iPadOS 18 feature a thoroughly revamped Control Center, accessible with a continuous swipe down on the Home Screen. You can create custom groups of controls—some from third-party apps—with resizing and mixing options.
  • iPad Calculator app and Math Notes: Not only does the iPad finally get a Calculator app, but it also introduces Math Notes. You handwrite an equation with an Apple Pencil, and when you write an equals sign, Calculator solves the equation. Math Notes works with keyboards, too, and you can also find it in the Notes app.
  • Lock and hide iPhone apps: New privacy features in iOS 18 and iPadOS 18 let you lock apps with Face ID or Touch ID so the friend who’s scrolling through your vacation photos can’t also read your journal. You can also move apps to a hidden folder in the App Library that can’t be opened without biometric authentication.
  • More tapbacks: In Messages, when you want to use a tapback to acknowledge a message without typing out a reply, you’ll be able to use any emoji or sticker, or a new AI-powered Genmoji.
  • Vitals app collects overnight data: When you wear your Apple Watch to sleep, a new Vitals app in watchOS 11 collects and displays your overnight health metrics on your wrist, including heart rate, respiratory rate, temperature, blood oxygen, and sleep duration. It might help you rest up to fight off that cold that’s going around.

Apple usually releases its new operating systems in September or October; we’ll write more about them as we get closer. Generally speaking, it’s OK to upgrade to everything but macOS shortly after release; with macOS, we recommend caution to ensure your existing apps and workflows won’t be impacted.

Apple Intelligence

Apple devoted a large chunk of the keynote to introducing Apple Intelligence, a collection of AI-powered features coming to the Apple ecosystem over the next year. These features will enable your iPhone, iPad, and Mac to understand language and create both text and images, plus take actions aimed at simplifying your interactions with apps. What sets Apple Intelligence apart from AI efforts from other companies is its focus on—and understanding of—your personal context. Apple Intelligence will know about your contacts, schedule, email, messages, photos, and much more.

The most significant use of Apple Intelligence will come with Siri, which will let us speak more naturally and understand what we mean if we make mistakes. We’ve trained ourselves to say only things Siri is likely to be able to handle, but that won’t be necessary when Siri gains Apple Intelligence capabilities. You’ll be able to search for photos of your child holding a fishing rod, for instance, or ask Siri to find something when you can’t remember if it was in Mail or Messages. Siri will also gain context awareness, so you can ask what the weather will be like at the beach tomorrow, and if the response is good enough, have it schedule a trip there. Siri will even know a lot more about your Apple devices and can help you use them. For the most part, though, Siri won’t have global knowledge. If Siri can’t answer your query directly, it will offer to send it to ChatGPT for free.

Apple Intelligence also includes writing tools, but unlike ChatGPT, it’s not aimed at creating text from scratch. Instead, it can rewrite text you’ve written to help you fine-tune the wording or adjust the tone to be more appropriate. It can also proofread text, helping you with grammar, word choice, and sentence structure (if you need this now, check out Grammarly). Even when Apple Intelligence does create text, such as the Smart Reply feature coming to Mail, it asks you questions to guide its response.

Text summarization powered by Apple Intelligence shows up repeatedly. In Notes, you’ll be able to summarize a transcription. If you save a long article to Safari’s Reader, it can provide a table of contents and summary. In Mail, instead of the first few sentences appearing in the message list, you’ll get a short summary. Apple Intelligence can even prioritize and summarize notifications.

Unsurprisingly, Apple Intelligence lets you create and edit images, but it’s a far cry from the AI artbots that let you create photo-realistic images. Instead, Apple Intelligence lets you create custom emoji, called Genmoji, which let you express yourself graphically in ways that standard emoji can’t support. Image Playground lets you create images for inclusion in conversations and documents, but it limits you to three styles: Sketch, Illustration, and Paint. Apple doesn’t want anyone making deepfakes with Apple Intelligence. A new Image Wand feature in Notes even turns your rough sketches into polished images.

Apple took great pains to emphasize the privacy aspects of Apple Intelligence. Most Apple Intelligence tasks will take place entirely on your device, hence the need for powerful Apple silicon chips with their Neural Engines and Secure Enclaves. Some tasks require more processing power; to handle those, Apple has developed a highly secure system called Private Cloud Compute. It relies on Apple silicon servers, transfers only the data necessary to the task, and stores nothing.

Apple Intelligence features will start arriving in the fall and continue to roll out in feature-release updates over the next 6–8 months. They will run only on the iPhone 15 Pro, iPhone 15 Pro Max, and iPads and Macs with M1 or later chips. Intel-based Macs and less-powerful iPads and iPhones need not apply. Apple Intelligence will also require Siri and the device language to be set to US English in the early releases, with other languages to follow.

Overall, Apple appears to have put a great deal of thought and effort into integrating AI into the Apple experience in focused, helpful ways that offer new capabilities while preserving user privacy. We won’t know how well these features will work until they ship, but we look forward to seeing how they can improve interactions with our Apple devices.

(Featured image by Apple)

Social Media: At yesterday’s Worldwide Developer Conference, Apple announced a treasure trove of new features in its upcoming operating system upgrades, including practical, everyday improvements and impressive AI-based capabilities.

Similar Posts

  • Watch What You Say in AI-Recorded Meetings

    You’re in a meeting with colleagues, and after everyone else has trickled out, you talk about a sensitive topic with a trusted friend….

  • _Dear Friends,_

    Vermont is back in the freezer as April becomes the most frustrating month for the Green Mountains. The days are longer, there is sun but it is too early to work in the garden. The roads are muddy and while the black flies haven’t awoken yet, it is hard to stay in the house but challenging to go outside.

    The iPad Pro 9.7-inch model has arrived at our stores and the initial sales have been strong. While this new iPad, at first glance, looks like the old iPad, once people start using it, playing with the Apple Pencil and realizing the advancements of this latest iPad they are hooked. Size-wise, I think that it might be ideal. The iPad Pro 12-inch model is, well it is big. The iPad mini is good for reading or checking your email abut the 9.7-inch iPad Pro is just right.

    I am very pleased to introduce the latest member of the Small Dog Team, Amy Farnsworth, who joins us as our Marketing and Design manager. Amy has strong marketing and graphic design background from her work in Utah and has recently relocated to Vermont with her husband. She says “I am a graphic designer, daydreamer, dog lover, wife, sister, best friend, Netflix junky & secret dad joke lover.” I think she will fit in fine! Please join me in welcoming Amy!

    This week’s Kibbles & Bytes exclusive features the Apple Certified Refurbished MacBook Pro. This is not a stripped down MacBook Pro but a fully-configured unit ready for your toughest challenges. It features the 2.8 GHz i7 intel processor, 16GB of ram, a 1TB hard drive and the NVIDIA 750M graphics chip driving the awesome “15-inch Retina display.”:http://www.smalldog.com/wag900002189 This Macbook Pro comes with the same 1-year warranty as new Macbook Pros but we are bundling it this week with Applecare that not only extends that 1-year warranty to 3-years but also extends your 90-days of free tech support from Apple to 3-years as well. “Kibbles & Bytes readers save $100 on this bundle at only $2925.98!”:http://www.smalldog.com/wag900002189

  • Get Organized!

    I have tried a lot of apps over the years for keeping ideas organized, assigning tasks or just keeping track of my goals. The problem I’ve found with many of the organizational applications is that I don’t find them easy to access. If you’re not on your phone or at your computer, often these applications can’t be utilized easily or have widely varied interfaces depending on which device your using.

    “**Trello**”:https://trello.com/ has become my new favorite go-to app for keeping ideas and tasks organized. Trello is a free app with the ability to also pay for upgraded features for minimal fees. Why do I love Trello so much? It’s simple, I can easily use it on my computer, my iPhone or my iPad. There is an app for all three of my devices, and each version works seamlessly with the others. Working with several staff members in different departments here at Small Dog can make keeping track of tasks and to-do lists a bit of a challenge, but this simple application has really helped to streamline things.

    I easily and quickly create what they call “boards”, each board then allows you to create individual categories to which you can then add individual tasks. Within my lists I can upload photos, files, web links, assign due dates and add notes. Once I have created a board, I can also easily share that board with co-workers or whomever I choose to share them with. Anyone I have shared a board with can also be granted access to update and add to the boards, add notes or more files.

    A feature many of us have come to really rely on are the updates that you get from Trello notifying you that someone has made a change. I have found just one complaint thus far about the application. There appears to be no feature to mark a task as completed while still leaving it on your board. You can easily archive tasks and even entire boards, but I prefer to still be able to see those tasks while clearly seeming them marked as completed. However, all in all, I find this to be an invaluable app and one that I utilize all of the time. I have tried and do use google docs and google drive, and I’ve installed those on my devices as well, but for me nothing beats the ease and convenience of Trello.

  • Do you use iCloud for Safari?

    With all the news surrounding the government’s attempt to force Apple to write software that doesn’t exist to crack an iPhone, iCloud has been in the news, too! Do you use iCloud? Apple has some huge server farms to support this amazing technology and I thought it would be good to do a brief review of some of the features as they relate to Safari.

    iCloud has sort of settled to the back of my mind because it just does its thing in the background and serves up features that I take for granted. But this week, I ran into a dilemma that puzzled me for some time. I noticed that I had accidentally deleted one of my folders in my Safari favorites bar. These were important bookmarks and I needed them back. Well, like a good boy, I have a Time Machine backup and quickly went back in time and restored my Safari bookmarks from a time before I had deleted them. Good stuff, but when I went to look the next morning, the folder was gone again. This happened a few times with me going back in time to get the .plist file. Then I figured it out – I had Safari active in iCloud so my bookmarks were being synced in the cloud. So, every time I restored it, it would eventually be overwritten by iCloud. The solution? Really sort of simple, I turned off Safari in iCloud preferences and turned it back on, problem solved.

    Activating Safari in iCloud gives you some great tools. You can start browsing on your iPad and pick up seamlessly from your Mac or you iPhone. It syncs your bookmarks and tabs and if you also use iCloud Keychain it will remember all those passwords for the websites you visit. If you use the reading list function of Safari it will also keep those current across your devices.

    As with the other features of iCloud, the features only work if you are signed on with the same Apple ID on all of your devices. It won’t know that you are signed onto one AppleID with your Mac and another with your iPhone. Most common issues with iCloud come down to this simple issue. Apple has not made it easy to merge Apple IDs so at least for iCloud you should be consistently using the same Apple ID. Open the iCloud System Preference on your Mac and choose Safari to activate iCloud on your Mac or go to the iCloud Setting on your iPhone or iPad to activate.

    You can also access the Safari tabs that you have open on your Mac on your iPhone or iPad. It is a bit different looking on the iPhone or iPad. Open Safari on your iPhone or iPad and then tap the tabs icon. You will see all of your open Safari windows but if you scroll down at the bottom will be all the tabs open on your Mac and you can click on any of those to make it active.