iOS 17 introduced a new synonyms API to the App Intents framework. Developers can provide an array of synonyms on their AppEntity or AppEnum cases, which is supposed to give users more flexibility with their spoken App Shortcut phrases. But in my experience, these synonyms are not actually recognized by Siri or Spotlight.

Headed to Cupertino next week for a session on Apple Intelligence, Siri, and App Intents at the new Apple Developer Center!

Some audio highlights of the Blue Angels' pilots during their Seafair rehearsal yesterday.

Signal path:

- Uniden Bearcat BCD536HP radio scanner with WiFi dongle

- Siren, Uniden’s control app for iPad (last updated 9 years ago but able to install on M1 Mac!)

- Audio Hijack by Rogue Amoeba

- iZotope RX Spectral De-noise

First time trying out Audio Hijack’s new Transcribe block (still in beta) – powered by OpenAI’s Whisper.

inaudibleinaudibleinaudible inaudibleinaudibleinaudible (static) (Growl) (Growl) (Growl) (Growl) (Growl) (Growl) (Growl) (Growl) (Growl) (Growl) (Growl)silence

Voice is sound.

Meet Art Museum, my first iOS app. Explore artwork from The Met, Art Institute of Chicago, and Cleveland Museum of Art. With a swipe. Or with your voice.

It’s powered by SwiftUI, App Intents, and CloudKit from Apple – along with open access data and imagery – published by these museums under Creative Commons Zero (CCO) to encourage download, remix and reuse.

Two years ago at WWDC22, Apple introduced App Intents.

An app intent represents something people can do inside of your app, and it makes it possible to do it from outside of your app.
– WWDC2022, Platforms State of the Union, Ari Weinstein, Shortcuts Engineering Manager

I’d been building with Alexa for five years, making conversational sound on smart speakers. The launch of App Intents electrified my focus and creative energy – so I charted a new course. I joined the Apple Developer program, started learning Swift, and dove into Apple’s APIs across speech, language and sound.

Art Museum is from Just By Speaking – a new imprint in Seattle exploring the canvas outside of your app.

WWDC Day 3 Labs: App Intents/Siri this morning and Design consult this afternoon. Stoked for both.

WWDC Labs are great. I got detailed feedback from the accessibility design team, including from a visually impaired person on my VoiceOver implementation.

Very much missing the official WWDC Slack this year. Mostly because it brought a strong sense of community. And it was a trove of knowledge nuggets and inspo.

Today I’m building a pipeline to describe all of Art Museum’s images using the vision capability of GPT-4o. This will enable a better VoiceOver experience for blind and low vision users.

Untangling and decoupling a few SwiftUI views that have become way too large.

Making some Art Museum enhancements today based on people’s feedback. Thank you people!

It fills me with sonic nerd joy knowing the Core Audio headers date back to 1985.

As a hip hop producer, we dug in the crates. We playing these vinyls and the part where there's no vocal, we pull it, we sample it, and we create an entire song around that. So right now we digging in the infinite crate. It's endless.
– Wyclef Jean on making music with AI

someone wearing Vision Pro

my mom: Oh! is that AI?

📸 Day 30: Hometown

📸 Day 29: Drift
📍Shi Shi Beach, Makah Reservation, 2023
📱11 Pro Max

📸 Day 28: Community
📍Beacon Food Forest, Seattle, 2024
📱15 Pro Max

📸 Day 27: Surprise
📍Dartmoor Otter Sanctuary, UK, 2022
📱11 Pro Max

📸 Day 26: Critter
📍Spring in Seattle, 2024
📱15 Pro Max

📸 Day 25: Spine
📍Koreatown, LA, 2015
📱6 Plus

📸 Day 24: Light
📍Paris, 2023
📱11 Pro Max

📸 Day 23: Dreamy
📍Little Bangladesh, LA, 2013
📱5

📸 Day 22: Blue
📍Museum of Flight, Seattle, 2022
📱11 Pro Max

📸 Day 21: Mountain
📍The Rockies, Colorado, 2018
📱7 Plus