591: That's Why I Like Computers
00:00:00
◼
►
Hey everybody, we're live from California in a hotel room. Good to be back, gentlemen.
00:00:05
◼
►
We're here, we're looking at each other. It's a little creepy because we haven't done this in a long time.
00:00:10
◼
►
We've got a table? We've never had a table before.
00:00:12
◼
►
Yeah, we're here and yeah, we have a couple of hours to talk and we'll go until we drop dead.
00:00:20
◼
►
You know, all of us are still mostly on Eastern Times, so we'll see how well this goes.
00:00:24
◼
►
Why is Casey so much louder than me?
00:00:27
◼
►
Because Casey just enunciates more than you.
00:00:29
◼
►
I know, but you've got to turn me up then.
00:00:31
◼
►
Alright, I got it, I got it. I'll turn Casey down.
00:00:34
◼
►
Especially if you're going to use a live mix.
00:00:35
◼
►
I mean, yeah.
00:00:37
◼
►
You're not going to be able to correct it. I'm going to shove this microphone into my face here.
00:00:40
◼
►
Don't do that, no, I can just do it.
00:00:42
◼
►
I got you, I got you. You're up to 50 decibels, that should be funny.
00:00:46
◼
►
I'm old and tired. Once I start yelling, it'll probably be better.
00:00:49
◼
►
That'll happen eventually.
00:00:50
◼
►
Give it time.
00:00:52
◼
►
I'm going to put a locking wheel nuts on this podcast.
00:00:53
◼
►
You'll hear about it.
00:00:57
◼
►
I have a lot of hard dynamic range. HDR. I'm at HDR.
00:01:00
◼
►
Casey has already gone through a compressor. Everything's the same.
00:01:03
◼
►
My whispers are low and my under the breath jokes are low, but then I get excited and I'm loud.
00:01:09
◼
►
That's what you got to deal with.
00:01:10
◼
►
We're off to a real off-space story.
00:01:12
◼
►
That's why people like vinyl, that's why people like me.
00:01:14
◼
►
Did you see my socks? Did you see my socks? Look at this. I know this is terrible audio content.
00:01:18
◼
►
It's supposed to be records, but they're all warped because it's on a sock.
00:01:21
◼
►
Then it's even more fitting.
00:01:23
◼
►
It's exactly like the real thing.
00:01:27
◼
►
I apologize for being in person.
00:01:28
◼
►
To see Casey's socks.
00:01:29
◼
►
I have my shoes off too.
00:01:32
◼
►
Yeah, I'm just flat gray.
00:01:33
◼
►
Oh, you have the white champion.
00:01:34
◼
►
You have the boring champion white. I got the flat gray Adidas.
00:01:37
◼
►
I got a great tie.
00:01:38
◼
►
It's such a mess.
00:01:40
◼
►
This is what the bootleg pays for. Sock comparisons.
00:01:43
◼
►
So only you could smell our feet.
00:01:47
◼
►
Yeah, right.
00:01:48
◼
►
Yeah, we're walking around in the California June heat all day.
00:01:51
◼
►
I'm sure they smell fantastic.
00:01:53
◼
►
Is this a show? Is this what people come in for?
00:01:56
◼
►
Okay. I got to tell you.
00:01:57
◼
►
So we're at a circular table, right?
00:01:59
◼
►
The table is, I don't know what you want.
00:02:01
◼
►
It's three, four feet across.
00:02:02
◼
►
So like a meter ish for those of you who have other units.
00:02:06
◼
►
And I had set a capped water bottle on the table between my computer and John's.
00:02:12
◼
►
That water bottle was on the table for three and a half seconds before John,
00:02:16
◼
►
which he's now doing again because I was demonstrating.
00:02:18
◼
►
They can't see you.
00:02:19
◼
►
Well, earlier today, earlier today, we were, we were sitting on,
00:02:24
◼
►
on the ground outside of the Steve Jobs theater lobby,
00:02:28
◼
►
trying to watch the state of the union.
00:02:29
◼
►
And we were watching it like there were a big group of us around
00:02:32
◼
►
and we were watching it on my laptop.
00:02:33
◼
►
I put my laptop on the ground and just had the screen going
00:02:36
◼
►
and the speakers up and everything.
00:02:37
◼
►
And I, and Casey had placed a can of Diet Coke within a foot of my laptop.
00:02:43
◼
►
Oh, easily three or four inches.
00:02:45
◼
►
And I took a picture of it.
00:02:46
◼
►
Oh no, I didn't know that.
00:02:48
◼
►
Because I thought if this spills onto my laptop,
00:02:51
◼
►
I'm going to want to have this picture.
00:02:54
◼
►
Just in case.
00:02:55
◼
►
Fortunately, I'm very lucky that Casey, in fact,
00:02:59
◼
►
noticed this was a problem and a few minutes later moved it himself.
00:03:01
◼
►
He moves it another foot away or so.
00:03:03
◼
►
My laptop survived being near Casey drink for a few minutes.
00:03:07
◼
►
Yeah, because we would have had no recording today if that had happened.
00:03:10
◼
►
And I don't know other computers in this room.
00:03:13
◼
►
You're right.
00:03:13
◼
►
It could have happened.
00:03:14
◼
►
I don't have two ports.
00:03:20
◼
►
We should probably get the show on the road.
00:03:21
◼
►
We have a lot to talk about.
00:03:22
◼
►
So John, the ruling is no follow up.
00:03:24
◼
►
Is that correct?
00:03:26
◼
►
So WWDC 2024.
00:03:31
◼
►
We are all here as we've mentioned.
00:03:33
◼
►
I'm very excited for it.
00:03:34
◼
►
I think I'd mentioned on the show, I was exceedingly anxious and nervous about travel.
00:03:39
◼
►
And I will just suffice to say there was no travel issues.
00:03:42
◼
►
Everything worked out.
00:03:42
◼
►
I'm a big baby, you know, same as it ever was.
00:03:45
◼
►
So we're all here.
00:03:46
◼
►
We're sound.
00:03:47
◼
►
And we got to the Apple Park, you know, like entry way.
00:03:51
◼
►
And we went through and it was all amazing.
00:03:53
◼
►
And, you know, John and I are eyes are as big as saucers because, you know, we've never
00:03:56
◼
►
seen this before.
00:03:57
◼
►
John is now plucking a piece of dust off of my life.
00:04:00
◼
►
You don't have to give a play of a play of everything I've been doing.
00:04:02
◼
►
I'm just proving your life.
00:04:03
◼
►
So I can't do it remotely.
00:04:06
◼
►
I've missed you guys so much.
00:04:08
◼
►
So we go and we got to visit with some other press people, which was awesome.
00:04:13
◼
►
It was so lovely for me, at least.
00:04:16
◼
►
I presume it's the same for both of you guys, but it was so lovely having that time where
00:04:21
◼
►
we were upstairs above where the actual event happens and they served us like breakfast
00:04:25
◼
►
and whatnot.
00:04:26
◼
►
And we had some time to just visit with a lot of our peers and friends and it was just very,
00:04:30
◼
►
And we had a couple hours of that.
00:04:33
◼
►
And then the show started with what I thought and admittedly, I am so giddy about everything
00:04:38
◼
►
that's happening right now that I'm going to love everything.
00:04:40
◼
►
But I thought it was a hilarious video of Hair Force One and Schiller and a bunch of
00:04:47
◼
►
the other presenters in a plane, skydiving out of the plane.
00:04:51
◼
►
I loved when Craig Federighi put the helmet on.
00:04:55
◼
►
That was his own hair.
00:04:57
◼
►
The helmet was in the shape of his own hair.
00:04:59
◼
►
It made me laugh quite a bit.
00:05:00
◼
►
Yeah, that was fun.
00:05:02
◼
►
I loved the video.
00:05:02
◼
►
Although I will say, first of all, it was amazing that everyone else's hair was getting
00:05:07
◼
►
blown around except Craig's.
00:05:08
◼
►
That's got to stay in place, right?
00:05:11
◼
►
I also loved having Schiller as the pilot.
00:05:15
◼
►
But he could not have looked less happy to be there.
00:05:18
◼
►
Also, he's supposed to look old and cranky.
00:05:20
◼
►
I was kind of surprised I didn't bleep him because his line is, I'm getting too old for
00:05:24
◼
►
And he said, stuff.
00:05:26
◼
►
An Apple video.
00:05:28
◼
►
But you know, Phil didn't want to say that.
00:05:29
◼
►
Then it had him using a click wheel iPod, which that was cute.
00:05:32
◼
►
And not his age is in spirit.
00:05:35
◼
►
No, since he came up with the click wheel, you remember?
00:05:38
◼
►
Oh, that was, oh, I don't think I know.
00:05:39
◼
►
It was at a meeting, Phil Schiller, but it's public knowledge.
00:05:42
◼
►
He said it somewhere that it was his idea to have a rotating wheel on the iPod.
00:05:46
◼
►
Oh, that's cool.
00:05:47
◼
►
So that's his little feather in his cap.
00:05:48
◼
►
And he's the grizzled old veteran there.
00:05:51
◼
►
I think this video, what I liked about it is that it didn't try to be too corporate,
00:05:58
◼
►
too over the top, too high production.
00:06:01
◼
►
It was just like a relatively short, relatively light, cute video, just about the event and
00:06:08
◼
►
a couple of fun execs.
00:06:08
◼
►
And then that was it.
00:06:09
◼
►
Like there was no major statement they're trying to make.
00:06:12
◼
►
They're not trying to be grand and show off how amazing everyone's lives are being saved
00:06:17
◼
►
It was just a nice, simple intro to a developer show.
00:06:20
◼
►
That video could have been made 10 years ago and we would have, well, everyone would have
00:06:24
◼
►
a little bit less gray hair, but not that I could be talking, but I feel like that was
00:06:29
◼
►
more of the spirit of the event than I think many of their more recent efforts with these
00:06:34
◼
►
like preproduced fancy videos that have been very much like just very overproduced,
00:06:39
◼
►
very like over polished, over corporate, over the top.
00:06:41
◼
►
I like this.
00:06:42
◼
►
This was a good fit for the event.
00:06:44
◼
►
One thing you missed out on if you weren't here live, like we were, yay, is the two minutes
00:06:48
◼
►
when Tim Cook and Craig come out on stage and just for the live people, you don't see
00:06:53
◼
►
this in the movie.
00:06:54
◼
►
And Craig introduced it by saying, and we have so much to announce today, we don't have
00:06:58
◼
►
time for one of our normal videos where we have this all over.
00:07:01
◼
►
So it's no over the top video, no silly things or whatever.
00:07:04
◼
►
We're just going to get right to the facts.
00:07:06
◼
►
And I think that intro helped like the undercutting, it helped to make that video land better because
00:07:11
◼
►
I was thinking if I had seen this video at home without hearing Craig's enter, I'd be
00:07:14
◼
►
like, oh, another one of these Apple things where they pretend they're secret agents and
00:07:18
◼
►
But because he undercut it so thoroughly and so well live that when it started playing
00:07:22
◼
►
it, it showed them jumping out of a plane.
00:07:24
◼
►
And it was, it's so clearly like ridiculous and self-deprecating.
00:07:27
◼
►
They're now parodying themselves.
00:07:29
◼
►
And that is a much better look than let's say crushing trombone and a hydraulic press.
00:07:35
◼
►
I mean, it was huge dad energy, but here we are three dads.
00:07:38
◼
►
So I loved it.
00:07:39
◼
►
But yeah, they went just broadly and we'll obviously pick apart everything, but broadly
00:07:45
◼
►
they went real fast and it was apparent pretty quickly that they were moving with a quickness.
00:07:50
◼
►
And you know, we were sitting next to each other.
00:07:52
◼
►
And I had Jason Snell to my right and Jason pointed out to me, like they're rounding out
00:07:59
◼
►
the main like stretch of content.
00:08:02
◼
►
And it was like, it was 11 o'clock Pacific or something like that.
00:08:05
◼
►
They said that on the intro, they have the, the, the parachutes open, had the name of
00:08:08
◼
►
the OSS and they said, we're going to do all of our OSS before we get onto the other stuff.
00:08:11
◼
►
They had something like that.
00:08:12
◼
►
And again, forgive people listening at home.
00:08:14
◼
►
Like you may have had time to review the keynote video.
00:08:16
◼
►
We have not, we've been busy all day, but yeah, there was an interesting approach to
00:08:20
◼
►
just say, you know, the parachutes have the OSS.
00:08:22
◼
►
They're going to go through all the OSS and they mentioned AI features, but they always
00:08:26
◼
►
said like machine learning.
00:08:27
◼
►
You made notes of it at a couple of times.
00:08:28
◼
►
They would say, oh, there's a machine learning feature this, that, but you know, anyway,
00:08:31
◼
►
we'll get to the big, uh, the big AI stuff at the end.
00:08:34
◼
►
But they, they wanted to get their OSS out of the way, but there was so much content.
00:08:38
◼
►
Like Casey was trying to take notes on it and I was trying to help and it was going
00:08:42
◼
►
We couldn't keep up with typing.
00:08:44
◼
►
It was, it was incredible.
00:08:45
◼
►
So, uh, moving through, oh, do we want to do like an overview upfront or we just want
00:08:50
◼
►
to plow through it.
00:08:50
◼
►
We got an order.
00:08:52
◼
►
So, uh, well, excuse me, Apple TV plus.
00:08:55
◼
►
That's right.
00:08:56
◼
►
I literally, I took a break during the TV plus promo to write an email.
00:08:59
◼
►
I'm like, I had to send this email to him this morning.
00:09:02
◼
►
I'm like, this seems like a good time.
00:09:04
◼
►
I'm excited about those shows, but I don't want to be spoiled on them.
00:09:07
◼
►
You don't like, I'm going to watch the new season of severance and silo no matter what
00:09:10
◼
►
you show me.
00:09:11
◼
►
So I was kind of trying to avert my eyes, but yeah, that was there.
00:09:13
◼
►
It was the thing.
00:09:14
◼
►
It was apparently fifth anniversary of Apple TV plus.
00:09:16
◼
►
So there was that.
00:09:16
◼
►
Honestly, I mean, look, TV plus, I think it has turned out pretty well.
00:09:19
◼
►
It's a great service.
00:09:20
◼
►
There's a lot of great content on there and it got exactly as much time during a developer
00:09:25
◼
►
keynote as I should have.
00:09:26
◼
►
I mean, that's pretty good.
00:09:27
◼
►
I would argue that I might be zero, but yeah, well, yeah.
00:09:29
◼
►
Although I will say so a little inside baseball and I'm not,
00:09:32
◼
►
I can't resist because it's my first time.
00:09:34
◼
►
It was definitely loud during, during the like big cut sequences.
00:09:40
◼
►
We should have used Margo's at concert head clubs.
00:09:41
◼
►
That's true.
00:09:42
◼
►
I didn't even think about it.
00:09:45
◼
►
It's so true, but all my word, it was so loud during anything that was like, not just somebody
00:09:50
◼
►
talking at you.
00:09:51
◼
►
It was astonishingly loud.
00:09:52
◼
►
It was very clear though.
00:09:53
◼
►
I have to say it was so clear that like, because actual live Tim Cook comes out on stage and
00:09:58
◼
►
talks into a microphone and then recorded Tim Cook came and they sounded exactly the
00:10:02
◼
►
That's true.
00:10:02
◼
►
So anyway, so vision OS, like Mark, what's that a moment ago?
00:10:06
◼
►
So Mike Rockwell comes out, uh, 1.5 million compatible apps.
00:10:09
◼
►
I think it was Ben McCarthy had sent me a screenshot of what appeared to be a little
00:10:14
◼
►
baby call sheet icon somewhere in the mass.
00:10:17
◼
►
I was looking for it.
00:10:18
◼
►
It was hard.
00:10:18
◼
►
I was looking for it.
00:10:19
◼
►
I couldn't tell, but we were seated relatively far away from the screen, which that sounds
00:10:24
◼
►
like a complaint.
00:10:25
◼
►
It actually wasn't.
00:10:25
◼
►
It was chosen deliberately.
00:10:26
◼
►
We wanted to be in the shade because we wanted to be in the shade.
00:10:29
◼
►
So we were seated fairly far back and I tried to look and I haven't had the chance to go
00:10:33
◼
►
Like one of you just said to look at the video and see it.
00:10:35
◼
►
But, uh, that would be my first keynote appearance if, if that's, if that's what happened.
00:10:39
◼
►
So that's extremely exciting.
00:10:41
◼
►
No, they had that.
00:10:42
◼
►
Well, I guess, I guess the ATP podcast was in a session.
00:10:45
◼
►
That's true.
00:10:46
◼
►
That's the keynote.
00:10:47
◼
►
Not on the keynote.
00:10:47
◼
►
Um, so anyway, so one half million compatible apps.
00:10:50
◼
►
And then we had a Haley Allen come out to talk about just vision, vision, West improvements.
00:10:55
◼
►
Um, I'm trying to just skip over the stuff.
00:10:57
◼
►
That's not that exciting.
00:10:58
◼
►
Go to the stuff that I find exciting.
00:10:59
◼
►
First of all, iOS.
00:11:02
◼
►
Well played.
00:11:02
◼
►
But, but still, uh, so yeah, so converting 2d images into 3d using quote advanced machine
00:11:09
◼
►
I thought that was very cool.
00:11:10
◼
►
Yeah, we'll see how it works.
00:11:12
◼
►
It may be garbage.
00:11:13
◼
►
It may be great.
00:11:13
◼
►
I mean, it's just gotta be the subject detection, right?
00:11:16
◼
►
And trying to figure out like, you know, how much depth certain subjects would naturally
00:11:20
◼
►
have and maybe what the side of their head might slightly look like.
00:11:23
◼
►
I mean, they're not, they're not the first for people to try to do this.
00:11:26
◼
►
It's going to be a little weird.
00:11:28
◼
►
I'm sure it will be fine if they do it with great subtlety.
00:11:31
◼
►
It should be fine in most cases.
00:11:33
◼
►
Like, uh, Facebook, I think I've never actually used like this feature, but I believe it has
00:11:38
◼
►
something where you can take a 2d video and it'll do like a parallax effect between the
00:11:43
◼
►
foreground and the background.
00:11:44
◼
►
I presume to, to y'all's point that it's something like that.
00:11:46
◼
►
Um, they did mention, and I forget exactly how they were, um, how they were describing
00:11:51
◼
►
it, but the gist of it was it's very annoying sometimes to, to try to figure out the battery
00:11:57
◼
►
level and the time on vision OS.
00:11:59
◼
►
What you're supposed to do today is you look up, up, up, up, up, up, up, and there's like
00:12:03
◼
►
a little gray circle with a down Chevron, and then you do a pinch gesture and that'll
00:12:07
◼
►
drop down like control center, whatever.
00:12:09
◼
►
And they say that what you can do is you can flip your hand.
00:12:12
◼
►
So your palm up and that'll, it'll detect that and show like time and battery.
00:12:16
◼
►
And then you can flip your hand over for control center, which if that works well, I think
00:12:20
◼
►
that'll be really neat.
00:12:21
◼
►
And the home gesture too.
00:12:22
◼
►
Like that was the thing, because right now to go home, you have to reach your hand up
00:12:25
◼
►
to the physical digital crown on the headset and push it.
00:12:29
◼
►
And then with this, now that you can just have your hand palm up and squeeze together,
00:12:32
◼
►
I think there's something, there's some kind of gesture as the home button, which that's
00:12:36
◼
►
a good improvement.
00:12:36
◼
►
Um, you know, vision OS, the more you can avoid constant hand motion, you know, the
00:12:40
◼
►
less fatiguing it will be over time for all the control center thing.
00:12:44
◼
►
Like they put it up high, like it's a balance.
00:12:45
◼
►
They don't want it to be in your eye line.
00:12:47
◼
►
So you accidentally trigger it, but then they don't want it to be too high.
00:12:50
◼
►
So it's annoying.
00:12:51
◼
►
But it is like, it's kind of important for it to be out of the way.
00:12:53
◼
►
And that's why I think it's annoying to go cause the people you don't look up that with
00:12:57
◼
►
your eyes, especially with your eyeballs.
00:12:58
◼
►
Cause you can't just look up with your head.
00:12:59
◼
►
Well, I guess you can, but it's just, no, if you look up with your head, you still got
00:13:03
◼
►
to look up with your eyes.
00:13:04
◼
►
It's, it's intentionally inaccessible and the hand gestures seem great.
00:13:07
◼
►
Although I do wonder if they're kind of, kind of like how you burn, like a, you know, a
00:13:11
◼
►
command click or whatever in an app.
00:13:13
◼
►
Like how many hand gestures are they going to have us doing by year five of this thing?
00:13:17
◼
►
We're making the spells from the one.
00:13:18
◼
►
I was going to say the same thing.
00:13:20
◼
►
It's so true.
00:13:21
◼
►
So, all right.
00:13:21
◼
►
So in the interest of moving along quickly, Mac virtual display, getting some big updates
00:13:24
◼
►
later this year, which I am genuinely super excited about.
00:13:28
◼
►
I I'm not using my vision pro that frequently, although it did on the plane on the way here
00:13:32
◼
►
and it was wonderful.
00:13:33
◼
►
But one of the things I do love about it is Mac virtual display.
00:13:36
◼
►
And they're saying that again, it was going so fast.
00:13:40
◼
►
I might be flubbing the details and that's true of basically everything we're about to
00:13:42
◼
►
talk about for the next hour and a half.
00:13:44
◼
►
But they said it was a much higher display resolution and size.
00:13:48
◼
►
And they said something along the lines of it's the equivalent of two 4k screens.
00:13:53
◼
►
But the way it was presented was like one just obscene ultra wide, like PC, PC ultra
00:14:00
◼
►
wide monitors, but a virtual version.
00:14:01
◼
►
It's basically like, you know, eight K by two K or whatever.
00:14:04
◼
►
And what was interesting about this was they made brief mention that what's happening here
00:14:09
◼
►
to make this work and look OK is that they're doing the dynamic foveation stuff that they
00:14:14
◼
►
do for the entire OS for vision OS that is, but they're doing it for Mac virtual display
00:14:20
◼
►
So I guess they're live transmitting where your eyes are looking so that so that the
00:14:25
◼
►
Mac will render.
00:14:25
◼
►
I think they're doing that for bandwidth reasons because then they don't have to send the full
00:14:29
◼
►
resolution display to the headset.
00:14:31
◼
►
They can just, they can send a crappier version, but with a higher res of where you're looking,
00:14:34
◼
►
which allows them to, I don't know what the limitation is.
00:14:37
◼
►
It's like, is it a video memory or something or whatever the M2's limits are, but it's
00:14:41
◼
►
clear that if they could have just said, okay, well just, you got a bigger screen now and
00:14:45
◼
►
just not deal with this, they would have done it.
00:14:46
◼
►
This is more complicated.
00:14:47
◼
►
So yeah, yeah, very much so.
00:14:48
◼
►
And then it was funny.
00:14:49
◼
►
I have not looked at Mastodon all day, but I did see a handful of people send me a text
00:14:53
◼
►
as soon as they mentioned that train support is now support will be supported in travel
00:14:57
◼
►
I, I, it's hilarious to me that an American of all people is the one who is known for
00:15:01
◼
►
using the vision pro on the train, but here I am.
00:15:04
◼
►
I mean, only Americans can buy it.
00:15:06
◼
►
So that's good point.
00:15:07
◼
►
I take it all back.
00:15:08
◼
►
Although soon there'll be opening another country.
00:15:10
◼
►
Yeah, that's true.
00:15:10
◼
►
I mean, yeah.
00:15:11
◼
►
And so actually we can, we can jump right over there.
00:15:13
◼
►
I mean, it's just very quickly.
00:15:14
◼
►
There's apparently going to be a physical lens for certain Canon cameras.
00:15:17
◼
►
I don't know, Marco, if you call it, which models for the EOS R7, Canon has this whole
00:15:22
◼
►
new line of the mirrorless cameras that replace other big ones.
00:15:24
◼
►
The R7 is one of the big great ones.
00:15:26
◼
►
And there's a new Canon spatial lens that will allow native spatial video capture.
00:15:31
◼
►
They say Final Cut Pro for Mac can edit it.
00:15:34
◼
►
They said specifically for Mac, so I guess too bad for the iPad people.
00:15:37
◼
►
And it's viewable in the new Vimeo app for Vision OS, which is interesting.
00:15:41
◼
►
And then they also announced some deals integration with Blackmagic and DaVinci Resolve
00:15:46
◼
►
for Apple immersive video.
00:15:48
◼
►
That's the 180 degree field of view with the 8K res for production of that.
00:15:53
◼
►
So they're basically, and then they said there's new Apple immersive video content on the way.
00:15:59
◼
►
So we will very slowly have new stuff coming to the vision pro.
00:16:03
◼
►
I mean, and what's interesting too is like almost everything else we're going to talk
00:16:07
◼
►
about is like they were very clear.
00:16:09
◼
►
They kept saying that, you know, all these like new features and everything are coming
00:16:12
◼
►
to quote a Mac, iPhone and iPad.
00:16:15
◼
►
It was very clear.
00:16:18
◼
►
None of this stuff is coming to Vision OS, at least not yet.
00:16:20
◼
►
And the only reason I can think like it has the hardware, it has an M2 and that's, you
00:16:25
◼
►
know, they, it goes down to M1 iPads and Macs.
00:16:28
◼
►
So we know it's, it's like, you know, the hardware is compatible.
00:16:31
◼
►
So I guess the only reason is like, they just haven't gotten to it.
00:16:34
◼
►
I think those code bases are just too far diverged.
00:16:37
◼
►
Like if you think about photos and vision, no S that's not a shared code base with the
00:16:41
◼
►
other platforms.
00:16:43
◼
►
When they made it, they knew they were going to have to unify shared ish, but it's, you
00:16:47
◼
►
know, they were so isolated for so long that there's enough of a divergence and they have
00:16:51
◼
►
to work on their 2.0 features that I under kind of understand why they didn't get, I'm
00:16:54
◼
►
assuming they will eventually as they converge further, but right now it kind of makes sense
00:17:00
◼
►
I think the vision pro user base such as it is probably really needs to see like signs
00:17:08
◼
►
of support from Apple.
00:17:09
◼
►
And I don't think they really got a lot of that today.
00:17:11
◼
►
I think they got a small amount of support, but all the cool features that they demoed
00:17:16
◼
►
for everything else, all their other platforms really are all their other major platforms.
00:17:20
◼
►
They like none of it's available for vision.
00:17:21
◼
►
It was, and I think that's, that's kind of a weird miss at this point.
00:17:24
◼
►
Well, the rumor was that they, that, you know, Craig Federi, he got religion about chat,
00:17:29
◼
►
GPT in 2022.
00:17:30
◼
►
So that gave all the other platforms two years to be figuring out how they're going to integrate
00:17:36
◼
►
And vision pro hadn't even shipped at that point is, but it's only been out for whatever
00:17:40
◼
►
four or six months.
00:17:41
◼
►
Like they're, they're just behind.
00:17:43
◼
►
I, I, you know, it's kind of a shame cause they really want to promote this.
00:17:47
◼
►
I knew that vision pro, I had it as the very first item in the schedule.
00:17:51
◼
►
I didn't predict that TV plus would be in there.
00:17:53
◼
►
You know, they want to talk about it cause it's their latest platform.
00:17:55
◼
►
But so your point, Marco, they had the least to say about it.
00:17:58
◼
►
It's not, it's not in on this party kind of like me with my Intel Mac.
00:18:02
◼
►
Well, just very briefly, I wonder if, cause obviously an M2 is on the surface, it supports
00:18:10
◼
►
all this new Apple intelligence stuff, which we'll talk about later, but I can't help but
00:18:13
◼
►
wonder, it seems like the vision pro is running at the edge of what the M2 is capable of just
00:18:19
◼
►
doing normal vision pro stuff.
00:18:21
◼
►
I almost wonder if there just wasn't enough, not literal bandwidth, but figurative bandwidth
00:18:25
◼
►
to like layer all this other stuff.
00:18:26
◼
►
It's got the R1 doing a lot of stuff there.
00:18:28
◼
►
Oh, that's true.
00:18:28
◼
►
That's a good thing.
00:18:29
◼
►
And the M2, I mean, the M2 is very strong.
00:18:31
◼
►
Like I don't think, I don't think that's the problem.
00:18:34
◼
►
I think it's just about like, they didn't, they just didn't have the time or the software
00:18:39
◼
►
I don't know, whatever it was.
00:18:40
◼
►
Half the apps that the AI stuff integrates with weren't even native.
00:18:43
◼
►
So maybe we'll get it.
00:18:47
◼
►
Well, we'll see.
00:18:48
◼
►
It should make it easier actually.
00:18:49
◼
►
Just here, run the iPad version.
00:18:50
◼
►
So anyway, so yeah, to wrap up vision pro, I tried to copy down the countries and when,
00:18:55
◼
►
and I failed miserably, so I don't have details.
00:18:57
◼
►
But suffice to say, there's a handful of countries sometime in the next couple of weeks.
00:19:02
◼
►
June 28th was China, Japan, and Singapore.
00:19:04
◼
►
And then July 12th was Australia, Canada, France, Germany.
00:19:07
◼
►
And then there was one of the one that I went to by too fast.
00:19:10
◼
►
We were right down.
00:19:11
◼
►
So I mean, this to me was a B, you know, like it was, it was good.
00:19:17
◼
►
There was nothing that really wowed me.
00:19:18
◼
►
There's nothing that made me think, oh, thank God this is going to change.
00:19:21
◼
►
And you think, again, we're talking about this a day off.
00:19:23
◼
►
There's gotta be more.
00:19:24
◼
►
They just didn't, they just didn't fit into the keynote.
00:19:26
◼
►
Once people install these betas in future episodes, we'll talk about how you can rearrange
00:19:29
◼
►
icons in the home screen or something.
00:19:31
◼
►
They just didn't make the keynote or whatever.
00:19:32
◼
►
Yeah, but this was, this was acceptable.
00:19:34
◼
►
Like I wasn't overly jazzed about this.
00:19:37
◼
►
I mean, I am pretty jazzed about Mac virtual display to be honest with you, but it didn't
00:19:41
◼
►
seem to take away any of the problems that people are having with vision OS in terms
00:19:45
◼
►
of how difficult it is for like text entry, for example.
00:19:47
◼
►
So we'll, we'll see what happens, but we.
00:19:49
◼
►
If you didn't like vision OS before, you still won't like it.
00:19:52
◼
►
If you liked it before you might, you have a few, a few improvements, some of which might
00:19:56
◼
►
mean a lot to you.
00:19:57
◼
►
Most of it probably won't.
00:19:58
◼
►
Yeah, exactly right.
00:19:59
◼
►
We are sponsored this episode, we're doing this live by Trade Coffee.
00:20:03
◼
►
Trade Coffee is a specialty coffee marketplace that matches customers with the best coffees
00:20:07
◼
►
from local roasters around the country.
00:20:09
◼
►
You just take a short quiz to share your preferences and trade matches you to personalized
00:20:14
◼
►
recommendations.
00:20:14
◼
►
It's a convenient way to experience small match specialty coffees and support small
00:20:18
◼
►
This coffee is roasted to order and ships to you within 48 hours.
00:20:23
◼
►
I have personally used Trade for a long time and I love the variety of beans that they
00:20:27
◼
►
send and they're so good.
00:20:28
◼
►
There's from all these roasters all across the country.
00:20:31
◼
►
You just tell them what you want in basic terms.
00:20:33
◼
►
Like, Hey, give me, you know, whole bean coffee.
00:20:34
◼
►
Give me a, you know, a pound every two weeks or, you know, whatever your terms are, they
00:20:38
◼
►
can accommodate what you want.
00:20:39
◼
►
They have different grinds, different, you know, light roast, dark roast, whether you're
00:20:43
◼
►
going to be brewing it hot or cold or, you know, espresso, they can optimize it for that
00:20:47
◼
►
trade just has it all.
00:20:48
◼
►
Coffee from Trade also makes a great gift.
00:20:51
◼
►
You cannot go wrong with giving someone the gift of great coffee.
00:20:54
◼
►
To me, the greatest secret of Trade is you just get fresh roasted beans.
00:20:59
◼
►
That is the best way to make fresh coffee at home.
00:21:00
◼
►
It's fresh roasted beans.
00:21:02
◼
►
It matters so much more than you think.
00:21:03
◼
►
Way more than how you're brewing them.
00:21:05
◼
►
Way more than, you know, whether they're from some mountain or, you know, like any detail
00:21:09
◼
►
you possibly think the fresh roasted is key and Trade has things roasted to order and
00:21:14
◼
►
shipped right to you so fast that it's always fresh.
00:21:17
◼
►
So it is a great service.
00:21:18
◼
►
Check it out today.
00:21:19
◼
►
Give Trade a try this summer.
00:21:21
◼
►
Right now they're offering 30% off your first order when you visit drinktrade.com/ATP.
00:21:28
◼
►
That's drinktrade.com/ATP for 30% off your subscription order.
00:21:34
◼
►
Drinktrade.com/ATP.
00:21:36
◼
►
Thank you so much to Trade Coffee for sponsoring our show.
00:21:39
◼
►
iOS 18, baby.
00:21:45
◼
►
So do we want to have a sidebar about the the Gurman rumor thing or do we want to put
00:21:52
◼
►
I'll tell you what.
00:21:52
◼
►
So I'm obviously leading up.
00:21:54
◼
►
Gurman always has lots of rumors, right?
00:21:55
◼
►
There was the he basically had a ton of info right beforehand.
00:21:59
◼
►
I didn't even look at it because I was at this point like we were so close.
00:22:02
◼
►
I think I was already on the plane when it came out and I'm like, I don't even I don't
00:22:05
◼
►
even want to be spoiled at this point.
00:22:07
◼
►
I'm close enough now.
00:22:08
◼
►
I'm like I'm in the mode.
00:22:09
◼
►
I'm in like the very like, you know, theatrical like I want to I want to see the performance.
00:22:13
◼
►
So, you know, I don't whatever he got like I've since heard afterwards.
00:22:18
◼
►
He has very impressive sourcing.
00:22:19
◼
►
Obviously, he he really is dominating the entire rumor game almost entirely by himself.
00:22:24
◼
►
I am glad that he provides us content throughout the year to talk about but when it comes down
00:22:30
◼
►
to like two days beforehand dumping an entire presentation, I don't I don't find a lot of
00:22:35
◼
►
value in that to be honest.
00:22:37
◼
►
So, you know, I recognize I'm not this is not the universal opinion of everybody who
00:22:41
◼
►
ever, you know, reads news sites and we've certainly been guilty of, you know, seeing
00:22:44
◼
►
these things ourselves and having fun with them sometimes but there's something like
00:22:48
◼
►
a certain limit on how much I want things to be spoiled and that that was that seemed
00:22:52
◼
►
like it was past it for me.
00:22:54
◼
►
Yeah, and that's fair.
00:22:55
◼
►
So anyway, so a lot of this we already knew if we had read the Mark Erman report but starts
00:23:01
◼
►
with the home screen.
00:23:02
◼
►
You can rearrange icons on springboard.
00:23:04
◼
►
So they had a picture of a dog.
00:23:06
◼
►
If I recall correctly, the dog's head is in like the upper left hand corner of the home
00:23:09
◼
►
screen as I'm sorry, the dog was like the background of the home screen or what have
00:23:13
◼
►
you dog's head is in the upper left.
00:23:14
◼
►
So Craig arranges, you know, icons.
00:23:17
◼
►
I think maybe there was a top row laterally and then there was a bunch of icons on the
00:23:20
◼
►
right hand side and some icons on the bottom and it seemed like it was relatively easy
00:23:26
◼
►
like whatever the new jiggle mode is.
00:23:28
◼
►
It seemed like whatever he did, he did it quickly in it.
00:23:31
◼
►
I don't think it was like a sequence is shortened sort of situation, although he didn't show
00:23:35
◼
►
how he picked up a bunch of app icons somehow and then he just showed him dropping a group
00:23:39
◼
►
The normal way where you grab one and then you tap a bunch of other ones and they join
00:23:42
◼
►
the group, right?
00:23:43
◼
►
He probably should have shown that just because most people don't even know you can do that.
00:23:46
◼
►
Yeah, it is kind of complicated.
00:23:47
◼
►
I mean, so we talk about the difficulty rearranging icons in the home screen and obviously people
00:23:51
◼
►
do want to leave spaces and they've been using spacer icons and this helps them for not.
00:23:54
◼
►
But if you can clear space on any of your screens, this should make it slightly easier
00:24:01
◼
►
to rearrange because one of the most annoying things is how they, whatever you do, it wants
00:24:05
◼
►
to fill the hole like it'll pull one from the previous screen and they all just want
00:24:09
◼
►
to like they just want to compress into this big, you know, like you can't leave holes.
00:24:14
◼
►
If you know you're going to put something in a spot, there's no way to leave that spot
00:24:17
◼
►
open and that makes it so difficult.
00:24:19
◼
►
And that's why, like when you, you know, you remove an icon, everything shuffles up and
00:24:23
◼
►
then one from the previous screen goes and shuffles in.
00:24:25
◼
►
I hope that what the way they've done it has made the icons less obsessed with being right
00:24:30
◼
►
next to each other or you can actually make holes because that's the point of this feature.
00:24:33
◼
►
And I know people want this, so, you know, good job in iOS 18, the 18th version of the
00:24:38
◼
►
phone operating system by allowing people to do something that they've been doing for
00:24:42
◼
►
years and years using blank icons.
00:24:45
◼
►
So they also announced that icons will darken in dark mode and the implication and from
00:24:51
◼
►
what little I've gleaned since the keynote is that this does not require developer input.
00:24:56
◼
►
Although I think we've since learned that that you can provide alternative versions
00:25:01
◼
►
of your icon and that additionally you can customize all of your icons collectively in
00:25:09
◼
►
one shot with a tint color.
00:25:10
◼
►
And again, now I'm not so clear what is what is what developer input is required for that
00:25:17
◼
►
or is or do they do it all magically?
00:25:19
◼
►
I think we had seen a screenshot that one of our friends had taken of like their home
00:25:24
◼
►
screen and with a red tint and that was with, you know, today's icon.
00:25:27
◼
►
So that makes me think you don't have to opt into it as a developer.
00:25:30
◼
►
That's right.
00:25:31
◼
►
Like it seems like you can opt in as a developer and provide them with separate icon assets
00:25:36
◼
►
that are maybe more optimized for it.
00:25:37
◼
►
But even if you don't, they will still do it anyway, which I think, you know, this is
00:25:41
◼
►
what we were saying the other week that we were saying like, wow, it kind of seems like
00:25:43
◼
►
that would be a bit risky with like big brand recognition and things, but they did it anyway.
00:25:48
◼
►
And so I think that's a it's a great move for users.
00:25:50
◼
►
Do we know if it's like every home screen when you pick this color?
00:25:54
◼
►
Is it per home screen?
00:25:55
◼
►
Because I had originally thought when this rumor I thought it was per icon, but that
00:25:58
◼
►
seems to be not the case, right?
00:25:59
◼
►
They only showed whole homes, home screens were like all the icons are right tinted or
00:26:03
◼
►
as far as I know, it's the entire screen, but it, but is it per like, if I go to a different
00:26:07
◼
►
page, we'll find out, but it's interesting.
00:26:08
◼
►
Like, and the way that it looked like they're doing it, I don't know if this is how they're
00:26:11
◼
►
doing it, but it looks as if they turned all the icons black and white and then all the
00:26:15
◼
►
things that were whitish become pinkish, become greenish, you know, whatever.
00:26:18
◼
►
Like that's what it looks like.
00:26:19
◼
►
If you don't have any sort of customization, that's how it tints your icons and that's
00:26:23
◼
►
not going to look great in some cases.
00:26:24
◼
►
And you know, it's like my, my main objection to this feature is that I just don't think
00:26:28
◼
►
it would be attractive.
00:26:29
◼
►
Like I think people should be able to change their icons, so whatever they want and they
00:26:33
◼
►
can with the stupid shortcut thing, which is annoying, just, you know, make whatever
00:26:35
◼
►
icon you want, make a shortcut.
00:26:37
◼
►
You can pick any icon you want.
00:26:38
◼
►
It would be nice if you could sort of just hold on an icon and say, I want to change
00:26:41
◼
►
this icon and here's what I want to change it to, but that's not really this feature.
00:26:46
◼
►
It's tinting it's developer support for, you know, custom icons for dark mode.
00:26:50
◼
►
And it's so you can give your home screens a theme and they, and it will pick the theme
00:26:55
◼
►
based on your background.
00:26:55
◼
►
If your background is yellowish, we'll make all your icons yellowish and so on.
00:26:59
◼
►
So I, you know, and apparently there's an Android feature that is very, very similar
00:27:02
◼
►
So it makes sense that they pulled this out because it's a kind of, I guess, switching
00:27:05
◼
►
Like people on Android are used to being able to do this now they can do it on iOS too.
00:27:09
◼
►
And I think if they did this in a very Apple way of like, you know, there, there's this
00:27:12
◼
►
whole industry out there of these apps that let people customize their home screens and
00:27:16
◼
►
they, they do it through, as we mentioned, you know, all these ridiculous hacks to get
00:27:20
◼
►
that, to be able to do per icon customization and, you know, to arbitrary icons.
00:27:24
◼
►
You know, you can, you can have all these apps that will help you install a really aesthetic
00:27:28
◼
►
theme for your home screen.
00:27:30
◼
►
And you can have this and it'll show you hundreds of things.
00:27:32
◼
►
You can buy packs of them and everything.
00:27:34
◼
►
And they work through all these, you know, terrible means.
00:27:36
◼
►
What Apple did here is not remove the need for all those apps and not remove their market
00:27:42
◼
►
What they did here was give you like the 20% solutions.
00:27:46
◼
►
Like here, if you want to customize your home screen, okay, we'll give you the, this very
00:27:50
◼
►
limited, like guardrailed safe way to do it.
00:27:53
◼
►
And we'll give you these, you know, these 10 options that you can pick or whatever.
00:27:57
◼
►
Although actually the free form color picker was nice, but like, you know, we're going
00:27:59
◼
►
to give you these, these very limited controls.
00:28:02
◼
►
You can do a small subset of customization.
00:28:04
◼
►
It's still very gated, very limited, very safe, but we will let you do this.
00:28:10
◼
►
And so that's going to be great.
00:28:11
◼
►
A lot of people are going to do that.
00:28:12
◼
►
And at the same time, it's not going to at all affect the market for the apps that go
00:28:15
◼
►
way further than that.
00:28:18
◼
►
I mean, we'll see what happens with it, but I I'm excited because it seems like there's
00:28:22
◼
►
a need for this or want for this, if nothing else.
00:28:24
◼
►
And now Apple satisfying it.
00:28:26
◼
►
You're going to make your whole home screen yellow?
00:28:28
◼
►
No, no, I'm not.
00:28:29
◼
►
But it would match your car if it did.
00:28:31
◼
►
Control center.
00:28:32
◼
►
So you're going to be able to swipe vertically between different pages.
00:28:36
◼
►
And what I thought was most interesting is that, and this is the beginning of, I feel
00:28:40
◼
►
like we heard a lot about the Intents API in several places that it becomes important.
00:28:44
◼
►
And I think Marco, you had said over the last few weeks or months that you saw this, you
00:28:49
◼
►
know, this, the tea leaves pointing this way and it sure seems like you were dead, right?
00:28:53
◼
►
So anyways, third parties can donate controls to control center, which is really, really
00:28:58
◼
►
So the canonical example that they used was like, Hey, if you have a Ford and you can
00:29:02
◼
►
unlock your Ford remotely, well, if the Ford app supports it, you can have a control center
00:29:08
◼
►
icon that, that is unlock my car.
00:29:11
◼
►
And then they additionally said that lock screen controls are now going to be swipeable.
00:29:17
◼
►
And which I think is very interesting and exciting.
00:29:20
◼
►
And while that, although I don't remember if it was mentioned here, while I'm thinking
00:29:23
◼
►
of it, another thing that they mentioned at some point today was that third party camera
00:29:27
◼
►
apps, there will be an API to have a third party camera app work while the phone is locked.
00:29:33
◼
►
And that is tremendous news for my dear friend, Ben McCarthy.
00:29:37
◼
►
And, you know, a lot of other people who have third party camera apps, because that is a
00:29:41
◼
►
real stumbling point because the fastest way to use a, a, or the fastest when you're trying
00:29:46
◼
►
to take a photo, you want to do it immediately, right?
00:29:48
◼
►
And you can don't want to unlock your phone and blah, blah, blah.
00:29:50
◼
►
So that's really exciting as well.
00:29:51
◼
►
This now gives people the full capability to have a third party camera apps that replace
00:29:55
◼
►
the camera button on the lock screen and work while the camera is still locked.
00:29:59
◼
►
That's all very new.
00:30:00
◼
►
And that's yeah.
00:30:01
◼
►
For third party camera apps, that's huge.
00:30:03
◼
►
And presumably also the swipe gesture on the lock screen.
00:30:05
◼
►
If you don't want to hold down on the camera icon, you can just swipe sideways.
00:30:07
◼
►
That will also be configurable.
00:30:10
◼
►
I don't know.
00:30:11
◼
►
It would be really weird if you held down on the icon and got one camera app and swiped
00:30:14
◼
►
and got a different one.
00:30:14
◼
►
That's true.
00:30:15
◼
►
But we'll see.
00:30:16
◼
►
We will see what happens.
00:30:17
◼
►
And control center integration too.
00:30:19
◼
►
And the way this works is all built on widgets.
00:30:21
◼
►
Like this, we've been seeing the building blocks here for a while.
00:30:25
◼
►
The modern widget system powers so many things all across system.
00:30:29
◼
►
And so as far as we can tell, I haven't dove too far into it yet, but as far as we can
00:30:33
◼
►
tell, all of this control center stuff is all just basically widgets in a new place.
00:30:38
◼
►
It does inherit the same seeming limitations of widgets.
00:30:41
◼
►
Hopefully we'll have some follow up next week with details of this, but it does seem like
00:30:46
◼
►
when you, if you have, say, an app running a thing in control center with one of these
00:30:50
◼
►
new blocks in control center, the app is not constantly running in the background.
00:30:55
◼
►
So it might be hard to do things like make a rich now playing widget for audio apps,
00:30:59
◼
►
for instance.
00:31:00
◼
►
It's very similar to other widgets seemingly in that it supports things like buttons and
00:31:04
◼
►
toggles that kind of wake the app up when they are hit and then make the app go back
00:31:08
◼
►
So it's going to be a little bit limited, but I'm really glad they're doing this.
00:31:13
◼
►
And what's interesting though is like that kind of to some degree might replace widgets
00:31:19
◼
►
on like, because you can currently pull down like the widget screen or you can swipe over
00:31:22
◼
►
to the widget page.
00:31:23
◼
►
Like there's certain places like you can kind of now have widgets in like three different
00:31:29
◼
►
directions of swiping on the phone.
00:31:30
◼
►
It's I think it might be, it might get a little confusing as to like where you're going to
00:31:34
◼
►
put certain things or like end up on the wrong page.
00:31:36
◼
►
I don't know, but I'm glad to have this, you know, even if it's maybe getting a little
00:31:43
◼
►
They talked about privacy for a while.
00:31:45
◼
►
They said that one of the things you might want to do is put face or touch ID or passcode
00:31:52
◼
►
in front of apps.
00:31:53
◼
►
So you can only open, you know, the photos app, for example, if you authenticate.
00:31:58
◼
►
They also said you can hide an app entirely.
00:32:01
◼
►
I missed how you would access it.
00:32:03
◼
►
Maybe you're searching for it.
00:32:04
◼
►
So it shows up in the app library.
00:32:06
◼
►
And there's like a special hidden apps block on the bottom of the app library.
00:32:10
◼
►
And it didn't show it in a locked state, but we assume it, you just let you face ID probably
00:32:14
◼
►
to unlock that, that block.
00:32:16
◼
►
And then you can access the app.
00:32:17
◼
►
That's like a deleted photos and the photos and hidden photos, the hidden album.
00:32:21
◼
►
It basically, it makes it work like the hidden album.
00:32:23
◼
►
It looks like it's kind of weird.
00:32:24
◼
►
How well, I guess it's, there's two things, right?
00:32:26
◼
►
So one is protecting an app and you can do that individually.
00:32:30
◼
►
The apps and you're like, great, the feature is done.
00:32:31
◼
►
And the other is hiding the fact that that app is on your phone at all because the apps
00:32:35
◼
►
that you tap and they face ID, you can still see the icon to the app and you're right.
00:32:38
◼
►
They didn't show it in the presentation, but I assume the hidden apps app library folder
00:32:42
◼
►
doesn't even show you which apps are in it when it's in the lock state.
00:32:44
◼
►
I would hope not.
00:32:45
◼
►
And so that's, that's why there's both of these features.
00:32:48
◼
►
It's not just like, Oh, if you don't want to individually lock apps, you can just drag
00:32:51
◼
►
them into this folder and they're all locked.
00:32:52
◼
►
No, it's the hide.
00:32:53
◼
►
The fact that the app is on your phone at all.
00:32:55
◼
►
They also said, and this is a long time coming, but I'm very happy for it.
00:33:00
◼
►
You can restrict what contacts are being exposed to apps.
00:33:04
◼
►
So there was a big brouhaha a few years ago where we realized, I don't remember what
00:33:08
◼
►
app, it doesn't matter, but like there was some app that wanted to slurp up all your
00:33:11
◼
►
contacts and path.
00:33:12
◼
►
I get, I want to say that, but I think it was after path, but you very well could be
00:33:16
◼
►
It doesn't really matter one way or another.
00:33:17
◼
►
It's slurped up all your contacts, which could have been for reasonable reasons, but
00:33:21
◼
►
ultimately what it ended up doing was like spamming all your contacts saying, Oh, you
00:33:25
◼
►
should join path, whatever it was.
00:33:26
◼
►
And that was really gross.
00:33:28
◼
►
And ever since then, I, at least, and I think many others have been really reluctant to
00:33:32
◼
►
let, let an app, you know, sort of up all your contacts, which I think is good to be
00:33:36
◼
►
reluctant about it.
00:33:37
◼
►
Now, apparently there's going to be some sort of API where you can say, I guess, again,
00:33:40
◼
►
in the, in the vein of photos, you know, what contacts would you like to expose to such
00:33:44
◼
►
and such an app, which is, which is great.
00:33:46
◼
►
I'm here for it.
00:33:47
◼
►
Because before there used to be no API at all to contact access.
00:33:50
◼
►
It was just a public API.
00:33:52
◼
►
And that, I think that's when a lot of these apps were really abusing it.
00:33:55
◼
►
And so this, this, it's great to see this because there are so many apps where like
00:33:59
◼
►
in order to do some critical functionality, it requests access to your entire address
00:34:04
◼
►
Sometimes it actually requires it in ways that I think are not actually necessary.
00:34:09
◼
►
And the app review should take a look at like WhatsApp, for instance.
00:34:12
◼
►
Small app, no one's really heard of it.
00:34:14
◼
►
But it there's, it's like, it's nice to see Apple putting a little more attention on
00:34:18
◼
►
contact privacy.
00:34:19
◼
►
Yeah, it's kind of, I see that in some apps and sometimes I can see, like, you want to
00:34:22
◼
►
be able to like, say it's an app where you're going to have to type people's email addresses
00:34:26
◼
►
or contact information.
00:34:27
◼
►
You want it to auto complete it, right?
00:34:28
◼
►
I understand what, like, I want this app to build up a database of all the contacts so
00:34:32
◼
►
I can auto complete.
00:34:33
◼
►
But you don't want the app to actually have all your contact info.
00:34:36
◼
►
I wonder if there's some privacy preserving way that they could like vend and a contact
00:34:41
◼
►
auto complete typing that I don't know.
00:34:43
◼
►
It's a complicated problem.
00:34:44
◼
►
They easily could for like the system text inputs.
00:34:47
◼
►
But I think the reality is in the app landscape we live in, no app would ever use that.
00:34:52
◼
►
They would just request access to your entire time.
00:34:54
◼
►
And keep nagging you about it every time you launch the app.
00:34:57
◼
►
You sure you don't want to give me access to all your contacts?
00:34:58
◼
►
Are you sure?
00:34:59
◼
►
And they would get some critical functionality behind it.
00:35:01
◼
►
An app review wouldn't have a problem with it.
00:35:03
◼
►
They should, but they won't.
00:35:06
◼
►
So we talk about messages.
00:35:07
◼
►
Tap backs could be any emoji.
00:35:11
◼
►
I'm very excited about this.
00:35:13
◼
►
I'm a little worried.
00:35:14
◼
►
I don't think they did a great job of showing what the user interface is going to look like.
00:35:18
◼
►
So I'm a little nervous.
00:35:19
◼
►
It's going to be super clunky.
00:35:20
◼
►
I'm going on faith that it won't be.
00:35:21
◼
►
But assuming it's not clunky, I'm here for it.
00:35:24
◼
►
Very excited.
00:35:25
◼
►
Yeah, that's a good point because the one good thing about the limited set is you don't
00:35:28
◼
►
have to go through like a giant picker.
00:35:30
◼
►
You know, their emoji picker has gotten better.
00:35:32
◼
►
But it's still sometimes cumbersome.
00:35:35
◼
►
I mean, one thing I also loved, obviously, yeah, finally, the emoji.
00:35:38
◼
►
Everyone's been wanting that for how many years now?
00:35:42
◼
►
And every other chat app does it.
00:35:43
◼
►
And it's great.
00:35:44
◼
►
And you know, Slack, WhatsApp, like every other-- there's so many other apps people
00:35:47
◼
►
are using that just have freeform emoji responsive things.
00:35:50
◼
►
It has become a language that people expect to have that.
00:35:54
◼
►
So that's good.
00:35:54
◼
►
I also love that they did bullet italic underlined strikethrough.
00:35:59
◼
►
And then they have send later because interestingly,
00:36:01
◼
►
they use the example of like if you want to send somebody a happy birthday message in
00:36:04
◼
►
the morning, you can schedule it at night and it'll go that morning.
00:36:08
◼
►
You can just have AI send it for them.
00:36:09
◼
►
You don't need to send it yourself.
00:36:10
◼
►
You're getting ahead, man.
00:36:11
◼
►
You're getting ahead.
00:36:12
◼
►
Well, then you can have their AI read all their birthday messages and just summarize
00:36:15
◼
►
And say thank you for you, yeah.
00:36:17
◼
►
All right, let's stay positive.
00:36:19
◼
►
So there's also text formatting.
00:36:21
◼
►
I'm sorry, you said text formatting.
00:36:22
◼
►
It's the text effects.
00:36:23
◼
►
There's magnification, animation, a blow away.
00:36:26
◼
►
We couldn't have a keynote without blow away reference some way somehow.
00:36:30
◼
►
Again, this sounds cool and interesting.
00:36:32
◼
►
I'm a little worried and skeptical about the interface in order to do it because like text
00:36:36
◼
►
selection on iOS, not fun, which I don't know how it could be fun without a full physical
00:36:42
◼
►
So I'm not like faulting them for that, but I don't know.
00:36:44
◼
►
This seems like it might be more effort than it's worth.
00:36:46
◼
►
Something that I thought was very, very interesting, particularly sitting directly in front of
00:36:51
◼
►
underscore actually was messages via satellite.
00:36:55
◼
►
So to back up a half step, you can send emergency messages via satellite.
00:36:59
◼
►
Like there's a wizard you would walk through that says, are you hurt?
00:37:03
◼
►
Are you stranded?
00:37:04
◼
►
You know, are you safe, et cetera, et cetera.
00:37:06
◼
►
And he would basically write a message, not in an AI way, just like, you know, so Casey
00:37:11
◼
►
is hurt on the side of the road and he's such and such Latin long.
00:37:14
◼
►
Go help him.
00:37:15
◼
►
More of a Mad Libs way.
00:37:16
◼
►
Yes, that's a good way of putting it.
00:37:17
◼
►
That's a very good way of putting it.
00:37:18
◼
►
Well, now you can do full honest to goodness messages.
00:37:23
◼
►
Like you type your message and send it via satellite, which I think is great.
00:37:27
◼
►
It's full, it's almost like it's, it's core messages or core features of iMessage via
00:37:32
◼
►
Yeah, that's true.
00:37:33
◼
►
Cause it was like tap backs as well.
00:37:34
◼
►
So, so it said, so now, you know, since the iPhone 14, you've been able to do those emergency
00:37:38
◼
►
messages, but it was like emergency only.
00:37:40
◼
►
Now when you are connected only via satellite, you can do, you can text seemingly anybody.
00:37:45
◼
►
They have SMS support.
00:37:47
◼
►
And then for iMessage, they said key iMessage features, whatever that means.
00:37:51
◼
►
But they said it includes sending receiving messages, emoji and tap backs.
00:37:54
◼
►
So like that's, you know, so obviously, so probably not like photos and stuff, but that's,
00:37:59
◼
►
that's pretty cool.
00:37:59
◼
►
Like it's basically like free unlimited satellite texting with any iPhone.
00:38:04
◼
►
They didn't mention any money, but I do.
00:38:06
◼
►
I mean, well, they, all they said was works with iPhone 14 or later.
00:38:10
◼
►
I mean, I take your point.
00:38:10
◼
►
I think they're just kicking that can down the road until they figure out what they're
00:38:14
◼
►
going to do about charging for this, but it's got to, it's got to be free.
00:38:17
◼
►
Well, maybe they would do emergency for free.
00:38:20
◼
►
That's a good point.
00:38:20
◼
►
And then this new feature, maybe we part of some plus plan.
00:38:23
◼
►
Same thing around in the keynote, which is weird.
00:38:25
◼
►
I know what are you going to do?
00:38:26
◼
►
Mails getting on device categorization.
00:38:29
◼
►
So this is where you filter in the Gmail's had this for how many years, John?
00:38:32
◼
►
But I do not use it in Gmail, but some people like it.
00:38:34
◼
►
I mean, in the times I used to actually, Hey, when Hey was new and exciting, like
00:38:39
◼
►
it had its own little cute categorization.
00:38:42
◼
►
The key feature of this categorization thing is what are the categories?
00:38:45
◼
►
And it's not like the user can pick them.
00:38:47
◼
►
It's basically the person who makes the app has to decide what are the categories of email
00:38:52
◼
►
that people get that they think would be useful to junk put into bins.
00:38:54
◼
►
And then they have whatever machine learning thing puts them into these bins.
00:38:57
◼
►
So here are the bins that Apple chose.
00:38:59
◼
►
I mean, there's no reason that has to be fixed.
00:39:01
◼
►
Like Apple has, I think chosen to make it fixed, but you could do things like
00:39:04
◼
►
make a tagging system and then have the system automatically file into those tags.
00:39:08
◼
►
I don't know if they're going to, I don't mean, I don't mean just the word.
00:39:11
◼
►
I mean like the, the analysis of the message to say what kind of message in it.
00:39:14
◼
►
So Apple's things are what primary transactions updates and promotions.
00:39:18
◼
►
Is that all of them?
00:39:19
◼
►
Something like that.
00:39:20
◼
►
Promotions was a great euphemism.
00:39:21
◼
►
Well, I mean, everyone has some promotions.
00:39:22
◼
►
It's, it's, it's tough.
00:39:23
◼
►
That's not spam or whatever, but like transactions make some sense.
00:39:26
◼
►
People want to have receipts.
00:39:27
◼
►
Primary is like the catchall for the important messages and then updates is newsletters and
00:39:32
◼
►
social media.
00:39:33
◼
►
I don't know.
00:39:33
◼
►
I, I always find it like, I find it more work for me to think about what bucket this thing
00:39:38
◼
►
And even though in Gmail, like Gmail's buckets, it can be in five, all the buckets at the
00:39:42
◼
►
Cause they're not folders.
00:39:42
◼
►
Like it's tagging system.
00:39:44
◼
►
But I think this, a lot of people feel like they don't have any tools to manage their
00:39:51
◼
►
email even when they do, because the tools are complicated or require setup that nerds
00:39:55
◼
►
will do, but people won't.
00:39:56
◼
►
They just go to their inbox and they just flail and then you leave.
00:40:00
◼
►
And this at least like this will, at first it's going to annoy people because it's like,
00:40:04
◼
►
where's my email?
00:40:05
◼
►
It's in these categories.
00:40:06
◼
►
I don't care about it, but as long as it can be disabled, that's fine.
00:40:09
◼
►
And for the people who do find this useful, they'll be like, Oh, now something else is
00:40:14
◼
►
organizing my email for me.
00:40:15
◼
►
And they will learn where to look for certain things like this.
00:40:19
◼
►
Gmail does it.
00:40:20
◼
►
A lot of other email clients do it.
00:40:21
◼
►
Obviously people find it useful.
00:40:22
◼
►
This is an apple catch up feature.
00:40:24
◼
►
I think it's important for them to have this.
00:40:26
◼
►
I just hope they allow.
00:40:27
◼
►
I'm thinking people in my life, if they install this operating system and they say, where
00:40:31
◼
►
did all my email go?
00:40:32
◼
►
I don't know what primary is.
00:40:34
◼
►
That's a bad sign, but we'll see how it goes.
00:40:36
◼
►
I'm also curious, they had that, the digest view per sender and it seems like it was like,
00:40:41
◼
►
they had like custom header images for companies that I don't know how that like, are they
00:40:46
◼
►
defining some new standard of like, if you know, extracting it from the emails, I don't
00:40:50
◼
►
That, that was that, that seemed a little gross to me, but I don't know.
00:40:54
◼
►
It's, it's pretty hard.
00:40:55
◼
►
I wonder if this, all this stuff will work on apple's email.
00:40:57
◼
►
So they can put all their own stuff into primary when they tell us about the latest sale on
00:41:01
◼
►
Mac book pros or the WWDC developer emails.
00:41:03
◼
►
We'll see what happens.
00:41:05
◼
►
But, uh, I do think the digest view, like the example they used was here's all your,
00:41:10
◼
►
all the emails about like a upcoming set of flights, for example.
00:41:12
◼
►
And I mean, I'm here for that.
00:41:14
◼
►
So I was very happy for underscore when we saw messages via satellite.
00:41:20
◼
►
And then I got very sad for underscore because then just a moment later they decided to announce
00:41:26
◼
►
new topographic maps in maps.
00:41:28
◼
►
You can access them offline.
00:41:29
◼
►
There's turn by turn voice guidance.
00:41:31
◼
►
I think they specifically were talking about for hikes.
00:41:34
◼
►
This was literally the only new features for maps this year were targeted.
00:41:40
◼
►
It was just targeting pedometer plus plus.
00:41:41
◼
►
He, he, because underscore is the nicest human that's ever lived.
00:41:44
◼
►
He was, it's so positive and so upbeat about it, but I, my heart breaks for poor.
00:41:49
◼
►
And there are other other hiking apps.
00:41:50
◼
►
We just happen to know someone who makes one of them.
00:41:52
◼
►
And this, and to be clear, this is, this is exactly, you would expect apple to add this
00:41:57
◼
►
It is a logical feature to add to maps.
00:41:59
◼
►
They should add it.
00:42:00
◼
►
Third parties have been filling this gap.
00:42:02
◼
►
Now apple is stepping up and I think underscores, right?
00:42:04
◼
►
That apple is going to do what they do, but third parties are able to do more sophisticated,
00:42:08
◼
►
complicated things with different decisions.
00:42:10
◼
►
So it's not like when apple enters one of these areas, it makes it impossible.
00:42:13
◼
►
Like apple made a podcast app and overcast still exists, right?
00:42:16
◼
►
So it is actually just the first, it is a, is it a, it is dynamic that as a developer
00:42:20
◼
►
for any platform you should become accustomed to.
00:42:23
◼
►
And don't be afraid that it's going to destroy your app because you know, if your app was
00:42:28
◼
►
successful at all, there's room to make something different than what apple does.
00:42:33
◼
►
And apple almost never do what a third party would want to do with a given app.
00:42:36
◼
►
Well, in all fairness though, you know, when apple really does damage by a Sherlocking,
00:42:41
◼
►
it's usually because they do something in a way that someone else can't match.
00:42:45
◼
►
Like in using some kind of system integration or apis that we aren't allowed to use or business
00:42:49
◼
►
terms that we aren't allowed to use 30%, you know, shenanigans like that's, that's what
00:42:54
◼
►
usually really kills something else.
00:42:56
◼
►
Or they massively subsidize it because obviously apple can make apps that are subsidized by
00:43:00
◼
►
their bazillions of dollars from their other businesses and they can put you out of business.
00:43:02
◼
►
But they tend not to do that.
00:43:04
◼
►
Like they, they, they have surprisingly small teams on many of their apps, but the real
00:43:07
◼
►
thing that keeps it back is because apple is never going to add really complicated, sophisticated
00:43:11
◼
►
They're just allergic to it, right?
00:43:13
◼
►
And so if you know, whatever obscure feature that you think hikers want, apple's probably
00:43:18
◼
►
never going to get around to that.
00:43:19
◼
►
They're just going to give like the thing that works for 90% of hikers and that 10%
00:43:23
◼
►
would still be using your app.
00:43:24
◼
►
So you just have to make sure your app, I mean, it probably already does, does something
00:43:28
◼
►
opinionated specific that is too, too nitty gritty for apple to ever add because they
00:43:33
◼
►
have to make something that works for most people and you can make something that works
00:43:36
◼
►
for like the hiking enthusiasts.
00:43:37
◼
►
By the way, real time follow apparently the standard exists for email corporate logo headers.
00:43:42
◼
►
It's called Bimi or B I M I and apparently it's not very good, but that is a public standard.
00:43:46
◼
►
So please don't email us.
00:43:48
◼
►
I today I learned that's, it must, it must be used so broadly somehow, somehow we missed
00:43:54
◼
►
Wallet gets a tap to apple pay cash.
00:43:57
◼
►
So what the theory is, you know, let's say you want to pay somebody for something, but
00:44:03
◼
►
you don't necessarily want to give out your phone number or your email address, what have
00:44:06
◼
►
Then you can just tap your phones like you can to exchange stuff via airdrop.
00:44:11
◼
►
Uh, so that's pretty cool.
00:44:13
◼
►
That's super cool.
00:44:13
◼
►
It's like not just that you don't have to share it with them, even with people who I
00:44:17
◼
►
don't care about sharing it.
00:44:18
◼
►
Like I'll totally give you my, you have to do the thing.
00:44:20
◼
►
It was like, what's your iMessage?
00:44:22
◼
►
What's your, I mean, that's why Venmo and stuff have the little QR codes for you to
00:44:25
◼
►
say, just the hassle of having to type something in or whatever.
00:44:29
◼
►
And so this has the double whammy.
00:44:30
◼
►
You don't have to type anything in and presumably it's privacy preserving where you literally
00:44:34
◼
►
don't need to give it to them.
00:44:36
◼
►
Uh, you can use apple pay online.
00:44:38
◼
►
Um, I guess it's apple pay cash online.
00:44:41
◼
►
Is that what I missed that part of the, there were some kind of like enhancements to what
00:44:44
◼
►
you can do with apple pay checkout online.
00:44:46
◼
►
And it was, it was various like financial, you know, little tricks that we don't really
00:44:50
◼
►
And this is another example of them flying by, but they did mention of something about
00:44:55
◼
►
in the wallet app.
00:44:56
◼
►
So if you have like a concert ticket, there would be an event guide for that particular
00:45:00
◼
►
venue, which in theory sounds really great.
00:45:03
◼
►
Um, they talked about journal app.
00:45:05
◼
►
Honestly, I don't really care.
00:45:06
◼
►
We should probably move on.
00:45:07
◼
►
They added a few, they added search, which it somehow magically did not have like amazingly
00:45:11
◼
►
now it has it.
00:45:12
◼
►
You can log your state of mind also, which I think I'm kind of surprised it wasn't there
00:45:16
◼
►
at first, but it's good to see them, you know, doing something to the journal app.
00:45:20
◼
►
Like this is a brand new app that launched in a very minimal state.
00:45:23
◼
►
I didn't have a chance.
00:45:24
◼
►
I didn't see yet though.
00:45:25
◼
►
Were there any changes to journal API's?
00:45:27
◼
►
Like was there any, any way for, for instance, other third-party apps to vend activities
00:45:32
◼
►
to suggest for journal to use?
00:45:34
◼
►
They didn't mention it in the keynote, but that doesn't mean it's not there.
00:45:36
◼
►
We'll find out.
00:45:36
◼
►
Yeah, indeed.
00:45:37
◼
►
Then there's game mode in iPhone.
00:45:40
◼
►
So that's, you know, basically cranking everything else back so that the game process is the
00:45:46
◼
►
Photos gets its biggest redesign ever.
00:45:50
◼
►
It's got a two pane design, which I didn't think aesthetically looked great, but I can
00:45:55
◼
►
understand how they landed there because it seems like functionally it'll be an improvement.
00:45:58
◼
►
There's filters.
00:46:00
◼
►
So one of the examples they, they enumerated was filtering out screenshots, which is pretty
00:46:04
◼
►
Granted, I was sitting with a bunch of journalists, so they were very excited about that.
00:46:08
◼
►
You don't have a lot of screenshots in your phone that were intentionally taking people
00:46:11
◼
►
who write about software for a living do.
00:46:13
◼
►
It's built on the amazing intelligence in the photos app is what was, what was stated
00:46:19
◼
►
at the time.
00:46:20
◼
►
There's collections time, people, favorite memories, trips, et cetera.
00:46:24
◼
►
You can reorder collections.
00:46:26
◼
►
You can pin collections.
00:46:27
◼
►
This is so I have, I have many albums and I want to put stuff in like the same three
00:46:31
◼
►
albums all the time and they're alphabetical currently.
00:46:34
◼
►
Scroll, scroll, scroll.
00:46:36
◼
►
Oh, I went past that letter.
00:46:37
◼
►
This is great.
00:46:39
◼
►
I think this is actually good.
00:46:40
◼
►
Like I obviously this is like a high risk thing to redesign the photos app.
00:46:44
◼
►
I will have to see like what it actually is like in use, but I'm pretty optimistic.
00:46:48
◼
►
The current photos app really has a hard time scaling to very large collections, which we
00:46:53
◼
►
all slowly accumulate.
00:46:55
◼
►
This seems like they've done a lot to try to make them more manageable.
00:46:57
◼
►
They did mention that they had, and this, the part of the state of the union that we
00:47:01
◼
►
saw that they had redone some of the photos app and Swift UI, but not, they made a point
00:47:04
◼
►
of saying, but not the collection view because they were showing, showing how it could integrate
00:47:08
◼
►
integrate with UI kit.
00:47:09
◼
►
And I think that's because a Swift UI can't handle the collection view in photos.
00:47:13
◼
►
We have a lot of photos.
00:47:14
◼
►
That would, that would not be something I would use Swift UI for.
00:47:18
◼
►
They also said there's a carousel that has a new set of photos each day, which is exciting.
00:47:22
◼
►
And then on the Bento box at the end, they mentioned RCS and we all laughed because we
00:47:27
◼
►
thought that that was all we were going to get with regard to RCS.
00:47:30
◼
►
But then they actually briefly said verbally that RCS is coming.
00:47:34
◼
►
And also something that I think is exciting, especially for those with not as great vision
00:47:38
◼
►
is larger icons on the home screen.
00:47:40
◼
►
So I think that was very briefly mentioned.
00:47:42
◼
►
Did they show that?
00:47:42
◼
►
Cause I would love to make some icons bigger and some icons smaller.
00:47:45
◼
►
You know what I mean?
00:47:46
◼
►
Like is my thing with game controllers.
00:47:48
◼
►
Not every button is equally important.
00:47:49
◼
►
The primary action button on a controller is more important than the tertiary button.
00:47:54
◼
►
So I would love to make apps bigger, but did you have other thoughts on game controllers?
00:47:58
◼
►
You want to share?
00:48:01
◼
►
Audio and home.
00:48:02
◼
►
I don't know too much that we need to say about this.
00:48:05
◼
►
I did like the AirPods Pro.
00:48:07
◼
►
Maybe only the AirPods Pro one way or another, you can nod or shake your head to interact
00:48:12
◼
►
So, you know, an example they gave is, you know, Marco was calling, do you want to answer
00:48:15
◼
►
and you can shake your head laterally left and right.
00:48:17
◼
►
And that Siri will interpret that as no, I do not want to answer.
00:48:20
◼
►
Which is cool.
00:48:21
◼
►
Voice isolation, which we got an email about this actually.
00:48:24
◼
►
And I don't know, do you, do you remember, I feel like voice isolation was a thing in
00:48:28
◼
►
They've talked about it on the phone and various other things.
00:48:31
◼
►
I don't know why maybe they did it better or it seems like there's like a new like ML
00:48:35
◼
►
based cause there are, there's lots of new techniques out in the industry for ML based
00:48:39
◼
►
voice isolation.
00:48:40
◼
►
I remember Nvidia did this amazing demo showing it off like two years ago.
00:48:44
◼
►
And other products have added it here and there.
00:48:47
◼
►
So I, you're right.
00:48:48
◼
►
They have had like various techniques for various noise canceling and microphone isolation
00:48:52
◼
►
techniques over time.
00:48:53
◼
►
I think those have mostly just been very kind of simple hardware tricks and this seems like
00:48:58
◼
►
it's more ML based.
00:48:59
◼
►
So this should work a lot better and be more advanced.
00:49:01
◼
►
It's going to be pretty cool if it works.
00:49:03
◼
►
I hope it's not AirPods Pro only.
00:49:04
◼
►
They just showed the AirPods Pro.
00:49:06
◼
►
The voice isolation is they said AirPods Pro.
00:49:08
◼
►
They specifically said the nodding your head might be for both, but sorry, John, you're
00:49:12
◼
►
going to have to get on the pro train eventually.
00:49:15
◼
►
This was fun for you, huh?
00:49:16
◼
►
It's time for the big pep talk we gave about how third party apps are still liable when
00:49:20
◼
►
Apple does something.
00:49:20
◼
►
Insert that here.
00:49:23
◼
►
So I believe there was a feature at its TV OS called insight.
00:49:27
◼
►
Now I believe it was like something else I've seen.
00:49:30
◼
►
Oh yeah, Amazon X-ray.
00:49:32
◼
►
That's right.
00:49:32
◼
►
And what else?
00:49:33
◼
►
There was some other app.
00:49:34
◼
►
Oh yeah, your app.
00:49:35
◼
►
That's right.
00:49:36
◼
►
Before Casey decided to make call sheet, we've been saying for years that X-ray is a great
00:49:40
◼
►
feature that Amazon has and people always have a question when they're watching a show.
00:49:43
◼
►
What is that person from an X-ray provides that feature X-rays interface to be clear
00:49:46
◼
►
is terrible.
00:49:47
◼
►
Like every Amazon interface, Casey's app call sheet, in case you don't know, is the thing
00:49:50
◼
►
where you can look up what people who've been in movies and TV shows and so on and so forth.
00:49:54
◼
►
And it's a very nice app.
00:49:55
◼
►
The thing I would say to encourage you here is those on screen things for doing that.
00:50:00
◼
►
I think they should be there and they're great, but Apple's history of making an interface
00:50:04
◼
►
on the TV itself that lets you do anything sensible is not good.
00:50:07
◼
►
I would much rather look when someone says, what is that person from?
00:50:12
◼
►
If I threw an interface on the screen while we were watching the show, she doesn't want
00:50:16
◼
►
me to even pause it.
00:50:17
◼
►
She wants me to look it up on my phone, in which case I'll use call sheet.
00:50:20
◼
►
And again, I'm not pooping this feature.
00:50:22
◼
►
I think it should exist.
00:50:23
◼
►
I think it's great.
00:50:23
◼
►
Hopefully it'll have a better interest in X-ray, but there is still definitely a place
00:50:28
◼
►
for a thing for app that you use on your phone to look up who that person is without pausing
00:50:31
◼
►
the show and without putting anything on the screen.
00:50:33
◼
►
Also the, you know, the, the, um, the new feature will only were inside this club.
00:50:38
◼
►
It will only work on Apple TV app.
00:50:40
◼
►
Like it won't work in third party.
00:50:42
◼
►
I didn't catch it first.
00:50:43
◼
►
I thought it was just on the Apple TV player, but again, in hindsight, it does make some
00:50:47
◼
►
They wouldn't have the data.
00:50:48
◼
►
They just, they just do screen, like do the Shazam version video Shazam.
00:50:52
◼
►
Oh, they're definitely not doing that.
00:50:54
◼
►
But like that, that would be the tech.
00:50:55
◼
►
Your TV is doing that to show you ads, but Apple's not doing that.
00:50:59
◼
►
Technology does exist, but Apple is not used.
00:51:00
◼
►
This is just for Apple TV plus television shows or movies.
00:51:04
◼
►
If I use that instead of call sheet, I'd be spoiled constantly on, you know, character
00:51:08
◼
►
reveals and stuff like that.
00:51:11
◼
►
I apparently owe you a drink at dinner.
00:51:12
◼
►
You'll be fine.
00:51:13
◼
►
But no, it was funny though, because for a hot second, I was devastated because I was,
00:51:21
◼
►
I thought it was for everything.
00:51:22
◼
►
And I think part of the reason I thought that, which in retrospect was silly, but I knew
00:51:26
◼
►
that there was so much AI and ML and what have you.
00:51:29
◼
►
And I'm like envisioning this world where they're like figuring out what's on screen.
00:51:32
◼
►
I mean, they could, hypothetically they could, but the more I think about it, the more I
00:51:36
◼
►
think that that's, that's challenging at least today, maybe in the future.
00:51:39
◼
►
Won't be, but today I think that's really challenging.
00:51:41
◼
►
I don't think it's challenging.
00:51:42
◼
►
I think it's expensive.
00:51:43
◼
►
And it's privacy invasive in a way that Apple doesn't like to do.
00:51:46
◼
►
So anyway, so there was a five minute window before people started reporting in and sending
00:51:50
◼
►
me texts that like, Oh no, no, no, no, no, no, no, no.
00:51:52
◼
►
It's just Apple TV plus.
00:51:53
◼
►
And then I was not quite so miserable, but for a second developer experience, that's
00:51:57
◼
►
the thing is underscore again, I'm just sitting right behind me and he's like, Nope, this
00:52:01
◼
►
is part of the process.
00:52:02
◼
►
So anyways, but yes, it was, it was funny in retrospect, not funny at the time.
00:52:06
◼
►
Enhanced dialogue, one of my favorite features about my beloved Sonos setup is that the sound
00:52:12
◼
►
bars, or at least my sound bar can do their own dialogue enhancing mode, which is not
00:52:18
◼
►
flawless, but it works reasonably well.
00:52:20
◼
►
And I am old enough now that I feel like generally speaking, I can hear, but particularly at
00:52:25
◼
►
nighttime when the kids are asleep and Declan's room is right above our family room where
00:52:28
◼
►
we watch TV.
00:52:29
◼
►
I don't want to have to crank the volume in order to just understand what the heck people
00:52:33
◼
►
Do you have reduced loud sounds on?
00:52:35
◼
►
I don't, I understand the question.
00:52:36
◼
►
I don't recall.
00:52:37
◼
►
You should try that.
00:52:38
◼
►
I'll have to give that a shot.
00:52:39
◼
►
You're talking about the reduced loud sound?
00:52:41
◼
►
Just a compressor.
00:52:42
◼
►
Just compress.
00:52:42
◼
►
I leave that on all the time.
00:52:44
◼
►
Yeah, I should, I should give that a shot, but one way or another, there's now enhanced
00:52:47
◼
►
dialogue for, for I think any playback on Apple TV, which I'm really excited for.
00:52:51
◼
►
Cause presumably an Apple TV box is going to have more processing power than my Arc
00:52:55
◼
►
So these enhanced dialogue features exist everywhere.
00:52:57
◼
►
They're on every TV, they're on every receiver, they're on every set-down box.
00:53:00
◼
►
It's good that Apple has one, but I have to tell you the quality of these varies widely.
00:53:05
◼
►
So hopefully Apple does a good job of it because it's easy to just like, Oh, I'm just applying
00:53:09
◼
►
an EQ curve and human voices are around here and that is awful.
00:53:12
◼
►
And that's been around for ages and there's, you know, increasing amounts of ML or whatever.
00:53:15
◼
►
So I hope Apple has done a good job of this because it actually is pretty hard to do because
00:53:18
◼
►
if you, if you listen to a bad one, it's, it's grading on your ears.
00:53:22
◼
►
Like you can, like the voices are just too loud and too clear and everything else feels
00:53:26
◼
►
in the distance.
00:53:27
◼
►
So doing this well is actually kind of tricky and I'm looking forward to seeing Apple's
00:53:30
◼
►
implementation.
00:53:31
◼
►
I mean, it could literally be the exact same algorithms as the voice oscillation for AirPods
00:53:34
◼
►
pro, just like tuned down, you know, like with less reduction of the background.
00:53:38
◼
►
But you do have to be careful because you don't want it to sound like, like the people
00:53:43
◼
►
are like right in front of your face and the whole rest of the show is back there.
00:53:46
◼
►
Like you can, you can over enhance it.
00:53:48
◼
►
I mean, one thing that, that Apple is historically very good at is doing features like this with
00:53:54
◼
►
Like a lot of times they get criticized for not like doing a more extreme version or having
00:53:57
◼
►
more controls over how they're doing things like this.
00:53:59
◼
►
But I would trust them to do this well enough that it would be, if anything, people, you
00:54:04
◼
►
would say it doesn't go far enough.
00:54:05
◼
►
It would, it's probably going to be a pretty subtle effect.
00:54:07
◼
►
Like the demo, I mean, obviously we were hearing it over like, you know, concert speakers.
00:54:11
◼
►
So who knows how it sounds in person, but the demo of it seemed like it was actually
00:54:14
◼
►
fairly subtle.
00:54:15
◼
►
Auto subtitle appearance when muting or skipping back.
00:54:19
◼
►
I thought that they already did this for like, what did she say or whatever.
00:54:22
◼
►
They do it when you, when you ask those Siri remote, what did they say?
00:54:25
◼
►
And then it will go backwards three seconds, turn subtitles on, play through and then turn
00:54:29
◼
►
the subtitles back off, which is one of the best features of Apple TV.
00:54:32
◼
►
And now this is even more of that of saying, look, if you just skip it back, you don't
00:54:36
◼
►
even have to, because it is kind of annoying to pick up the remote and mumble into it.
00:54:40
◼
►
What did they say or whatever?
00:54:41
◼
►
This, if you skip back, it just assumes it's because you didn't hear something.
00:54:44
◼
►
So that, that removes the stuff.
00:54:46
◼
►
And that's great.
00:54:47
◼
►
And the auto subtitles, subtitling appearance when muting is a no brainer.
00:54:50
◼
►
That is great.
00:54:51
◼
►
I love that support for, I think it was 21 by nine projectors, whatever the standard
00:54:56
◼
►
aspect ratio is, which is kind of interesting and cool.
00:54:59
◼
►
I don't know anyone that uses an Apple TV with a projector, but I know what happens.
00:55:02
◼
►
So that's neat.
00:55:03
◼
►
And then different screensavers are going to be available.
00:55:06
◼
►
Slideshows, portraits, moments from Apple TV plus shows.
00:55:09
◼
►
And then they did a big song and dance about Snoopy and how that's going to be a screensaver.
00:55:13
◼
►
That's cool.
00:55:13
◼
►
Before we talk watchOS, do we want to talk about something else that's awesome?
00:55:20
◼
►
In a moment.
00:55:21
◼
►
Sorry, I dropped that on you a little unexpectedly.
00:55:24
◼
►
We are also sponsored.
00:55:26
◼
►
Thanks, man.
00:55:26
◼
►
We are also sponsored this episode by DeleteMe.
00:55:30
◼
►
You ever wonder how much your personal data is out there on the internet for anyone to
00:55:34
◼
►
It's more than you think.
00:55:35
◼
►
Your name, concept info, social security number, maybe even your home address, even
00:55:39
◼
►
like all these things for your family members too.
00:55:42
◼
►
This is all out there and it's all being compiled by data brokers and openly sold online.
00:55:46
◼
►
Anybody can do a quick web search and get all those details.
00:55:49
◼
►
And this can lead to all sorts of problems for you.
00:55:51
◼
►
Things like phishing attempts, harassment, unwanted telephone calls.
00:55:55
◼
►
So you can protect your privacy with DeleteMe.
00:55:58
◼
►
So I actually found DeleteMe before they were a sponsor.
00:56:02
◼
►
I was looking for a service to help clean up some of that stuff about me online a few
00:56:05
◼
►
And I picked DeleteMe because it was great.
00:56:07
◼
►
And I'm actually very glad I did.
00:56:09
◼
►
It has worked fantastically.
00:56:10
◼
►
So what it does is a subscription service that removes your personal info from the largest
00:56:15
◼
►
people search databases on the web.
00:56:16
◼
►
And in the process, that helps prevent all those problems above.
00:56:20
◼
►
Doxing, unwanted phone calls, phishing scams, stuff like that.
00:56:23
◼
►
So here's what it is.
00:56:25
◼
►
You sign up for DeleteMe, you tell them exactly what information you want deleted.
00:56:29
◼
►
And then they take it from there.
00:56:30
◼
►
So you can tell them like, here's the addresses I've lived at in the past, here's my current
00:56:33
◼
►
stuff, here's like family member names.
00:56:35
◼
►
Whatever you want them to go find and delete, you give it to them and then they go do it.
00:56:39
◼
►
They send you regular personalized reports showing what info they found, where they found
00:56:43
◼
►
it, how they were able to remove it.
00:56:44
◼
►
And it's always working for you.
00:56:46
◼
►
This isn't just like a one-time thing.
00:56:47
◼
►
They are constantly monitoring and removing that personal information that you don't want
00:56:51
◼
►
from the internet.
00:56:52
◼
►
So they do all the hard work for you of wiping that data and your family's personal data
00:56:57
◼
►
off as many places on the web as they can find.
00:56:59
◼
►
Data brokers hate them.
00:57:01
◼
►
When you sign up, DeleteMe immediately goes to work, scrubbing that info.
00:57:04
◼
►
So take control of your data and keep your private life private by signing up for DeleteMe.
00:57:08
◼
►
Now, a special discount for our listeners.
00:57:10
◼
►
Get 20% off your DeleteMe plan today when you go to joindeleteme.com/ATP and use promo
00:57:17
◼
►
code ATP at checkout.
00:57:18
◼
►
The only way to get 20% off is to go to joindeleteme.com.
00:57:21
◼
►
That's the domain name.
00:57:22
◼
►
joindeleteme.com/ATP.
00:57:25
◼
►
Enter code ATP at checkout.
00:57:26
◼
►
Once again, joindeleteme.com/ATP.
00:57:30
◼
►
Thanks to DeleteMe for sponsoring our show.
00:57:32
◼
►
[MUSIC PLAYING]
00:57:36
◼
►
They talked a lot about activity or activeness.
00:57:41
◼
►
I know that's not really a word.
00:57:42
◼
►
But anyways--
00:57:44
◼
►
That's what it was.
00:57:45
◼
►
But they talked about training load, which was interesting.
00:57:47
◼
►
To be honest, I was slightly tuned out at this point because I was still figuring out
00:57:50
◼
►
if my job was going away.
00:57:52
◼
►
You were sending your emails.
00:57:53
◼
►
Right, exactly.
00:57:54
◼
►
But they talked about training load and, oh, if you've trained really, really hard, that
00:57:59
◼
►
maybe you need to back it off a little bit so you don't get exhausted, et cetera, et cetera.
00:58:01
◼
►
You can customize the summary tab in fitness, which I'm excited about.
00:58:06
◼
►
You can also have different goals for different days.
00:58:08
◼
►
You can account for injuries.
00:58:10
◼
►
And gentlemen, you can pause for rest days.
00:58:13
◼
►
This is great.
00:58:14
◼
►
You know there's someone out there who got a Series 0 watch, and they've been on a streak,
00:58:18
◼
►
and they've been getting their badges, and they haven't missed a thing.
00:58:20
◼
►
It's a single day.
00:58:21
◼
►
And now, finally, that person can have one day of rest.
00:58:25
◼
►
I don't think a Series 0 watch would have enough battery life to give you your stand-out
00:58:29
◼
►
They've been going from watch to watch and somehow haven't lost all their streaks.
00:58:32
◼
►
They've just-- because we've been saying this for years.
00:58:34
◼
►
Like, they gamified this by giving you cool little badges for going on streaks.
00:58:39
◼
►
But it's unhealthy to, like, for example, keep doing the same activity through injuries
00:58:43
◼
►
or never to take a day off.
00:58:45
◼
►
And we've always been like Apple.
00:58:46
◼
►
Like, you're not promoting a healthy lifestyle.
00:58:48
◼
►
The people who are most addicted to this gamified thing are going to end up injuring themselves
00:58:53
◼
►
and making their lives worse.
00:58:55
◼
►
Let people have a day off.
00:58:57
◼
►
Pause for a day.
00:58:58
◼
►
The streak still counts.
00:59:00
◼
►
This is just a life lesson that Apple has now learned and now is passing on to us.
00:59:04
◼
►
It's OK to take a day off.
00:59:05
◼
►
And if you're injured, don't do the same activity you normally do.
00:59:08
◼
►
And now the watch understands that and will allow you to maintain your streak.
00:59:11
◼
►
And I think it is completely legitimate.
00:59:13
◼
►
And also, like, there's this, like, falling off the wagon effect where, like, if you have
00:59:17
◼
►
had a long streak and then you have to break it, you're forced to break it for some reason,
00:59:21
◼
►
a lot of times it's really hard to ever go back.
00:59:22
◼
►
It's like, well, it's over now.
00:59:24
◼
►
And you never go back.
00:59:26
◼
►
Yeah, exactly.
00:59:26
◼
►
Like, well, I'm off the wagon now.
00:59:28
◼
►
I guess I'll go back to being a slob.
00:59:30
◼
►
And it can be very demotivating.
00:59:33
◼
►
So actually, like, enabling rest days not only is healthier mentally for the people who are
00:59:39
◼
►
trying to keep streaks going, but I think it will result in people keeping more streaks
00:59:42
◼
►
overall and not falling off that wagon as much because you're not, like, losing, oh,
00:59:49
◼
►
there it is.
00:59:50
◼
►
I'm gone forever.
00:59:50
◼
►
Like, I lost all this that I've worked for.
00:59:52
◼
►
I might as well throw it away.
00:59:54
◼
►
But it makes the Apple Watch stickier, you know, for a self-motivated thing where, like,
00:59:57
◼
►
you're not going to switch to a different watch if you still have your streaks gone.
01:00:01
◼
►
They talked a little bit about a Vitals app, which I'm genuinely excited about, to see
01:00:07
◼
►
kind of, like, an overall status of what your health is across several different metrics,
01:00:12
◼
►
which is cool because fitness, obviously, is specifically about exercise and things of
01:00:16
◼
►
that nature and fitness.
01:00:17
◼
►
And Vitals is more of a holistic view of everything about you.
01:00:21
◼
►
I mean, I like what they're doing here.
01:00:23
◼
►
Like, so the idea is, like, daily health metrics, overall health status.
01:00:26
◼
►
If they're-- if a bunch of-- if something changes in a few different ways, like, if
01:00:30
◼
►
your Vitals in different ways change, they will alert you, like, hey, your heart rate's
01:00:34
◼
►
been up this week, and also, you know, other stuff has changed.
01:00:36
◼
►
That's nice.
01:00:38
◼
►
But why-- I have to wonder, why can't this just be the health app?
01:00:42
◼
►
Why-- like, I feel like the health app, honestly, is a mess.
01:00:46
◼
►
There's so much in there, and I don't think the health app does a good job of information
01:00:52
◼
►
architecture.
01:00:52
◼
►
You mean on the watch?
01:00:53
◼
►
Because this is the watch OS section.
01:00:55
◼
►
You mean in general, the health app.
01:00:57
◼
►
I mean in general.
01:00:58
◼
►
Like, I think this should be just a function of the health app.
01:01:01
◼
►
Maybe it is.
01:01:01
◼
►
Maybe it's just the Vitals tab in the health app now.
01:01:03
◼
►
No, well, maybe.
01:01:05
◼
►
I mean, I thought it was a whole separate app, but--
01:01:07
◼
►
I thought it was a whole separate app.
01:01:08
◼
►
I'm pretty sure it is.
01:01:09
◼
►
And I will concur.
01:01:10
◼
►
We don't-- I don't want to belabor it, because--
01:01:11
◼
►
Chat room's saying it's in the health app on iOS, and on watch OS, it's separate.
01:01:14
◼
►
So maybe it's just a separate screen.
01:01:16
◼
►
Oh, interesting.
01:01:16
◼
►
Yeah, that's what I assumed.
01:01:17
◼
►
OK, either way, the health app-- and from an information architecture perspective, the
01:01:22
◼
►
health app is a disaster.
01:01:24
◼
►
It's just terrible.
01:01:25
◼
►
Yeah, like, Apple's modern-- like, Apple's modern design language that they use there
01:01:28
◼
►
of just, like, a bunch-- like, a grid of square-- around rect squares with, like, some text
01:01:34
◼
►
in the corner, and that's it.
01:01:35
◼
►
And there's just a whole huge grid.
01:01:36
◼
►
Like, I feel like that is-- that does not scale to a lot of information.
01:01:40
◼
►
That's fine if you have a simple app, like, Reminders, where you have, like, those little
01:01:44
◼
►
It's the same pattern.
01:01:45
◼
►
Reminders, that's OK there, but the health app has a thousand different things in it.
01:01:49
◼
►
And I don't feel like it's organized well.
01:01:52
◼
►
So maybe they'll do a better job of this.
01:01:54
◼
►
Yeah, but that's so nice.
01:01:55
◼
►
They talked about cycle tracking and gestational age, which I thought was very cool, and a
01:02:00
◼
►
lot more support about pregnancy-specific metrics.
01:02:03
◼
►
So as an example, you know, I think they-- I think they use blood pressure as an example,
01:02:08
◼
►
but there was something that they cited that it goes up quite a bit during pregnancy, and
01:02:12
◼
►
that's normally OK, but you want to keep an eye on it, et cetera, et cetera.
01:02:15
◼
►
So I thought that was very cool.
01:02:16
◼
►
Yeah, that's another example of, like, third-party app opportunity type thing, and even more
01:02:20
◼
►
so here, because, like, the health data is essentially a shared database that other apps
01:02:23
◼
►
can access and do things with.
01:02:25
◼
►
And there are tons of pregnancy tracking apps on the App Store right now, and it's like,
01:02:30
◼
►
oh, Apple is now going to give you one for free, so why would anyone use a third-party
01:02:34
◼
►
I hope the third-party ones could integrate with the new pregnancy-specific information
01:02:39
◼
►
that is presumably in the health database to enhance themselves.
01:02:42
◼
►
And of course, those apps are going to be way more sophisticated, way more varied, way
01:02:45
◼
►
more tailored to people's individual goals or whatever.
01:02:47
◼
►
So I think this will actually be a boost to that market, not a detriment to it.
01:02:50
◼
►
Well, honestly, maybe it might have to be a detriment, because a lot of times-- like,
01:02:54
◼
►
remember, it came out a few years ago that the privacy of those apps is horrendous, like,
01:02:58
◼
►
that all of the leading pregnancy tracking apps that somebody could find a couple years
01:03:02
◼
►
ago, they were all sending that data to Facebook.
01:03:04
◼
►
Oh, that's true.
01:03:05
◼
►
Yeah, yeah, yeah.
01:03:05
◼
►
I forgot about that.
01:03:06
◼
►
No, that is true.
01:03:07
◼
►
And I feel like this should help-- the competitive landscape should change so that now there
01:03:12
◼
►
is a privacy-preserving option, so maybe apps have to do that less.
01:03:15
◼
►
Yeah, I think that any time Apple can add this kind of-- even though their version is
01:03:20
◼
►
going to be more basic, more just core functionality, they're going to give the 20% solution, right?
01:03:25
◼
►
But even-- like, that is usually a good thing if the alternative is a market full of privacy-invading
01:03:32
◼
►
Yeah, I just want to sell your name to diaper manufacturing.
01:03:35
◼
►
Anyway, it's for diaper.
01:03:36
◼
►
You know, it makes perfect sense.
01:03:37
◼
►
That's how they do it.
01:03:38
◼
►
Connections was another section where they talked about several different things.
01:03:41
◼
►
They will automatically add new widgets to the Smart Stack watch face, which is kind
01:03:45
◼
►
of sort of the nouveau Siri watch face.
01:03:47
◼
►
There's Translate on the Apple Watch that uses, quote, "machine learning models" to
01:03:52
◼
►
do the translation.
01:03:54
◼
►
Live activities in the Smart Stack.
01:03:56
◼
►
This-- I don't use live activities enough, but if there's anything that's going to get
01:04:00
◼
►
me on this watch face, it's live activities in the Smart Stack.
01:04:02
◼
►
I am here for that, very excited about it.
01:04:05
◼
►
And in fact, I'm jumping ahead a bit, but there seem to be a lot of different things
01:04:10
◼
►
where they're acknowledging and embracing the fact that the iPhone is kind of the core
01:04:14
◼
►
computing device of your life, even for the three of us, where I think we're all primarily
01:04:20
◼
►
But-- and John will argue with me as soon as I stop talking-- but generally speaking,
01:04:23
◼
►
I think for a lot of people, the iPhone is the prime-- or maybe not primary, but the
01:04:27
◼
►
most important hub of your digital life.
01:04:30
◼
►
And I think a lot of things are now-- Apple is embracing that for a lot of features.
01:04:35
◼
►
And this is one of them, live activities on the Smart Stack.
01:04:37
◼
►
So we're getting lifts and Ubers and whatnot while we're here in San Jose and Cupertino.
01:04:42
◼
►
And so having that appear on your watch, whatever the live activity is on your watch, that's
01:04:48
◼
►
So I'm looking forward to that.
01:04:50
◼
►
That is a theme throughout.
01:04:51
◼
►
And I think that's a good-- what we have with our iPhones is it's always the primary-- it's
01:04:57
◼
►
always where things come first.
01:04:58
◼
►
It's always the device that no matter what is going on, if you're traveling or something,
01:05:02
◼
►
you're always going to at least have your phone.
01:05:04
◼
►
It makes a lot of sense to keep the iPhone as the center of everything and to bring those
01:05:09
◼
►
features to the other platforms when you can, but still having the-- because no matter what
01:05:14
◼
►
Apple tries to do, the iPhone's always going to be the primary computing device.
01:05:17
◼
►
So as much as they can embrace that and make the iPhone help the other platforms, as much
01:05:23
◼
►
as they can do it--
01:05:24
◼
►
And we'll see the iPhone helping the other platforms by making appearance on them later.
01:05:29
◼
►
Can I just say my favorite addition to watchOS, the Double Tap API.
01:05:36
◼
►
So tell me more-- I'm not trying to be funny.
01:05:37
◼
►
Tell me more about why that's so exciting for you.
01:05:39
◼
►
Because I don't have Double Tap, so I don't know what I'm missing out on.
01:05:41
◼
►
You couldn't-- remember, you couldn't do it before.
01:05:43
◼
►
Only Apple had access to it.
01:05:44
◼
►
But do you feel like it-- do you feel-- do you use the features
01:05:47
◼
►
in Apple stuff at all ever or no?
01:05:50
◼
►
No, because it's very slow and unreliable.
01:05:52
◼
►
So I try to use it to dismiss notifications or whatever.
01:05:55
◼
►
I have found it to be way too slow.
01:05:58
◼
►
And I have the Series 9.
01:05:59
◼
►
Like, I have the right hardware for it.
01:06:01
◼
►
And it's just really unreliable.
01:06:04
◼
►
And when it does work, it's still very-- it's much slower than doing it yourself.
01:06:09
◼
►
Because you have to give it a second to recognize it.
01:06:11
◼
►
And then it taps you to tell you, hey, I recognize this.
01:06:15
◼
►
And it shows a little overlay saying, Double Tap.
01:06:18
◼
►
So the reason I want it is that my customers want to use it.
01:06:21
◼
►
And I've gotten so many emails from people since it launched saying, hey,
01:06:25
◼
►
Double Tap doesn't work in your app.
01:06:27
◼
►
What the heck, man?
01:06:28
◼
►
Because they don't know that until this, the only thing third-party apps could do with
01:06:32
◼
►
it was use it to dismiss notifications or perform the primary action on a notification.
01:06:36
◼
►
That's all it could do.
01:06:37
◼
►
So apps-- and of course, what they expect from OverTap is play/pause.
01:06:41
◼
►
Like, when you-- of course that would be what it does, right?
01:06:44
◼
►
That doesn't make sense.
01:06:45
◼
►
And it just seemed like I was being neglectful by not having this in my app, when really
01:06:48
◼
►
I couldn't have it in my app.
01:06:49
◼
►
So now that's going to be good for the very basic thing.
01:06:52
◼
►
And whatever they add in the future in this area, if they add more gestures or more things
01:06:57
◼
►
like that, hopefully they will now add these switch to modifiers for them as well.
01:07:01
◼
►
Photos watch face gets better customization and will automatically find photos.
01:07:05
◼
►
I don't know what specifically that means.
01:07:07
◼
►
I mean, I understand those words.
01:07:08
◼
►
It meant machine learning.
01:07:09
◼
►
That's what they said.
01:07:10
◼
►
They still didn't-- so this-- now we're like a half hour.
01:07:12
◼
►
And they still didn't say AI once.
01:07:16
◼
►
iPadOS 18, yes?
01:07:19
◼
►
Or are we taking another pause?
01:07:20
◼
►
We don't need more pauses.
01:07:22
◼
►
Pause it out.
01:07:23
◼
►
We are paused out.
01:07:25
◼
►
I would like to make an opening statement about this.
01:07:28
◼
►
Everyone was waiting for Apple to say, don't worry, you guys.
01:07:33
◼
►
We've solved multitasking.
01:07:35
◼
►
Like I said, there was no rumors about that.
01:07:37
◼
►
No, there were no rumors.
01:07:38
◼
►
But like, just this morning--
01:07:39
◼
►
No expectations.
01:07:40
◼
►
I think it was just this morning.
01:07:41
◼
►
And if-- I apologize.
01:07:43
◼
►
I am not even going to be doing show notes for this episode.
01:07:46
◼
►
So the show notes are barren.
01:07:47
◼
►
But there was a Verge link that I'm not going to look up.
01:07:50
◼
►
But you can look it up yourselves.
01:07:51
◼
►
There's a Verge link where they talked about basically--
01:07:53
◼
►
I feel like it was literally this morning.
01:07:55
◼
►
Like, hey, we've got this incredible hardware.
01:07:57
◼
►
Where's the software?
01:07:59
◼
►
And so all of us--
01:08:00
◼
►
I agree, John, that nobody was necessarily expecting it.
01:08:03
◼
►
But we were all hoping for it.
01:08:05
◼
►
And it didn't land.
01:08:06
◼
►
And what did land, though, was actually for me, to this point,
01:08:10
◼
►
the most impressive stuff I saw in the entire keynote.
01:08:14
◼
►
Like, I was excited about other things, for sure.
01:08:16
◼
►
But the iPad demo--
01:08:19
◼
►
iPad OS demo blew my mind more than anything else
01:08:23
◼
►
I think I saw during the keynote.
01:08:24
◼
►
So what did we talk about?
01:08:25
◼
►
Well, first, it has the home screen customization
01:08:29
◼
►
Which, honestly, that's new.
01:08:30
◼
►
Yeah, it's not a given that it's going to get new features.
01:08:33
◼
►
Usually when something cool comes to like Springboard in iOS,
01:08:37
◼
►
the home screen, the widgets, usually that either doesn't
01:08:40
◼
►
come to the iPad at all that year,
01:08:41
◼
►
or maybe comes like the following year,
01:08:43
◼
►
or it comes to the iPad in a much more limited way.
01:08:45
◼
►
In this case, all of that home screen customization
01:08:47
◼
►
and stuff that is in iOS 18 is also all on iPad OS 18.
01:08:51
◼
►
So that was actually a pleasant surprise.
01:08:53
◼
►
Couldn't agree more.
01:08:54
◼
►
So there's that.
01:08:55
◼
►
The same story with Control Center
01:08:58
◼
►
and a lot of the photo stuff.
01:09:00
◼
►
They talked a lot about a floating tab bar,
01:09:02
◼
►
which I believe they either said or implied
01:09:05
◼
►
has an associated API where--
01:09:06
◼
►
Yes, it does.
01:09:07
◼
►
--this is like on the Apple TV+ app
01:09:08
◼
►
where there's a tab bar at the top.
01:09:10
◼
►
And I was like, OK, fine, whatever.
01:09:12
◼
►
And then they said, oh, and there's some--
01:09:14
◼
►
I don't know if it's like a hamburger button or whatever,
01:09:16
◼
►
but there's some button you can press.
01:09:17
◼
►
And then that tab bar will slide down into the--
01:09:20
◼
►
I was going to say the left, wherever your text starts.
01:09:22
◼
►
Into a sidebar.
01:09:23
◼
►
Into a sidebar.
01:09:24
◼
►
It'll slide down into dot leading.
01:09:25
◼
►
Into dot leading, right.
01:09:26
◼
►
Into a sidebar.
01:09:28
◼
►
And that, I thought, was extremely cool.
01:09:30
◼
►
And so they talked about-- they made a big happy stink
01:09:35
◼
►
about how there's improved and refined animations.
01:09:38
◼
►
They talked a little bit about SharePlay.
01:09:40
◼
►
And at this point, I started to pass out.
01:09:42
◼
►
But then they started talking about screen sharing.
01:09:44
◼
►
And I woke back up.
01:09:46
◼
►
And they said, there are a couple
01:09:47
◼
►
of very interesting features.
01:09:48
◼
►
You can tap and draw on the screen
01:09:51
◼
►
to instruct the remote users.
01:09:52
◼
►
So they showed putting a gigantic F-U.
01:09:56
◼
►
It's right here.
01:09:58
◼
►
It's right here.
01:09:58
◼
►
Circle the button in a big, hot pink marker.
01:10:01
◼
►
It's right here.
01:10:03
◼
►
Yeah, it's like a big arrow or circle or what have you.
01:10:06
◼
►
And they also said that you can ask-- the remote person
01:10:10
◼
►
can ask for remote control.
01:10:12
◼
►
So if you have grandma or grandpa or what have you,
01:10:14
◼
►
and they don't understand what's going on,
01:10:15
◼
►
but they live 500 miles away, you get on a SharePlay call.
01:10:19
◼
►
I'm not clear how you do the screen sharing.
01:10:21
◼
►
It doesn't really matter.
01:10:22
◼
►
But one way or another, you can say to grandma,
01:10:24
◼
►
I would like the control, please.
01:10:27
◼
►
And you can actually perform the operation
01:10:29
◼
►
that grandma or grandpa is trying to perform,
01:10:30
◼
►
which I was very excited about.
01:10:32
◼
►
For remote tech support.
01:10:33
◼
►
I'm so excited to use this.
01:10:36
◼
►
Back when I had needs like that with my grandparents,
01:10:38
◼
►
this would have been a godsend.
01:10:41
◼
►
I'm very happy for everybody who has to use this feature.
01:10:45
◼
►
This is going to be a big quality of life improvement.
01:10:50
◼
►
Then the Sherlocking continues.
01:10:53
◼
►
Poor James Thompson.
01:10:54
◼
►
I love James so much.
01:10:56
◼
►
Calculator is arriving on iPad.
01:10:58
◼
►
I genuinely double down on what you guys were saying earlier
01:11:02
◼
►
about how this doesn't necessarily hurt James,
01:11:04
◼
►
but it's not a fun feeling.
01:11:06
◼
►
And I don't know if it would help him necessarily.
01:11:09
◼
►
I mean, it does draw attention to our calculator apps.
01:11:12
◼
►
I think PCALC is going to be fine,
01:11:13
◼
►
because PCALC has, with the sole exception of the iPad,
01:11:17
◼
►
has always run on platforms that had built-in calculators.
01:11:21
◼
►
Well, I guess the Apple TV.
01:11:22
◼
►
But there were always Apple calculator apps
01:11:26
◼
►
on these platforms, and PCALC still had quite a market.
01:11:28
◼
►
I will say also, when they announced a calculator for iPad,
01:11:32
◼
►
as of yet, that got the biggest applause in the event.
01:11:35
◼
►
I would have expected emoji responses in iMessage
01:11:39
◼
►
to be a bigger applause, but no.
01:11:41
◼
►
Calculator for iPad, by far the biggest applause
01:11:44
◼
►
in that keynote up to this point.
01:11:46
◼
►
This is interesting with Casey being excited about the iPad stuff
01:11:48
◼
►
we're about to see in a second.
01:11:49
◼
►
It's kind of just because of the order,
01:11:52
◼
►
because as we'll see, this thing that was presented
01:11:55
◼
►
as a feature of calculator is not a feature of calculator.
01:11:58
◼
►
It is like an OS-wide service that appears in other OSs
01:12:01
◼
►
and other places, like it's everywhere.
01:12:02
◼
►
Well, I think it's just calculator and notes.
01:12:05
◼
►
Right, but it's clear that it's not
01:12:06
◼
►
a feature of the calculator app if Notes is using it.
01:12:09
◼
►
So it's interesting.
01:12:09
◼
►
So it's a framework.
01:12:10
◼
►
Yeah, so what we're going to talk about now is math notes.
01:12:13
◼
►
Like this is-- so calculator, it's calculator for the iPad,
01:12:16
◼
►
but then it has this other mode called math notes that--
01:12:20
◼
►
It's totally unrelated.
01:12:21
◼
►
It might as well have been a separate app.
01:12:22
◼
►
That's the thing.
01:12:23
◼
►
So there's all these apps now that are--
01:12:26
◼
►
all these features now that are kind of buried
01:12:28
◼
►
in Apple apps in weird places.
01:12:30
◼
►
So for instance, like--
01:12:31
◼
►
You hit that one secret button on calculator.
01:12:32
◼
►
There's like the document scanning
01:12:33
◼
►
that's just built into the files app or preview on the Mac.
01:12:36
◼
►
There's a whole document scanner you can use with phone cameras
01:12:40
◼
►
and stuff, and it's tucked into weird places.
01:12:42
◼
►
Like you don't even know it's there.
01:12:43
◼
►
Notes is the king of this.
01:12:45
◼
►
There are so many amazing features in Apple Notes
01:12:49
◼
►
that you wouldn't really expect to be in a notes app,
01:12:52
◼
►
and it doesn't really have that much to do with notes
01:12:54
◼
►
necessarily.
01:12:55
◼
►
And so this is one of them.
01:12:56
◼
►
So this math notes feature, this is what they demoed
01:12:59
◼
►
but I agree, Casey.
01:13:01
◼
►
I think this is one of the most impressive demos of the day.
01:13:03
◼
►
Math notes, it's kind of like a combination of calculator
01:13:08
◼
►
and solver with handwriting in the most amazing--
01:13:12
◼
►
it's like a handwritten solver, basically.
01:13:15
◼
►
Yeah, yeah, yeah.
01:13:15
◼
►
That's a good way to put it.
01:13:15
◼
►
The most amazing recognition and ways to play with numbers.
01:13:20
◼
►
So the way it works is you use the Apple Pencil,
01:13:22
◼
►
and you can just doodle up a note or whatever.
01:13:25
◼
►
And any-- if you write like 7 plus 4 equals,
01:13:29
◼
►
it will recognize that as a mathematical expression
01:13:32
◼
►
and stick the answer there.
01:13:34
◼
►
Well, but there-- wait, there's more.
01:13:35
◼
►
And there's so much more.
01:13:36
◼
►
But wait, there's more.
01:13:37
◼
►
Not only does it stick the answer there,
01:13:39
◼
►
the naive way of building this is it puts a mono-spaced font--
01:13:45
◼
►
What did you say?
01:13:45
◼
►
7 times 4 is 28 or what have you.
01:13:47
◼
►
It doesn't matter.
01:13:47
◼
►
It puts a 28 there in a mono-spaced font, right?
01:13:49
◼
►
Oh no, baby.
01:13:50
◼
►
It's going to try to mimic your own flippin' handwriting.
01:13:54
◼
►
How amazing is that?
01:13:56
◼
►
I don't understand how this is possible.
01:13:58
◼
►
And I think-- I don't know if this
01:13:59
◼
►
was part of the same thing, but I think it also improves--
01:14:01
◼
►
yeah, it improves your handwriting as well.
01:14:03
◼
►
So when you're scribbling the numbers, it's trying to-- oh,
01:14:06
◼
►
you made the circle on that 9 is a little bit squished.
01:14:09
◼
►
It opens it back up for you.
01:14:10
◼
►
So it's more legible to yourself later.
01:14:12
◼
►
And then it writes the answer.
01:14:14
◼
►
And then like Solver, which is a great app
01:14:15
◼
►
that we should link in the show notes that Casey's not making,
01:14:18
◼
►
that will-- it's a live thing.
01:14:21
◼
►
It's like a spreadsheet where the answer is based
01:14:23
◼
►
on the things that are before it.
01:14:24
◼
►
One of the really cool things I think I saw in the keynote
01:14:27
◼
►
was hard to tell because it was far away is what-- they were
01:14:30
◼
►
like, oh, you can change the numbers.
01:14:31
◼
►
And I'm like, oh, changing numbers.
01:14:32
◼
►
Is it going to make me get an eraser tool
01:14:34
◼
►
and then carefully scribble out the 9?
01:14:36
◼
►
And you can do-- the presenter did that.
01:14:38
◼
►
That was one of the choices.
01:14:39
◼
►
But I think there's like a gesture to sort of just
01:14:43
◼
►
swipe over the 9 and the whole-- it knows where the 9 is.
01:14:46
◼
►
You know what I mean?
01:14:46
◼
►
And the whole 9 disappears and you type a new number
01:14:48
◼
►
in its place.
01:14:49
◼
►
And there's a little-- if you hover over it,
01:14:51
◼
►
it shows a little slider above it.
01:14:53
◼
►
And you can just slide the value up and down.
01:14:55
◼
►
And it does more complicated math.
01:14:56
◼
►
So more ways for kids to cheat on their homework,
01:14:58
◼
►
not that they need it anymore because there's
01:15:00
◼
►
a million web-based tools that will do all this for you
01:15:03
◼
►
I mean, I personally am not a handwriting person.
01:15:05
◼
►
That's why I like computers.
01:15:06
◼
►
But tons of people are.
01:15:09
◼
►
I like solver.
01:15:10
◼
►
I like typing actual numbers.
01:15:12
◼
►
I don't want to see my handwriting.
01:15:13
◼
►
I don't want to handwrite math equations.
01:15:14
◼
►
But sometimes, especially if you don't know like math ML
01:15:16
◼
►
or how to make the big--
01:15:17
◼
►
if you're in an actual math class,
01:15:19
◼
►
we have big giant expressions with fractions and exponents
01:15:22
◼
►
and lots of parentheses and square roots
01:15:24
◼
►
over whole big things.
01:15:25
◼
►
And doing algebra, this looks like a great teaching tool.
01:15:29
◼
►
And it's essentially-- I don't know
01:15:31
◼
►
if it's a public framework, but it's
01:15:33
◼
►
a private framework that's used by two of Apple's apps.
01:15:34
◼
►
And it's so amazing.
01:15:35
◼
►
They should just spread it everywhere.
01:15:37
◼
►
Like Pencil Kit, I hope they eventually
01:15:39
◼
►
will make this a third-party thing that you can just pop up
01:15:41
◼
►
because it's just--
01:15:42
◼
►
what a great app.
01:15:43
◼
►
And for the iPad, it's their one app platform that has a pencil.
01:15:47
◼
►
This is-- what can you do with a pencil?
01:15:49
◼
►
They're really cranking up the features that--
01:15:51
◼
►
and we'll see more later-- that appear
01:15:53
◼
►
with the Pencil in Pencil Kit or with pencil-related things
01:15:56
◼
►
Yeah, because this feeds right into SmartScript, actually.
01:15:59
◼
►
This was-- Math Notes and Smart Script
01:16:01
◼
►
seem to be the same system.
01:16:03
◼
►
So between-- Calculator has Math Notes.
01:16:06
◼
►
Notes also has Math Notes.
01:16:08
◼
►
But Notes takes it further with the idea of Smart Script.
01:16:11
◼
►
So this is basically the engine that
01:16:13
◼
►
recreates your handwriting as like a font,
01:16:16
◼
►
basically, dynamically.
01:16:17
◼
►
And so as you hand write notes, it
01:16:20
◼
►
figures out what your handwriting looks like.
01:16:21
◼
►
As John mentions, if you kind of squish a letter
01:16:24
◼
►
or flub a letter, it will correct it
01:16:26
◼
►
to make it more readable as you go.
01:16:28
◼
►
And because what it's doing is converting your handwriting
01:16:30
◼
►
into reflowable text.
01:16:32
◼
►
So after you've handwritten a whole page of notes
01:16:35
◼
►
with the Apple Pencil in Apple Notes,
01:16:38
◼
►
you can delete words by scratching them out
01:16:40
◼
►
and then just collapses them.
01:16:41
◼
►
You can copy and paste.
01:16:42
◼
►
You can paste other text in, and it will paste it
01:16:44
◼
►
in your handwriting.
01:16:46
◼
►
It's just nuts.
01:16:47
◼
►
I said to Dan sitting next to me,
01:16:49
◼
►
I said, oh, they'll also sign checks for you.
01:16:50
◼
►
Yeah, right?
01:16:52
◼
►
Like, wait, it's pasting?
01:16:53
◼
►
Oh, this is-- can people--
01:16:56
◼
►
do kids still need doctor's notes or notes from your parents
01:16:59
◼
►
to get out of school?
01:17:01
◼
►
Oh, this would be great.
01:17:02
◼
►
No, kids have other ways of hacking that.
01:17:03
◼
►
They always do.
01:17:03
◼
►
But this is definitely a cool feature.
01:17:05
◼
►
And it also has kind of like shades of Newton.
01:17:07
◼
►
You know what I mean?
01:17:08
◼
►
Like being able to use handwriting as text
01:17:11
◼
►
and then interchangeably.
01:17:12
◼
►
It's amazing looking tech.
01:17:14
◼
►
I hope it works as well as the demos.
01:17:16
◼
►
It demoed phenomenally.
01:17:17
◼
►
If you watch nothing else from the ski note, if you ask me,
01:17:20
◼
►
watch this like 5 to 10 minute demonstration.
01:17:23
◼
►
It was-- I think Jenny Chen did it.
01:17:25
◼
►
It was phenomenal.
01:17:26
◼
►
It was so cool.
01:17:28
◼
►
It doesn't evaluate an expression
01:17:30
◼
►
until you draw an equal sign, which I thought was clever.
01:17:34
◼
►
She had a column of numbers.
01:17:36
◼
►
She was putting together like a--
01:17:37
◼
►
Budget or something.
01:17:39
◼
►
And there was a column of numbers.
01:17:40
◼
►
And she said, oh, I really wish I had a sum of this.
01:17:43
◼
►
And so she just underlined the bottom number.
01:17:45
◼
►
And then magically, a sum appears.
01:17:47
◼
►
It was unbelievable.
01:17:49
◼
►
She put a graph in one of them.
01:17:50
◼
►
She was doing like some physics problem.
01:17:52
◼
►
Yeah, it has a built in grapher because of course,
01:17:53
◼
►
might as well.
01:17:55
◼
►
It was incredible.
01:17:56
◼
►
It was really--
01:17:57
◼
►
I wish I was not like John and I hand wrote things.
01:18:00
◼
►
Yeah, right.
01:18:01
◼
►
I just never do.
01:18:02
◼
►
But again, if you don't know the correct note,
01:18:04
◼
►
if you ever tried to enter a complicated algebraic
01:18:06
◼
►
expression like in Wolfram Alpha or in something or whatever
01:18:10
◼
►
and you don't know how to do that,
01:18:11
◼
►
are you trying to use the tools?
01:18:12
◼
►
Oh, I need a big parentheses.
01:18:13
◼
►
I'm using a toolbar.
01:18:15
◼
►
If you don't know the ASCII syntax for it or whatever,
01:18:18
◼
►
it's just like, just let me draw it.
01:18:19
◼
►
Just let me draw the expression and this is really making
01:18:24
◼
►
this stuff more accessible.
01:18:25
◼
►
And again, there are web based tools that do this.
01:18:27
◼
►
And there are teaching tools that do all these things as well.
01:18:28
◼
►
And there's Wolfram Alpha exists.
01:18:30
◼
►
But this is on your iPad.
01:18:31
◼
►
This comes with your iPad.
01:18:33
◼
►
I think this also shows some of the kind of hilarious limits
01:18:36
◼
►
of the rumor game.
01:18:36
◼
►
Because it was rumor that there would be like MathML support
01:18:40
◼
►
in Notes, which like, OK.
01:18:42
◼
►
It undersells it, yeah.
01:18:43
◼
►
Yes, it's like that is sort of what this is.
01:18:46
◼
►
But it's totally missing what this really is.
01:18:49
◼
►
It's Newton plus solver.
01:18:52
◼
►
So we get to Mac OS 15.
01:18:53
◼
►
Sequoia is the answer, which is good because everyone
01:18:57
◼
►
definitely knows how to correctly pronounce and spell
01:19:00
◼
►
But here we are.
01:19:03
◼
►
Mac OS 15 gets all the Notes stuff we just talked about.
01:19:06
◼
►
Well, I guess except the pencil related things.
01:19:08
◼
►
Not necessarily because people can use tablets--
01:19:12
◼
►
Oh, that's true.
01:19:13
◼
►
Drawing tablets with the Mac.
01:19:13
◼
►
I wonder if a wacko would work.
01:19:15
◼
►
I didn't think about that.
01:19:15
◼
►
I don't know.
01:19:18
◼
►
Then this is what I was alluding to earlier.
01:19:21
◼
►
They had a big section on continuity.
01:19:22
◼
►
And I think for me, if you're going to watch one thing,
01:19:25
◼
►
watch Math Notes.
01:19:26
◼
►
If you're going to watch two things,
01:19:28
◼
►
watch this iPhone mirroring stuff.
01:19:29
◼
►
So what they said was, hey, what about occasions
01:19:32
◼
►
when your phone is out of reach, but you want to do something
01:19:35
◼
►
with your phone?
01:19:36
◼
►
Well, what they demoed was you can mirror your phone's screen
01:19:42
◼
►
onto your Mac.
01:19:43
◼
►
And then not only that, but you can
01:19:45
◼
►
interact with your phone using your keyboard and mouse, which
01:19:49
◼
►
was very freaking cool.
01:19:52
◼
►
And then apparently you can pinch to zoom?
01:19:54
◼
►
I mean, they mentioned that.
01:19:55
◼
►
I was wondering.
01:19:56
◼
►
As soon as they did that, I'm like, oh,
01:19:57
◼
►
that looks like a simulator.
01:19:58
◼
►
Are they going to make users hold down option
01:20:00
◼
►
to get the little two balls or whatever?
01:20:02
◼
►
I'm like, there's no way that they're
01:20:03
◼
►
going to ask users to do that.
01:20:04
◼
►
But then I realized everyone has a trackpad,
01:20:05
◼
►
so you can just pinch.
01:20:06
◼
►
That's true.
01:20:07
◼
►
This is your virtual phone on your Mac screen.
01:20:09
◼
►
I mean, you feel like, oh, how lazy are you?
01:20:11
◼
►
Why don't you just go get your phone?
01:20:12
◼
►
But honestly, it's a back door to let you run iPhone apps
01:20:15
◼
►
on your Mac, essentially.
01:20:16
◼
►
Previously, only iPad apps could be run on your Mac
01:20:18
◼
►
and their little windows.
01:20:19
◼
►
Now your whole freaking phone is there on your Mac.
01:20:21
◼
►
I think this is a great feature.
01:20:23
◼
►
It's such a perfect integration of because they
01:20:25
◼
►
make the phone platform and the Mac--
01:20:28
◼
►
I give this two thumbs up.
01:20:30
◼
►
I mean, I don't even know how often I'll use it,
01:20:32
◼
►
but it just seems like something that should be possible,
01:20:34
◼
►
and now it is.
01:20:35
◼
►
And think of so many--
01:20:37
◼
►
also, notifications from the phone will show up on the Mac.
01:20:40
◼
►
The audio from the phone comes through the Mac.
01:20:43
◼
►
You can have standby support, where
01:20:45
◼
►
the phone can be on a charging stand in standby,
01:20:47
◼
►
showing some widgets next to your desk,
01:20:48
◼
►
and you can be using it on the Mac.
01:20:50
◼
►
Like, you can drag and drop files to the phone from the Mac.
01:20:53
◼
►
I think this is going to be one of those things
01:20:55
◼
►
that we start to use all the time and not even realize it.
01:20:58
◼
►
And wonder how we lived before it existed.
01:21:00
◼
►
Even just something simple, like what
01:21:02
◼
►
if you break your screen on your phone,
01:21:04
◼
►
and you need to get info on it or something?
01:21:06
◼
►
Extend the life of phones with broken screens.
01:21:08
◼
►
I need to bring the laptop around with me to use my phone.
01:21:11
◼
►
Yeah, or get info off of it before you get a replacement
01:21:14
◼
►
phone from it.
01:21:14
◼
►
Maybe Apple will start selling a headless iPhone shuffle.
01:21:19
◼
►
I can't even with that.
01:21:20
◼
►
It's like a stick of Trident gum,
01:21:22
◼
►
but you need another device to use it.
01:21:26
◼
►
I just want to reiterate what Marco just
01:21:27
◼
►
said, because he went so fast.
01:21:29
◼
►
But I think it's important.
01:21:30
◼
►
A notification comes through on your Mac.
01:21:33
◼
►
It looks like it is peer with all your Mac notifications.
01:21:37
◼
►
You can click on it on the Mac, and it will start up
01:21:40
◼
►
the phone mirroring.
01:21:42
◼
►
So you'll see your phone, and then you
01:21:44
◼
►
can interact with that notification,
01:21:46
◼
►
because your phone has now started
01:21:48
◼
►
whatever app that notification came from, which is incredible.
01:21:51
◼
►
And like you said a moment ago, you could have standby.
01:21:53
◼
►
I don't personally use standby, just
01:21:55
◼
►
because I don't really have a dock that makes it easy.
01:21:58
◼
►
But I love the idea of it.
01:21:59
◼
►
But if you are a standby person, you
01:22:01
◼
►
can have your phone sitting next to your computer.
01:22:04
◼
►
And similar to how CarPlay eventually
01:22:07
◼
►
started working, where it was not literally
01:22:10
◼
►
what you were doing on your phone,
01:22:11
◼
►
it became like a second screen, well, standby
01:22:14
◼
►
can remain up while you're interacting with your phone
01:22:19
◼
►
on the computer.
01:22:20
◼
►
So your phone is doing two things concurrently.
01:22:23
◼
►
Very, very, very cool stuff.
01:22:24
◼
►
And this is also--
01:22:25
◼
►
just now that it needs to be reinforced.
01:22:27
◼
►
So reinforcing the Mac's dominance as the platform
01:22:30
◼
►
where you can do everything.
01:22:31
◼
►
You can run iPad apps.
01:22:32
◼
►
You can run Mac apps.
01:22:33
◼
►
You can use your entire phone.
01:22:35
◼
►
It integrates with all these things.
01:22:36
◼
►
You can develop apps for all those platforms.
01:22:37
◼
►
The only thing you can't do is the Vision OS stuff.
01:22:39
◼
►
And that still kind of seems like it's off in the corner.
01:22:41
◼
►
And the pencil, too.
01:22:43
◼
►
Yeah, I do wonder about the pencil.
01:22:45
◼
►
Obviously, you can use an iPad as sidecar.
01:22:46
◼
►
I don't think there's any pencil support in that mode.
01:22:49
◼
►
But technically speaking, it seems
01:22:50
◼
►
like it would be plausible to allow
01:22:52
◼
►
you to use your Apple pencil on your iPad screen
01:22:54
◼
►
when using a sidecar.
01:22:55
◼
►
And we'll see how--
01:22:56
◼
►
I mean, they should just make Touch Max with pencil support.
01:22:58
◼
►
I mean, they'll get to it eventually, but not this one.
01:22:59
◼
►
And cellular and OLED.
01:23:01
◼
►
Well, get in line.
01:23:02
◼
►
OLED we're going to get.
01:23:03
◼
►
Don't worry about it.
01:23:04
◼
►
That's coming.
01:23:06
◼
►
What else do they have?
01:23:08
◼
►
Video conferencing stuff.
01:23:09
◼
►
Window tiling.
01:23:10
◼
►
You blew right past that.
01:23:11
◼
►
Oh, I'm sorry.
01:23:11
◼
►
You're right.
01:23:11
◼
►
That's true.
01:23:12
◼
►
There goes a bunch of apps that manage Windows.
01:23:14
◼
►
Don't worry, John.
01:23:14
◼
►
You're totally safe from being Sherlocked.
01:23:16
◼
►
Well, the app doesn't do any of this stuff.
01:23:18
◼
►
Again, they still don't expose enough APIs
01:23:20
◼
►
for you to do something good.
01:23:20
◼
►
I know window tiling is one of the few things you can do.
01:23:23
◼
►
Because you don't need interactive support for it.
01:23:24
◼
►
It's like, oh, I just enter a keyboard command.
01:23:26
◼
►
And the active window goes into the third or a quarter
01:23:28
◼
►
or whatever.
01:23:29
◼
►
But real-time interactive window dragging,
01:23:31
◼
►
like when you're dragging a shape in Adobe Illustrator
01:23:34
◼
►
or Affinity Designer or something,
01:23:36
◼
►
there's no APIs for that.
01:23:37
◼
►
And Apple doesn't do it itself.
01:23:38
◼
►
But yeah, this does hurt a lot of apps that do the same thing.
01:23:41
◼
►
This is just catch up with Windows.
01:23:42
◼
►
They've had this forever.
01:23:43
◼
►
People just expect to be able to yank a window
01:23:44
◼
►
to the side of the screen and have it tile.
01:23:46
◼
►
And now it does.
01:23:47
◼
►
And it will hurt a bunch of third-party apps.
01:23:48
◼
►
But third-party apps do way more than this.
01:23:50
◼
►
So again, there's room for them to exist.
01:23:52
◼
►
Though this is another moment where
01:23:53
◼
►
there was a lot of applause when we were sitting there.
01:23:56
◼
►
And it's so funny, too, because you guys have talked about it,
01:23:57
◼
►
or maybe just Marco, I guess, has talked about in the past.
01:24:00
◼
►
They have the pregnant pause when
01:24:02
◼
►
they're waiting for people to stop clapping
01:24:04
◼
►
because it's a recorded video.
01:24:05
◼
►
They just keep going.
01:24:05
◼
►
They just keep plowing forward.
01:24:07
◼
►
But there was a lot of applause for that.
01:24:09
◼
►
So like I said, there's some video conferencing stuff.
01:24:11
◼
►
They have Zoom-style fake backgrounds.
01:24:13
◼
►
I thought they already had that.
01:24:14
◼
►
But it's a catch-up feature.
01:24:15
◼
►
System-wide background replacement for any video input.
01:24:18
◼
►
And presumably, they'll do a less janky job of it.
01:24:20
◼
►
I mean, their demo looked pristine.
01:24:22
◼
►
But we'll see.
01:24:23
◼
►
It's a competition to see who has the best machine learning.
01:24:25
◼
►
Everyone's demos always look pristine.
01:24:27
◼
►
Let's see what happens when you're in dim lighting
01:24:28
◼
►
and stuff like that.
01:24:29
◼
►
All right, so real-time follow-up.
01:24:31
◼
►
I just adjusted where I was sitting.
01:24:33
◼
►
And I definitely kicked over my capped water bottle.
01:24:35
◼
►
So maybe John was right about this.
01:24:37
◼
►
Because I had it at the edge of my chair.
01:24:39
◼
►
And I adjusted where I was sitting and cleaned.
01:24:41
◼
►
See, levels.
01:24:42
◼
►
Levels are important.
01:24:43
◼
►
Levels, levels.
01:24:43
◼
►
I've had opinions about where 1Password has been
01:24:51
◼
►
going for the last year or two.
01:24:53
◼
►
And I will say that there is now a passwords
01:24:57
◼
►
app on all of the platforms, including Windows
01:25:01
◼
►
on the iCloud for Windows app.
01:25:03
◼
►
And I will be exploring that later this year.
01:25:05
◼
►
And I'm going to--
01:25:07
◼
►
That's all I'm going to say about that for now.
01:25:10
◼
►
It is not as full featured as 1Password by any means.
01:25:13
◼
►
In particular, it seems-- I haven't explored yet
01:25:15
◼
►
whether there's any kind of group functionality,
01:25:17
◼
►
like family sharing and things like that.
01:25:19
◼
►
I had somebody talk to me--
01:25:20
◼
►
Oh, there is.
01:25:20
◼
►
We have that already?
01:25:21
◼
►
So I had somebody reach out on Mastodon,
01:25:24
◼
►
because I think I'd cast out a question about this.
01:25:27
◼
►
And I know that there is something, but I don't know.
01:25:30
◼
►
Talk about it on this show.
01:25:30
◼
►
Now you're both like this.
01:25:32
◼
►
I'm currently using it.
01:25:33
◼
►
Yes, you can make arbitrary groups
01:25:35
◼
►
where you share things in your iCloud keychain.
01:25:38
◼
►
I have two groups.
01:25:38
◼
►
I have family passwords and parent passwords.
01:25:41
◼
►
And once you put a thing into that group,
01:25:43
◼
►
it is shared with the people who you say--
01:25:45
◼
►
just completely arbitrary.
01:25:46
◼
►
It works great.
01:25:47
◼
►
I mean, for passwords, the verification
01:25:49
◼
►
goes the whole nine yards.
01:25:50
◼
►
And yeah, this app--
01:25:51
◼
►
I mean, people have been asking for this because passwords--
01:25:54
◼
►
the keychain access app is obscure and weird.
01:25:57
◼
►
That is not for regular people to use.
01:25:58
◼
►
I don't think it's for me to use, for goodness sakes.
01:26:00
◼
►
It's not for any people to use.
01:26:02
◼
►
But then there was the password settings thing on iOS,
01:26:05
◼
►
and then the password preference pane/whatever
01:26:07
◼
►
they're called in settings.
01:26:08
◼
►
But it's just kind of buried.
01:26:09
◼
►
And people were making shortcuts to launch it,
01:26:10
◼
►
but now there will be a dedicated app,
01:26:12
◼
►
so it's more exposed.
01:26:13
◼
►
It just makes it feel more comfortable, like, yes,
01:26:15
◼
►
when I need to get my passwords.
01:26:17
◼
►
Now, keychain access does more than just passwords.
01:26:20
◼
►
Keychain access has secure notes.
01:26:21
◼
►
Keychain access has all your stupid developer certificates
01:26:25
◼
►
That stuff isn't exposed in passwords.
01:26:27
◼
►
That is in the keychain, so to speak,
01:26:29
◼
►
and that is important stuff.
01:26:30
◼
►
And so keychain access has to still exist,
01:26:32
◼
►
but regular people should not touch that,
01:26:34
◼
►
because you can really hose yourself by like, oh, I
01:26:35
◼
►
don't know what these certificates are.
01:26:36
◼
►
Let me delete all these.
01:26:37
◼
►
Like, even if you're not a developer, don't do that.
01:26:39
◼
►
Like, your root SSL certificates are represented in there.
01:26:42
◼
►
There's your login keychain and the system keychain and things
01:26:44
◼
►
that people don't have to understand.
01:26:46
◼
►
Plus, making-- what do we call it--
01:26:48
◼
►
signing requests for making SSL certificates
01:26:50
◼
►
if you're not using Let's Encrypt, which you should be.
01:26:53
◼
►
Like, keychain access will soldier on.
01:26:55
◼
►
But since the last version of Mac OS,
01:26:57
◼
►
when you launch keychain access, it says, hey,
01:26:59
◼
►
are you sure you want to launch keychain access?
01:27:01
◼
►
Yes, the passwords are over here.
01:27:02
◼
►
Yeah, do you want me to just open the passwords preference
01:27:05
◼
►
And now I hope it will say, actually,
01:27:07
◼
►
there's a whole other app called passwords.
01:27:08
◼
►
You should go to that one.
01:27:09
◼
►
And it's a Swift UI app, and it looks nice.
01:27:11
◼
►
And I hope it doesn't have write-aligned text
01:27:12
◼
►
fields for the passwords, but we'll see how that goes.
01:27:15
◼
►
Yeah, I think this is--
01:27:17
◼
►
there are going to be some things, like secure notes,
01:27:19
◼
►
you mentioned are not there.
01:27:20
◼
►
Like, you know where secure notes are?
01:27:23
◼
►
Like, you can make a locked note and have all the--
01:27:25
◼
►
But those aren't in keychain.
01:27:26
◼
►
I do wonder how they're going to square this,
01:27:28
◼
►
because I do have secure--
01:27:29
◼
►
like, the secure notes in Notes are in the Notes database
01:27:31
◼
►
and encrypted.
01:27:32
◼
►
The secure notes in keychain access, I believe,
01:27:34
◼
►
are in the keychain with all of the-- in iCloud keychain
01:27:37
◼
►
with all the secure synced stuff.
01:27:38
◼
►
I may be wrong about that, but I think
01:27:40
◼
►
there are two different worlds, and I
01:27:42
◼
►
wonder how they're going to reconcile that.
01:27:43
◼
►
Because that is a feature that people like 1Password,
01:27:45
◼
►
like, they just want to, like--
01:27:46
◼
►
here's an arbitrary list of secure stuff
01:27:48
◼
►
that I want to be locked up or whatever.
01:27:50
◼
►
And you can do that in keychain, but it's
01:27:52
◼
►
a terrible interface for it.
01:27:54
◼
►
Then using it in Notes is much nicer,
01:27:55
◼
►
so I hope that's what people are doing.
01:27:57
◼
►
I wonder if maybe they're just trying
01:27:58
◼
►
to keep the iCloud keychain data size small and lightweight.
01:28:02
◼
►
Like, you know, if you--
01:28:03
◼
►
with 1Password, you can have just arbitrary files
01:28:06
◼
►
that you stick in there.
01:28:07
◼
►
And the way it does it is honestly kind of rough.
01:28:09
◼
►
But you-- so I'd, like, scan my driver's license
01:28:12
◼
►
and have the picture of it in there, for instance.
01:28:14
◼
►
Like, if you put, like, one image or one PDF into keychain,
01:28:18
◼
►
it's going to be way larger probably
01:28:20
◼
►
than everything else in there.
01:28:21
◼
►
And that's just for one of them.
01:28:22
◼
►
So, like, if they keep the size of everything small,
01:28:24
◼
►
maybe that helps them keep it fast and reliable.
01:28:27
◼
►
All right, they talked about Safari for a bit.
01:28:30
◼
►
They said the quote, "private browsing."
01:28:32
◼
►
That's actually private, which I thought was funny.
01:28:34
◼
►
They didn't go deeper into that, but we all know who they're--
01:28:37
◼
►
And then the next line was, "if you've
01:28:39
◼
►
missed anything we've added to Safari over the last few years,
01:28:42
◼
►
it's time to check it out."
01:28:43
◼
►
They were clearly targeting Chrome.
01:28:45
◼
►
Because, like, look, the reality is
01:28:47
◼
►
Safari has a Chrome problem.
01:28:49
◼
►
Chrome is way more popular than Safari,
01:28:51
◼
►
and Google is being extremely aggressive at getting
01:28:54
◼
►
the most people possible to switch to it.
01:28:56
◼
►
Like, Google is so-- like, the second you sign into any Google
01:28:59
◼
►
service, you get that email saying, like,
01:29:01
◼
►
complete your Google setup.
01:29:02
◼
►
And it, like, hammers home.
01:29:03
◼
►
You've got to install Chrome.
01:29:04
◼
►
You've got to install Chrome on all your devices.
01:29:06
◼
►
Like, the fact is, Safari has a severe problem
01:29:09
◼
►
with, like, losing people to Chrome a lot over the years.
01:29:13
◼
►
So this was clearly targeted at that.
01:29:15
◼
►
And I think it's good to see Apple being a bit aggressive
01:29:18
◼
►
there, because they have to be.
01:29:19
◼
►
Yep, couldn't agree more.
01:29:21
◼
►
So they highlighted, quote, "machine learning,"
01:29:24
◼
►
quote, which includes directions to things
01:29:27
◼
►
that it detects on the page, summaries of pages,
01:29:30
◼
►
quick links to learn more about, like, people, movie, music, TV
01:29:34
◼
►
This was not a call sheet thing in my eyes.
01:29:36
◼
►
That's just, you know, hey, there's--
01:29:38
◼
►
Basically, this is all kind of Safari saying,
01:29:41
◼
►
the web has junked up with crap.
01:29:42
◼
►
And we know when you land on a web page,
01:29:45
◼
►
maybe you just don't know what the deal is with this TV show.
01:29:47
◼
►
And you can't see it through the barrage
01:29:49
◼
►
of ads and other garbage.
01:29:50
◼
►
And so this reader mode that's existed for years,
01:29:53
◼
►
it will summarize it.
01:29:54
◼
►
And if there's media stuff, it will try to extract that stuff
01:29:56
◼
►
and probably give you a button that you can see it
01:29:58
◼
►
on Apple TV+.
01:29:59
◼
►
You know, like, it's an opportunity
01:30:01
◼
►
for them to integrate with streaming services.
01:30:03
◼
►
But it's also just--
01:30:04
◼
►
a lot of Safari's tools seem like the web is an annoying
01:30:08
◼
►
place to be sometimes.
01:30:10
◼
►
And we will try to use our application to scrape out
01:30:13
◼
►
the stuff that you actually want and present it to you
01:30:15
◼
►
in a nice way.
01:30:15
◼
►
And I appreciate that.
01:30:17
◼
►
Reader includes now a table of contents
01:30:20
◼
►
and a summary, which I thought was very cool.
01:30:23
◼
►
It's in, like, a little sidebar area, which was neat.
01:30:25
◼
►
Then they talked about viewer, which was specifically
01:30:28
◼
►
for video playback.
01:30:30
◼
►
It's unclear.
01:30:31
◼
►
Like, John wrote in the notes, does this work on YouTube,
01:30:33
◼
►
question mark?
01:30:34
◼
►
We don't know.
01:30:36
◼
►
So it's unclear what the situation is.
01:30:38
◼
►
But it has a mode where the video will take up
01:30:42
◼
►
the entire window area, which I really liked.
01:30:44
◼
►
Because I don't necessarily want to go full screen with video.
01:30:46
◼
►
But I wanted to make the video take up the entire window
01:30:49
◼
►
And it uses the native player, too.
01:30:51
◼
►
Like, if you watch some web page that has video,
01:30:52
◼
►
and it's some weird video player,
01:30:54
◼
►
and there's a bunch of blinking ads in the corner,
01:30:55
◼
►
and there's some thing-- like, this
01:30:57
◼
►
will yank it out into the native player somehow.
01:31:00
◼
►
That's why I asked if it works on YouTube,
01:31:01
◼
►
because how would that work?
01:31:02
◼
►
There's a bunch of utilities that do that with YouTube now,
01:31:04
◼
►
where they'll essentially modify the markup on the page
01:31:06
◼
►
to let you use the native player,
01:31:08
◼
►
turn it into an HTML5 player.
01:31:10
◼
►
So that would be the first thing I'd try on that.
01:31:12
◼
►
But it's good to have that feature available.
01:31:14
◼
►
These features are great, because if you
01:31:15
◼
►
don't want to use them, they don't
01:31:17
◼
►
mess with your web browsing.
01:31:18
◼
►
But it's always worth a try.
01:31:20
◼
►
And I'm using Reader more and more often,
01:31:22
◼
►
just because so many web pages are so junked up,
01:31:24
◼
►
it's impossible to actually read them.
01:31:26
◼
►
Oh, it's bad.
01:31:27
◼
►
John, there was some talk about gaming.
01:31:32
◼
►
Yeah, so the game porting toolkit,
01:31:34
◼
►
they are not budging on this, the idea
01:31:37
◼
►
that this is a tool for you to port your games,
01:31:40
◼
►
as opposed to what other people like Valve
01:31:43
◼
►
has done with the Steam Deck and everything, of saying, no, no,
01:31:47
◼
►
Apple will take care of this.
01:31:48
◼
►
You just run your game, and we will make it work on the Mac.
01:31:51
◼
►
They're saying, no, this is a tool for you, developer,
01:31:53
◼
►
for you to make your game to run on the Mac,
01:31:54
◼
►
because we want it to be essentially a native Mac game.
01:31:57
◼
►
We don't want this to be a way to run Windows games on Mac,
01:32:01
◼
►
although it is.
01:32:02
◼
►
And they mentioned crossover and whatever that whiskey thing is.
01:32:05
◼
►
There's a bunch of other tools that use the game party toolkit
01:32:07
◼
►
to essentially provide an app that's like, hey, go here,
01:32:10
◼
►
and you can play Windows games on your Mac,
01:32:11
◼
►
and you totally can, right?
01:32:12
◼
►
But Apple is not on board with that.
01:32:14
◼
►
And when they said this, it was like,
01:32:16
◼
►
why don't you do what they're doing, Apple?
01:32:17
◼
►
But no, Apple says, we want you to port your games,
01:32:20
◼
►
and we've found two more developers who are porting
01:32:23
◼
►
games that you played three years ago.
01:32:25
◼
►
I mean, the most interesting thing
01:32:26
◼
►
is they mentioned Frostpunk, which I don't know much about.
01:32:29
◼
►
But they mentioned Control, which
01:32:31
◼
►
was one of the first sort of AAA games
01:32:33
◼
►
to really emphasize ray tracing.
01:32:37
◼
►
They're like, hey, you just got an Nvidia
01:32:38
◼
►
carb with ray tracing support, and you might not
01:32:40
◼
►
know what the hell that's good for.
01:32:41
◼
►
Well, get Control, because it has the mode,
01:32:43
◼
►
but you can turn on ray tracing, and it looks kind of cool.
01:32:45
◼
►
And again, that was years ago.
01:32:46
◼
►
Now it's available on the Mac.
01:32:48
◼
►
As you know, Macs and iPads have ray tracing hardware
01:32:51
◼
►
in their GPUs, and so that's a good get for them.
01:32:54
◼
►
But this is back in time.
01:32:56
◼
►
So if you've been wanting to play Control,
01:32:57
◼
►
which is a pretty cool game, you can try it out now on your Mac.
01:33:00
◼
►
And then Ubisoft out there talking about Prince of Persia
01:33:03
◼
►
and the new Assassin's Creed game.
01:33:04
◼
►
So Apple is schmoozing the developers enough
01:33:06
◼
►
to get them on board, and some of these games
01:33:09
◼
►
are not three-year-old games.
01:33:10
◼
►
Like the Assassin's Creed is the upcoming one,
01:33:12
◼
►
so there's support there.
01:33:13
◼
►
So they seem to be making some headway
01:33:15
◼
►
with the big developers.
01:33:16
◼
►
It's kind of one of those things where Apple
01:33:19
◼
►
has to get to the point where when a cool game is coming out,
01:33:22
◼
►
a Mac user doesn't have to think about whether it will
01:33:25
◼
►
be available on their platform.
01:33:27
◼
►
All they have to ask is, is this a platform exclusive?
01:33:29
◼
►
Because that's what people think, oh,
01:33:30
◼
►
is the game coming out?
01:33:31
◼
►
And what do they want to know?
01:33:32
◼
►
Is this a platform exclusive?
01:33:33
◼
►
Is it only on PlayStation?
01:33:34
◼
►
Is it only on Xbox?
01:33:35
◼
►
Is it only on PC?
01:33:37
◼
►
And if they say no, it's a cross-platform game,
01:33:39
◼
►
which most AAA games are because they want
01:33:40
◼
►
to make money from everybody.
01:33:41
◼
►
When they say that, Mac users know they're still excluded.
01:33:44
◼
►
No, it's not platform exclusive.
01:33:45
◼
►
It's everywhere, except for the Mac, obviously.
01:33:48
◼
►
That's the hurdle they have to get over.
01:33:50
◼
►
And so I bring up a new developer every year
01:33:52
◼
►
to say, we have this game.
01:33:53
◼
►
We have that game.
01:33:54
◼
►
They have to get it to the point where gamers, when they hear
01:33:57
◼
►
a game is not platform exclusive,
01:33:59
◼
►
can assume that it's on the Mac, and we are so far from that.
01:34:01
◼
►
But baby steps.
01:34:02
◼
►
Every year there's one more developer, one more game.
01:34:05
◼
►
It's just at this rate, it'll be like 2076 before that happens.
01:34:09
◼
►
Do we know, Jon, if your ancient piece of garbage slow Mac Pro
01:34:13
◼
►
is going to be able to work with anything?
01:34:15
◼
►
It seems like no.
01:34:16
◼
►
I mean, they were pretty clear.
01:34:19
◼
►
I mean, they didn't say anything about OS supported platforms.
01:34:22
◼
►
But I would assume-- this is a bad assumption.
01:34:24
◼
►
Previous years, you would assume that if this version of Mac OS
01:34:28
◼
►
did not support Intel, they would have set it
01:34:30
◼
►
in the keynote.
01:34:30
◼
►
But in recent years, it seems like they
01:34:33
◼
►
leave unfortunate news out of the keynote
01:34:35
◼
►
and maybe say it for State of the Union or something.
01:34:37
◼
►
But they didn't say anything.
01:34:38
◼
►
So I'm assuming Sequoia still runs
01:34:41
◼
►
on Intel minus all the features we're going
01:34:43
◼
►
to talk about in a little bit.
01:34:44
◼
►
But just, you know, a listener sent in a link
01:34:50
◼
►
to our predictions from past episodes.
01:34:52
◼
►
We mentioned that in the last episode.
01:34:54
◼
►
Like, what were our predictions?
01:34:55
◼
►
I was kind of surprised to hear myself
01:34:57
◼
►
saying that my prediction was WWC 2024,
01:34:59
◼
►
but then I heard the reasoning.
01:35:01
◼
►
That would be pretty much the exact same time span
01:35:03
◼
►
for when Apple dropped PowerPC support, which
01:35:05
◼
►
is three years and seven months after the first Intel Mac.
01:35:07
◼
►
So if they followed the same logic,
01:35:10
◼
►
they should have dropped Intel support today.
01:35:14
◼
►
I don't think they did.
01:35:15
◼
►
So therefore, they're going even longer with this transition.
01:35:17
◼
►
So good for them.
01:35:18
◼
►
Casey's prediction was 2026, and Marco just waffled.
01:35:21
◼
►
Usually that's my competition.
01:35:22
◼
►
Sounds about right, yeah.
01:35:25
◼
►
Now we have a little over an hour in.
01:35:27
◼
►
We have our first mention of artificial intelligence.
01:35:32
◼
►
This was-- again, I think I'm going to request and give
01:35:35
◼
►
myself an opening statement.
01:35:37
◼
►
I felt like what we all wanted, or certainly what I wanted,
01:35:40
◼
►
and I think we talked about this last week,
01:35:41
◼
►
was we wanted the adults in the room.
01:35:44
◼
►
And that's not really to slag on Microsoft necessarily
01:35:48
◼
►
or Google, but we wanted somebody with a little bit of--
01:35:52
◼
►
I can't think of ways to say this
01:35:53
◼
►
that aren't going to sound mean, but here we are,
01:35:56
◼
►
and I'm very tired.
01:35:57
◼
►
So we wanted people that weren't--
01:36:00
◼
►
that were going to have taste and have not class,
01:36:03
◼
►
but just apply artificial intelligence and large language
01:36:07
◼
►
models and things like that in ways that
01:36:09
◼
►
actually help regular humans.
01:36:12
◼
►
Not for me to figure out an FFmpeg incantation,
01:36:14
◼
►
but to do normal stuff.
01:36:16
◼
►
And Craig comes out, or maybe it was Tim.
01:36:19
◼
►
I think it was Craig, though.
01:36:20
◼
►
It was Tim first.
01:36:22
◼
►
And says-- several things I'm going to read.
01:36:24
◼
►
These may not be verbatim quotes,
01:36:25
◼
►
but I think they're worth noting.
01:36:28
◼
►
They called it Apple Intelligence.
01:36:29
◼
►
I don't recall exactly when the reveal was,
01:36:31
◼
►
but they said, we want to ensure that the outcome of using
01:36:35
◼
►
AI features reflects the principles
01:36:36
◼
►
at the core of our promise.
01:36:38
◼
►
We want them to be powerful enough to help with the things
01:36:40
◼
►
that matter most.
01:36:42
◼
►
They need to be intuitive and easy to use,
01:36:44
◼
►
deeply integrated into product experiences,
01:36:47
◼
►
and they should understand you and be grounded
01:36:49
◼
►
in your personal context.
01:36:51
◼
►
What is your routine?
01:36:53
◼
►
Who are your relationships with?
01:36:54
◼
►
What kind of communications do you participate in?
01:36:57
◼
►
And obviously, privacy is a very big deal.
01:36:59
◼
►
And so they say, oh, I think this
01:37:00
◼
►
is when the reveal was.
01:37:01
◼
►
It goes beyond artificial intelligence.
01:37:03
◼
►
It's personal intelligence.
01:37:04
◼
►
It's now Apple Intelligence.
01:37:05
◼
►
So what you were saying about being adults and--
01:37:09
◼
►
it could be phrased as being less hasty,
01:37:11
◼
►
being more conservative.
01:37:12
◼
►
But really what it is is Apple's implementation of everything,
01:37:19
◼
►
as I said, it reflects a value system.
01:37:21
◼
►
Apple has a value system that informs their products.
01:37:24
◼
►
Every company does.
01:37:25
◼
►
But the thing is, the value system of many companies
01:37:28
◼
►
is unattractive to customers.
01:37:30
◼
►
So they don't talk about it.
01:37:32
◼
►
Their value system may be, we need as much
01:37:33
◼
►
of your information as possible because we
01:37:35
◼
►
can sell ads better to it.
01:37:36
◼
►
And they don't want to say that to you
01:37:38
◼
►
because it doesn't make you want to buy their products.
01:37:40
◼
►
But that is their value system, and it is embodied
01:37:42
◼
►
in their product.
01:37:44
◼
►
And so Apple's value system--
01:37:46
◼
►
and again, it's not because Apple is magnanimous or whatever.
01:37:48
◼
►
Apple's business model does not involve selling advertisement
01:37:51
◼
►
and collecting information about you to sell to advertisers.
01:37:54
◼
►
That's why they do this.
01:37:55
◼
►
It's not because Apple is good.
01:37:56
◼
►
And you can say, well, maybe--
01:37:57
◼
►
because Apple does have ad-type businesses or whatever.
01:37:59
◼
►
And we've talked about Apple's conflicts
01:38:01
◼
►
with their services business versus other ones or whatever.
01:38:03
◼
►
But Apple's value system is such that telling it to customers
01:38:08
◼
►
is advantageous for their business.
01:38:10
◼
►
And do they live up to their value system all the time?
01:38:13
◼
►
We call them on it.
01:38:14
◼
►
But they do have a value system.
01:38:15
◼
►
And if you look at the amount of work
01:38:17
◼
►
and the amount of technology they
01:38:19
◼
►
put into trying to implement artificial intelligence stuff
01:38:23
◼
►
within the bounds of their value system,
01:38:25
◼
►
you see that it's not like BS.
01:38:27
◼
►
They're not blowing smoke up your butt.
01:38:29
◼
►
They did a lot of work that they didn't
01:38:30
◼
►
have to do to make these features exist and fit
01:38:35
◼
►
within their value system.
01:38:36
◼
►
And the problem is this thing that's sweeping the industry,
01:38:39
◼
►
this whole AI trend with LMs or whatever, a lot about it
01:38:42
◼
►
is counter to their value system of privacy and useful approach
01:38:46
◼
►
and making it easier for everybody.
01:38:48
◼
►
And so Apple had to figure out how
01:38:50
◼
►
we have to get in on this train because it's
01:38:52
◼
►
the trend or whatever.
01:38:53
◼
►
And Apple doesn't always follow trends,
01:38:55
◼
►
but Apple sees the value--
01:38:56
◼
►
excuse me, the value too much.
01:38:58
◼
►
They see how good these features could be.
01:38:59
◼
►
So they say, we can't ignore this.
01:39:01
◼
►
We have to do something here.
01:39:03
◼
►
But how do we take this thing that, by its very nature,
01:39:08
◼
►
consumes information indiscriminately,
01:39:10
◼
►
gives bogus answers to things, potentially harmful,
01:39:13
◼
►
offensive things that we don't want?
01:39:15
◼
►
How do we figure out how to provide the benefit to people
01:39:19
◼
►
while still keeping it within our values?
01:39:21
◼
►
And I was honestly very impressed with the lengths
01:39:24
◼
►
that they have gone to to try to do what everyone else is doing
01:39:26
◼
►
and their catch up in a way that--
01:39:29
◼
►
I bet other companies are looking at this like, they did what?
01:39:32
◼
►
For what reason?
01:39:33
◼
►
Why would they do all that work?
01:39:34
◼
►
To preserve privacy?
01:39:36
◼
►
That doesn't make any sense.
01:39:37
◼
►
Go fast and break things.
01:39:39
◼
►
So I came away really impressed with what they've done.
01:39:42
◼
►
I mean, obviously, the features that we're going to talk about,
01:39:44
◼
►
it's like, OK, yeah, every one of these features,
01:39:45
◼
►
you can say someone else had this already.
01:39:47
◼
►
But I feel much more comfortable using these features
01:39:50
◼
►
in the way that Apple has implemented them.
01:39:53
◼
►
And it remains to be seen and we'll
01:39:54
◼
►
talk about for the next year.
01:39:55
◼
►
How do they actually work?
01:39:57
◼
►
Because if you're all wonderful and privacy preserving
01:40:00
◼
►
and deeply integrated into the operating system
01:40:02
◼
►
but it doesn't work well, we'll complain about it.
01:40:04
◼
►
But it sure demoed well.
01:40:07
◼
►
I thought they handled it with a deft hand.
01:40:09
◼
►
I thought it was well done.
01:40:10
◼
►
Because to keep in mind, the environment into which they
01:40:14
◼
►
are announcing these AI-based features, some of which
01:40:17
◼
►
are server-based--
01:40:18
◼
►
and this is an awfully hostile environment in the culture
01:40:23
◼
►
right now, in the media, in the press,
01:40:26
◼
►
even just among the public.
01:40:28
◼
►
There's a lot of hate around AI stuff these days.
01:40:31
◼
►
It's a very, very hot area.
01:40:34
◼
►
And Apple historically has been hit or miss
01:40:36
◼
►
in terms of how they've been able to read
01:40:37
◼
►
the room in those ways.
01:40:38
◼
►
That's true.
01:40:39
◼
►
And I was a little concerned for them going into this, honestly.
01:40:41
◼
►
But I think they did a really good job with it.
01:40:43
◼
►
As John said, I think their approach
01:40:45
◼
►
to doing this in the Apple way with all the privacy
01:40:49
◼
►
focus and everything, I think it probably
01:40:52
◼
►
will result in not being as good or as capable as some
01:40:57
◼
►
of the other systems here and there.
01:40:59
◼
►
But overall, I think what they've shown--
01:41:01
◼
►
again, we'll see how it works-- but I
01:41:02
◼
►
think what they've shown has a pretty good chance of working
01:41:05
◼
►
well enough that we will decide, as Apple users,
01:41:08
◼
►
this is worth the trade-off.
01:41:09
◼
►
I think they might have an actual advantage this time.
01:41:11
◼
►
Because-- well, we'll talk to it when we get to it, I guess.
01:41:15
◼
►
But a lot of the capabilities they're providing
01:41:19
◼
►
require information that is not readily accessible to anything
01:41:23
◼
►
except for the OS platform, because they
01:41:24
◼
►
have access to everything.
01:41:26
◼
►
And normally, you wouldn't want to use a platform that's
01:41:29
◼
►
like, we're going to take all your information
01:41:31
◼
►
and chuck it over the fence to open AI.
01:41:33
◼
►
And that will give us these amazing features.
01:41:35
◼
►
But because Apple has implemented all of their AI
01:41:37
◼
►
features in such a privacy-preserving way,
01:41:39
◼
►
they feel free to pull literally anything, everything,
01:41:43
◼
►
all your relationships, all your contacts, all your photos,
01:41:45
◼
►
all your everything, because they know they're not sending
01:41:47
◼
►
all that information to the server
01:41:49
◼
►
to be harvested for advertising purposes.
01:41:51
◼
►
They're custom selecting just the two things you need.
01:41:55
◼
►
Your wife's name is this.
01:41:56
◼
►
Here's a picture of her.
01:41:57
◼
►
Here's the information we have about her.
01:41:59
◼
►
Here's the question the person asks.
01:42:01
◼
►
And then it processes your requests
01:42:02
◼
►
and discards that information.
01:42:04
◼
►
You would not want that information
01:42:06
◼
►
to being sent to arbitrary third-party AI vendors.
01:42:09
◼
►
You would never-- like, say you're using this cool AI tool,
01:42:12
◼
►
and so it's great.
01:42:12
◼
►
I need access to all your photos and all your contacts
01:42:14
◼
►
and everything you've written in your messages
01:42:16
◼
►
and all your email.
01:42:17
◼
►
And it's like, you would never give that.
01:42:18
◼
►
It's like, well, we need that to do cool AI stuff.
01:42:20
◼
►
It's like, but do you need it all now?
01:42:22
◼
►
And they'd be like, yes, sell ads, right?
01:42:24
◼
►
So I think Apple's ability to pick and choose just
01:42:28
◼
►
the slices they want should make it possible for them to add--
01:42:33
◼
►
not creepier features, but features that, as they said,
01:42:36
◼
►
they take your personal contacts into account
01:42:38
◼
►
without you feeling like you're giving them everything.
01:42:40
◼
►
Never mind that Apple already has access to everything,
01:42:42
◼
►
because if you use Apple Photos, they have all your photos.
01:42:43
◼
►
But the whole idea of, well, Apple doesn't have access
01:42:46
◼
►
to your photos, and then encrypted,
01:42:47
◼
►
and Apple doesn't have access to your messages,
01:42:48
◼
►
and then encrypted, except for iCloud backups,
01:42:50
◼
►
unless you enable advanced data protection.
01:42:52
◼
►
Anyway, the world is complicated.
01:42:54
◼
►
But I think, in this case, they may actually
01:42:57
◼
►
be at an advantage here, because they no longer have barriers
01:43:00
◼
►
to combining information about you to give good answers.
01:43:04
◼
►
They feel free to just yank it all,
01:43:05
◼
►
because they have this very privacy-preserving way
01:43:07
◼
►
that they're doing it.
01:43:09
◼
►
And I love that, as expected, they
01:43:12
◼
►
are doing as much as they can locally on device.
01:43:15
◼
►
And that's great for privacy concerns in lots of ways,
01:43:18
◼
►
because then you can have even more access to things.
01:43:20
◼
►
But also, it's great for latency and performance.
01:43:23
◼
►
Some of the biggest problems that I've always had with Siri
01:43:26
◼
►
is that it's just so incredibly inconsistent in ways
01:43:29
◼
►
that feel kind of like server failures, or server timeouts,
01:43:32
◼
►
or things like that.
01:43:33
◼
►
And so by putting so much on device--
01:43:36
◼
►
and of course, by also having probably
01:43:38
◼
►
a pretty strong financial incentive
01:43:39
◼
►
to put more and more on device over time,
01:43:41
◼
►
and to minimize server requests--
01:43:44
◼
►
that is both good for privacy--
01:43:46
◼
►
and you're right.
01:43:47
◼
►
When they do send them to servers or to another model,
01:43:51
◼
►
they're sending a minimal set of information, and that's good.
01:43:53
◼
►
But I got the impression that most requests are intended
01:43:57
◼
►
to be handled fully on device.
01:43:59
◼
►
And that's going to be just amazing for consistency
01:44:02
◼
►
and performance also.
01:44:03
◼
►
Yeah, the one thing they don't have with this,
01:44:05
◼
►
and we talked about with learning the LMs,
01:44:07
◼
►
learning and everything, is they're not pitching,
01:44:09
◼
►
and they certainly don't have.
01:44:10
◼
►
The idea of your own personal assistant
01:44:12
◼
►
that learns about you over time, that's not this.
01:44:16
◼
►
This is like one-off.
01:44:17
◼
►
So you have an agent.
01:44:18
◼
►
It can do it.
01:44:18
◼
►
It can answer questions.
01:44:19
◼
►
It can take commands or whatever.
01:44:20
◼
►
But it immediately forgets everything.
01:44:22
◼
►
The servers forget everything.
01:44:23
◼
►
The client forgets everything.
01:44:24
◼
►
I know they have the semantic model.
01:44:25
◼
►
And they talked about this.
01:44:26
◼
►
It's like, we have a semantic model.
01:44:27
◼
►
They didn't want to say, we have the equivalent of Microsoft
01:44:30
◼
►
Recall database on your phone.
01:44:31
◼
►
But don't think about that comparison,
01:44:33
◼
►
because they do have this local-only semantic model of all
01:44:36
◼
►
this stuff that is the stew that processed all your email,
01:44:39
◼
►
and all your photos, and all your other things.
01:44:41
◼
►
So you can ask scary questions.
01:44:42
◼
►
Find me the picture of this person with this thing
01:44:44
◼
►
or whatever, and it can pull it out.
01:44:45
◼
►
Because it's already done that processing.
01:44:47
◼
►
But there's no agent that learns about you.
01:44:49
◼
►
Because if there was, it would live only on your phone.
01:44:51
◼
►
And when your phone goes in a lake, you would lose it.
01:44:53
◼
►
Well, I think the phone is the agent, in a way.
01:44:55
◼
►
Like the semantic index that they kept talking about,
01:44:58
◼
►
I think what they're trying to do
01:45:01
◼
►
is use all the data and info that you already
01:45:05
◼
►
entrust to your phone.
01:45:07
◼
►
Not do something like Microsoft Recall or Rewind AI,
01:45:10
◼
►
where not creating a whole new record of every single thing,
01:45:13
◼
►
like a screen recorder.
01:45:14
◼
►
It's not as in readable form.
01:45:16
◼
►
It doesn't have plain text versions,
01:45:17
◼
►
and it doesn't have screenshots.
01:45:18
◼
►
But it has, hopefully, that information inside it.
01:45:21
◼
►
But I think what they are doing seems
01:45:23
◼
►
to be more like a search index.
01:45:25
◼
►
But it's a search index, in AI terms, of information
01:45:30
◼
►
that your phone already is keeping.
01:45:32
◼
►
It doesn't seem like it's keeping new records.
01:45:34
◼
►
But it's not learning anything.
01:45:36
◼
►
It's not gaining knowledge over time to become more and more
01:45:38
◼
►
intimately familiar with you.
01:45:39
◼
►
It is always just in time what it
01:45:41
◼
►
pulls from its semantic index, and it
01:45:42
◼
►
can answer your question.
01:45:43
◼
►
But there's no teaching in anything.
01:45:45
◼
►
The whole point is, if there was teaching it,
01:45:46
◼
►
what would you be teaching?
01:45:47
◼
►
Would you be teaching anything that's only on your device?
01:45:49
◼
►
To do sort of a learning agent that learns about you
01:45:52
◼
►
and get smarter over time, that would
01:45:53
◼
►
have to live somewhere other than on your phone,
01:45:54
◼
►
and then introduce a whole host of other problems.
01:45:56
◼
►
So they're not even addressing that.
01:45:57
◼
►
They're saying, this will crunch through the data on your phone,
01:46:00
◼
►
which is all the data in your life,
01:46:01
◼
►
and you could ask the questions, and it can give you an answer.
01:46:03
◼
►
But it's never going to get any more knowledgeable about you
01:46:06
◼
►
other than you just adding new photos and new messages
01:46:08
◼
►
or whatever.
01:46:09
◼
►
There's no learning.
01:46:10
◼
►
Well, but I think that is learning.
01:46:12
◼
►
You can't give a huge preamble to your system prompt things
01:46:16
◼
►
like, please speak to me only in limericks.
01:46:19
◼
►
You can't do that.
01:46:20
◼
►
I mean like learning, learning, as in getting familiar with you
01:46:24
◼
►
and just the dream of the eye of a thing that actually--
01:46:27
◼
►
we discussed it.
01:46:28
◼
►
The large thing I always don't learn in the ways
01:46:30
◼
►
that people think they do.
01:46:31
◼
►
And Apple is not changing that here.
01:46:33
◼
►
I just think it's interesting to clarify,
01:46:34
◼
►
because they do have that-- by going with this approach,
01:46:37
◼
►
they do have the problem of where would this thing live,
01:46:39
◼
►
whereas all the voracious server-side people are like,
01:46:41
◼
►
don't worry, it all lives in our cloud.
01:46:43
◼
►
You'd just suck all your information up.
01:46:44
◼
►
And if they figure out how to make that learn,
01:46:46
◼
►
don't worry, you have your own private one,
01:46:48
◼
►
and it gets smarter over time.
01:46:49
◼
►
And Apple doesn't have the ability
01:46:51
◼
►
to do that with this approach.
01:46:52
◼
►
I don't think it's going to hurt them,
01:46:53
◼
►
because it'll be addressed.
01:46:54
◼
►
Discuss the last episode, there is no good way
01:46:57
◼
►
to do that with LLMs right now.
01:46:58
◼
►
But if there ever is, Apple may need to--
01:47:01
◼
►
there may become a time where some intelligence needs
01:47:04
◼
►
to live somewhere other than on your phone.
01:47:06
◼
►
And I'm sure Apple will work hard to find a privacy
01:47:09
◼
►
preserving way to do that.
01:47:10
◼
►
All right, let's talk about how we're actually
01:47:12
◼
►
using this model.
01:47:14
◼
►
So they talked about several different things.
01:47:16
◼
►
And it started with capabilities.
01:47:18
◼
►
So basically, what are we doing with this?
01:47:20
◼
►
And they talked about language.
01:47:22
◼
►
So prioritizing notifications, which
01:47:25
◼
►
seems like low-hanging fruit in terms of a good way to use it.
01:47:28
◼
►
It may be a very difficult thing to implement,
01:47:30
◼
►
but in terms of a good way to use this sort of thing.
01:47:33
◼
►
Are they going to prioritize down the Apple Store
01:47:35
◼
►
notification I got this morning?
01:47:37
◼
►
No, it's the highest priority.
01:47:38
◼
►
You need a Father's Day gift.
01:47:41
◼
►
Thank you so much, Apple Store.
01:47:42
◼
►
I know this is a stupid tangent, but the Apple TV thing
01:47:45
◼
►
tells you a sports score that pops over your screen.
01:47:47
◼
►
How do you disable that?
01:47:49
◼
►
I thought I had disabled it.
01:47:50
◼
►
I went through all the settings.
01:47:51
◼
►
That drives me crazy.
01:47:53
◼
►
I have never watched a sport on Apple TV, ever.
01:47:56
◼
►
No part of all the information Apple knows about me
01:47:59
◼
►
would indicate that I like sports at all.
01:48:01
◼
►
It didn't gather that, if I knew.
01:48:02
◼
►
And yet, I'm getting those sports
01:48:04
◼
►
promos on top of everything I watch on the Apple TV.
01:48:08
◼
►
It makes me want to set it on fire.
01:48:09
◼
►
I get so mad.
01:48:11
◼
►
There is some way to disable this, I'm sure.
01:48:13
◼
►
I thought I had disabled it.
01:48:14
◼
►
That's why, but I can't--
01:48:16
◼
►
someone write in and tell us how to actually disable it,
01:48:18
◼
►
because it's driving me insane.
01:48:19
◼
►
Chuck your Apple TV.
01:48:20
◼
►
Anyway, it will prioritize those.
01:48:21
◼
►
Top priority.
01:48:22
◼
►
The movie you're watching, it's real important
01:48:24
◼
►
for you to know the score on a sports game
01:48:25
◼
►
that you don't care about.
01:48:27
◼
►
Hopefully, Apple's learning index
01:48:28
◼
►
is better now than whatever's running on the Apple TV.
01:48:31
◼
►
Sometimes I don't even know what sport they're talking about.
01:48:33
◼
►
They're like, Rogers and Harrison are in the--
01:48:36
◼
►
I don't know who these people are.
01:48:37
◼
►
Am I supposed to know people by their last name?
01:48:39
◼
►
I can't tell what sport you're talking about.
01:48:41
◼
►
All right, so then there's new writing tools
01:48:43
◼
►
that are available system-wide.
01:48:44
◼
►
They may have mentioned--
01:48:45
◼
►
I forget how they phrased it-- but basically,
01:48:46
◼
►
anywhere you would have a text field,
01:48:48
◼
►
like an actual Apple-vended text field, you can do rewrite.
01:48:52
◼
►
You can summarize.
01:48:53
◼
►
At some point, they talked about changing the tone.
01:48:56
◼
►
That might have been email-specific.
01:48:57
◼
►
I don't recall.
01:48:57
◼
►
But you can change the tone of things.
01:49:00
◼
►
I think it's anywhere.
01:49:01
◼
►
This entire feature class is called Rewrite.
01:49:03
◼
►
And I think this is in any standard text field,
01:49:06
◼
►
like Craig Federighi said in the Don't Call It a Talk Show,
01:49:08
◼
►
Fake Talk Show they held afterwards, that it works--
01:49:11
◼
►
We should probably explain what that is in a minute,
01:49:13
◼
►
but carry on.
01:49:14
◼
►
That basically, it works anywhere
01:49:16
◼
►
that you currently see things like spell check.
01:49:19
◼
►
So any standard system--
01:49:20
◼
►
Yeah, third-party apps, not just--
01:49:22
◼
►
anywhere you see those standard controls.
01:49:24
◼
►
And I was like, Mac OS 8 had a way
01:49:27
◼
►
to select text and summarize it.
01:49:28
◼
►
We've come a long way.
01:49:29
◼
►
That summarization was not very good.
01:49:30
◼
►
I believe it would just pick the most relevant sentences based
01:49:33
◼
►
on analysis, just string those together, which worked about
01:49:35
◼
►
as well as you can imagine.
01:49:36
◼
►
But yeah, another catch-up feature,
01:49:38
◼
►
every app that we've used with AI enhancement
01:49:40
◼
►
has a feature to summarize it and rewrite it and fix the--
01:49:43
◼
►
but they're implementing it well.
01:49:45
◼
►
It's system-wide.
01:49:46
◼
►
It's available to third parties.
01:49:47
◼
►
We hope it works well.
01:49:48
◼
►
I think it does make me a little bit uneasy that like, all right,
01:49:51
◼
►
so here we are.
01:49:52
◼
►
We're having AI generate and edit
01:49:54
◼
►
our messages that are going to be sent to someone else who's
01:49:57
◼
►
going to use AI to summarize them.
01:49:59
◼
►
And it's like, what are we doing?
01:50:00
◼
►
This seems like sexual waste.
01:50:02
◼
►
In some respects, you would hope that this
01:50:05
◼
►
will teach people to be better writers when they
01:50:08
◼
►
see how things are rewritten.
01:50:09
◼
►
Do calculators teach people how to do math themselves better?
01:50:12
◼
►
It's not quite the same, because you just
01:50:14
◼
►
care about the answer with the calculator, where
01:50:16
◼
►
I assume people will read the revised writing to see
01:50:21
◼
►
if it is acceptable to them.
01:50:22
◼
►
Maybe that's not--
01:50:23
◼
►
That's a big assumption.
01:50:24
◼
►
But things like that, I think you can learn by seeing how--
01:50:31
◼
►
if you had a human editor revise your writing
01:50:33
◼
►
and you watch them do it, you will eventually
01:50:35
◼
►
become a better--
01:50:35
◼
►
I'm not saying this is a tool to become a better writer,
01:50:37
◼
►
but I think there is some learning happening there,
01:50:39
◼
►
because a lot of time, people just write a certain way,
01:50:42
◼
►
and they don't think about it.
01:50:43
◼
►
And just having somebody rewrite their stuff,
01:50:45
◼
►
like even if it's a computer, and them seeing, oh,
01:50:47
◼
►
that actually is better that way can teach them to be
01:50:49
◼
►
a better writer in small ways.
01:50:50
◼
►
But we'll see how much people actually use these features.
01:50:54
◼
►
And for people not reading, that's obviously
01:50:55
◼
►
the danger case.
01:50:56
◼
►
It's like, oh, I'll just hit this button,
01:50:58
◼
►
and then I'll hit Send.
01:50:59
◼
►
People are going to get burned by that.
01:51:01
◼
►
They're going to learn.
01:51:02
◼
►
Oh, maybe I should read what I wrote.
01:51:05
◼
►
It's one of those things.
01:51:06
◼
►
Tools give you enough rope to hang yourself,
01:51:08
◼
►
and I think this is the case with that.
01:51:10
◼
►
I do like, though, one of the options-- so first of all,
01:51:12
◼
►
Rewrite's going to give you a really, really good proofread
01:51:15
◼
►
grammar check kind of thing.
01:51:16
◼
►
It's going to be more advanced than most grammar checks.
01:51:18
◼
►
Isn't there a service Grammarly, is it?
01:51:19
◼
►
Grammarly, yeah.
01:51:20
◼
►
Whatever uses it for this.
01:51:21
◼
►
So that's good to have that be on device, too,
01:51:23
◼
►
to not have basically a key logger from someone else.
01:51:26
◼
►
So that's good.
01:51:26
◼
►
But also, I like that they have tone changes
01:51:29
◼
►
as one of the options to rewrite messages.
01:51:31
◼
►
So you can make your writing more formal or whatever.
01:51:33
◼
►
And I think that's not-- or have different sentiment analysis
01:51:37
◼
►
to have it be maybe less negative.
01:51:38
◼
►
That, I think, is going to be nice for people who maybe are
01:51:41
◼
►
not great at that kind of writing
01:51:43
◼
►
or even that kind of speaking.
01:51:44
◼
►
I mean, like, forum software has had stuff like that for years
01:51:46
◼
►
where they'll say, before you hit Send on this message,
01:51:49
◼
►
it seems pretty aggressive.
01:51:50
◼
►
You sure you don't want to comment down?
01:51:52
◼
►
People have been using it to try to make people be less
01:51:54
◼
►
obnoxious online.
01:51:55
◼
►
And I tried to write down the tone things,
01:51:58
◼
►
but they were all nice.
01:51:59
◼
►
I was like, do you want your tone to be more concise
01:52:02
◼
►
or more friendly or more conciliatory?
01:52:04
◼
►
Where is the more aggressive setting?
01:52:07
◼
►
I want it to be more assertive.
01:52:09
◼
►
I want it to be like maybe you're
01:52:10
◼
►
negotiating for real estate over email or something.
01:52:13
◼
►
That wasn't in the options, and I kind of understand that
01:52:15
◼
►
because the thing will just start threatening people's
01:52:17
◼
►
lives or whatever.
01:52:18
◼
►
Yeah, make me a better negotiator.
01:52:19
◼
►
But this is part of the being conservative with, like,
01:52:22
◼
►
let's just have all the tone settings to make
01:52:24
◼
►
you sound nicer and none of them to be.
01:52:26
◼
►
Sometimes you do want to be more assertive,
01:52:27
◼
►
but it's too dangerous for you.
01:52:29
◼
►
I'd help you with that at this point.
01:52:30
◼
►
With respect, I don't think that you
01:52:32
◼
►
needed to be more assertive about blocking real nuts.
01:52:35
◼
►
I was so nice about it.
01:52:36
◼
►
I was just mostly incredulous.
01:52:37
◼
►
No, it's good too.
01:52:38
◼
►
Like, you know, for people who are
01:52:39
◼
►
trying to write a formal business email or something,
01:52:42
◼
►
and maybe they don't have that kind of writing skill
01:52:44
◼
►
or maybe they don't know English that well.
01:52:46
◼
►
Like, I think this has a lot of really good applications.
01:52:50
◼
►
But I think we are definitely going
01:52:51
◼
►
to have the problem of people not reading what I wrote
01:52:54
◼
►
and just sending it.
01:52:55
◼
►
You know, and then people don't read emails anyway.
01:52:58
◼
►
These are all-- us exchanging so much text
01:53:01
◼
►
is such a big change from when I was a kid when people did not
01:53:04
◼
►
exchange text this much, period, in their entire lives.
01:53:06
◼
►
Like, they didn't write letters to each other,
01:53:08
◼
►
and there was no text messaging, no email, no this, not--
01:53:11
◼
►
like, now people work with text so much more.
01:53:13
◼
►
I think it is making people better writers.
01:53:15
◼
►
And I think you learn, like, when you get your first job
01:53:17
◼
►
where you have to do, like, job email, oh, job email
01:53:20
◼
►
is different than text messages.
01:53:21
◼
►
Like, kids will learn that when they get their first job
01:53:23
◼
►
and realize they can't address their coworkers and boss
01:53:27
◼
►
the same way.
01:53:28
◼
►
And, like, there's a culture that evolves around that.
01:53:29
◼
►
And, you know, for better or for worse,
01:53:31
◼
►
we all learn how to write work emails.
01:53:33
◼
►
And having computers help out with that, you know,
01:53:36
◼
►
maybe we'll just smooth that curve a little bit.
01:53:38
◼
►
Please advise.
01:53:40
◼
►
So the language stuff is in Mail Notes, Safari Pages, Keynote,
01:53:42
◼
►
and third party apps, as John had mentioned.
01:53:44
◼
►
Then we get to images.
01:53:47
◼
►
I don't know why I wrote down photos, emojis, and GIFs.
01:53:49
◼
►
But apparently that was mentioned.
01:53:51
◼
►
You get, like, a Bitmoji style generated images of people.
01:53:56
◼
►
It's more like a Memoji, isn't it?
01:53:57
◼
►
Doesn't it look kind of like the Memoji style?
01:53:59
◼
►
Well, sort of.
01:53:59
◼
►
But then you've got, like, the backgrounds,
01:54:01
◼
►
and they're interactive-- or they're not interactive,
01:54:03
◼
►
but they're, like, holding things, which is more Bitmoji.
01:54:05
◼
►
I don't know.
01:54:05
◼
►
I mean, it's one way or the other.
01:54:07
◼
►
But yeah, no, what I'm saying is you have pictures of people
01:54:10
◼
►
in your contacts, in your photos collection
01:54:12
◼
►
that it has identified using the people and places feature.
01:54:15
◼
►
You can ask it to draw you a cartoony picture
01:54:18
◼
►
of that person, which is brave.
01:54:20
◼
►
Because cartoony pictures of people
01:54:23
◼
►
can go wrong in many, many ways.
01:54:25
◼
►
And this is an Apple feature, not an OpenAI feature,
01:54:27
◼
►
which I'll get to in a little bit.
01:54:28
◼
►
This is an Apple feature.
01:54:29
◼
►
So if Apple hoses this, there's going to be press about it.
01:54:34
◼
►
There's a lot of ways to go wrong.
01:54:35
◼
►
I bet they've been very careful with certain things.
01:54:38
◼
►
Don't make my nose too big or whatever.
01:54:39
◼
►
I bet there's a lot of that kind of stuff in there.
01:54:41
◼
►
First of all, they don't want to make it something unflattering,
01:54:43
◼
►
because people don't want to see unflattering picture
01:54:44
◼
►
of themselves.
01:54:45
◼
►
And second, I think it's got the same problem
01:54:46
◼
►
that I always complain about in Memoji
01:54:48
◼
►
is that unlike the Miis in Nintendo,
01:54:50
◼
►
Memoji all have little pumpkin heads.
01:54:52
◼
►
And my head's not a pumpkin, it's a football, right?
01:54:57
◼
►
They just regularize everybody into the little people
01:55:01
◼
►
from Play School or whatever.
01:55:03
◼
►
Everyone looks like a doll.
01:55:04
◼
►
And then you don't see yourself in that.
01:55:06
◼
►
You're like, you have not captured my likeness.
01:55:07
◼
►
That doesn't look like me, right?
01:55:09
◼
►
This seems like it's going to try
01:55:11
◼
►
to capture people's likenesses.
01:55:12
◼
►
So when you paste it into a chat or whatever,
01:55:14
◼
►
generate it in whatever way, people go, oh, that's Timmy.
01:55:17
◼
►
I recognize his face.
01:55:19
◼
►
It's not just because Timmy has brown hair.
01:55:21
◼
►
It's just a round pumpkin head with brown hair on it.
01:55:23
◼
►
So this is the first sort of potential danger
01:55:27
◼
►
zone of the features they've got.
01:55:28
◼
►
Because all the other ones, like text summarization,
01:55:30
◼
►
helping you with writing, changing the sentiment nicer,
01:55:33
◼
►
this has the potential to go wrong.
01:55:34
◼
►
But anyway, it's part of their image generation framework.
01:55:37
◼
►
It can make people for you.
01:55:40
◼
►
And you can do it as sketches, illustrations, or animations.
01:55:43
◼
►
And it's built into the system apps.
01:55:45
◼
►
Then another capability, action.
01:55:48
◼
►
Basically what they're saying is you can say--
01:55:51
◼
►
I think to Siri was the implication.
01:55:53
◼
►
This is such a weird structure of the thing.
01:55:55
◼
►
We've talked about it before of how
01:55:57
◼
►
are they going to talk about the OS is about talking
01:55:58
◼
►
about AI features.
01:55:59
◼
►
And the fact is they didn't.
01:56:00
◼
►
They talked about AI features.
01:56:01
◼
►
They just didn't call them AI.
01:56:02
◼
►
How are they going to talk about Siri
01:56:03
◼
►
when they haven't introduced Siri yet?
01:56:05
◼
►
They just talked about it, and they just didn't mention Siri.
01:56:07
◼
►
Later they're going to mention Siri.
01:56:09
◼
►
Normally they have a way to arrange it
01:56:11
◼
►
so they can talk about what they want about it.
01:56:13
◼
►
They couldn't avoid it.
01:56:13
◼
►
They had to talk about things that they hadn't, quote, unquote,
01:56:15
◼
►
talked about yet.
01:56:16
◼
►
And this is one.
01:56:16
◼
►
Yes, you're asking Siri.
01:56:18
◼
►
So the examples they gave-- pull up the files
01:56:20
◼
►
that JAWS shared with me last week,
01:56:22
◼
►
or show me all the photos with Declan and Michaela and Erin
01:56:25
◼
►
and me, or show me the podcast that my wife sent last week.
01:56:27
◼
►
I was happy to hear that.
01:56:30
◼
►
I can't do that.
01:56:32
◼
►
My point is just that I'm always pleased when
01:56:34
◼
►
Apple acknowledges a podcast or a thing.
01:56:36
◼
►
But yeah, I think these make a lot of sense.
01:56:38
◼
►
I think this is the sort of thing we want to see from Siri,
01:56:41
◼
►
making it more useful.
01:56:43
◼
►
They also said a lot about personal context.
01:56:45
◼
►
And they started to flirt a little bit with Rewind.ai
01:56:48
◼
►
and-- what is it-- Recall that Microsoft
01:56:50
◼
►
has been embroiled over.
01:56:52
◼
►
But they said that there is an awareness
01:56:54
◼
►
of what's on the screen.
01:56:55
◼
►
They didn't say that.
01:56:57
◼
►
They showed things that said, hey, when you're on the screen,
01:56:59
◼
►
that's the context.
01:57:00
◼
►
And so when you say something like, oh, send this to whatever
01:57:05
◼
►
I'm assuming it's not OCRing the screen and scraping the info.
01:57:08
◼
►
I'm assuming this is all user activity APIs and Apple's apps
01:57:11
◼
►
that have integration.
01:57:11
◼
►
I don't know if that's true.
01:57:12
◼
►
Well, I don't think that's exclusively true.
01:57:14
◼
►
Because one of the examples they showed at some point--
01:57:16
◼
►
it might not have been at this part of the presentation--
01:57:19
◼
►
but somebody sent their address in the text message thread.
01:57:22
◼
►
So you and I are exchanging messages.
01:57:24
◼
►
You send me your mailing address.
01:57:25
◼
►
And they said to Siri, add that address to his contact
01:57:29
◼
►
or something along those lines.
01:57:30
◼
►
But Siri has full access to messages.
01:57:33
◼
►
It's Apple's own app.
01:57:34
◼
►
If that was WhatsApp, what would it have done?
01:57:36
◼
►
I see your point.
01:57:37
◼
►
Yeah, I'm not sure.
01:57:38
◼
►
That's a good point.
01:57:38
◼
►
I'm not entirely sure.
01:57:40
◼
►
Honestly, I think because of the way they're doing this,
01:57:42
◼
►
I would have no problem with it screen scraping and OCRing it.
01:57:45
◼
►
Because I know that it is just getting the information it
01:57:47
◼
►
It's sending it to a server that doesn't log it
01:57:49
◼
►
that has no ability to store things.
01:57:50
◼
►
And it throws it away.
01:57:51
◼
►
That's so much better.
01:57:52
◼
►
It is also probably just using the accessibility APIs.
01:57:55
◼
►
It's probably already all--
01:57:56
◼
►
Yeah, there are lots of-- like I said,
01:57:58
◼
►
there's NS user activity-- or not NS.
01:57:59
◼
►
But there's user activity API.
01:58:01
◼
►
There's the other various ways where
01:58:03
◼
►
this information is exposed to the OS to the frameworks
01:58:06
◼
►
that you're using.
01:58:06
◼
►
Because you're using the UI frameworks.
01:58:08
◼
►
There's lots of ways they can do this.
01:58:10
◼
►
And that is the advantage they have as the platform vendor.
01:58:12
◼
►
And being context aware in this way
01:58:15
◼
►
is great because when they said about context,
01:58:17
◼
►
it's like, how are we providing context?
01:58:19
◼
►
You're providing context by just using your phone.
01:58:21
◼
►
Whatever you're doing on your phone, that is the context.
01:58:23
◼
►
And then you activate the new Siri,
01:58:26
◼
►
which we'll see in a little bit.
01:58:27
◼
►
And you don't have to do anything to provide the context.
01:58:29
◼
►
It's already there.
01:58:30
◼
►
And the OS sort of extracts that from what you're doing
01:58:33
◼
►
and what you have done.
01:58:35
◼
►
Because the OS knows all that and uses
01:58:36
◼
►
that to hopefully get a more useful answer out of the LLM.
01:58:39
◼
►
So I talked about architecture.
01:58:41
◼
►
I feel like maybe we should try to breeze through this
01:58:44
◼
►
as quickly as possible.
01:58:45
◼
►
But basically, they made a whole speech
01:58:47
◼
►
about how privacy is important.
01:58:49
◼
►
And of course, they cited that on-device processing
01:58:52
◼
►
is where they're doing most of this, which leads us
01:58:55
◼
►
to Apple Intelligence being Apple Silicon only,
01:58:58
◼
►
apparently A17 Pro and above.
01:59:01
◼
►
They talked about how there's different models.
01:59:04
◼
►
There's LLMs and diffusion models.
01:59:06
◼
►
They have an on-device semantic index, the software image.
01:59:10
◼
►
They made a lot of-- they talked a lot about how their images,
01:59:15
◼
►
which they meant both for the iPhone
01:59:17
◼
►
and for their servers, which we're
01:59:19
◼
►
going to get to in two seconds, are independently verifiable.
01:59:22
◼
►
And I'm not entirely clear how or why or what.
01:59:25
◼
►
All they're saying is, you know how security researchers can
01:59:27
◼
►
find flaws in iOS because they have iOS?
01:59:31
◼
►
That's the same thing.
01:59:32
◼
►
Because if you've run servers, there
01:59:33
◼
►
was no reason for you to give them what's there.
01:59:34
◼
►
Now, anyone listening to this who's not an Apple
01:59:36
◼
►
client was like, why don't they just give them the source code?
01:59:38
◼
►
That's not yet the Apple way.
01:59:40
◼
►
But honestly, analyzing a compiled binary
01:59:43
◼
►
is much harder than analyzing the source code.
01:59:46
◼
►
But that's the way it is.
01:59:48
◼
►
So they talk about private cloud compute,
01:59:50
◼
►
which basically, the short short of it is,
01:59:52
◼
►
they try to do everything on-device when they can,
01:59:54
◼
►
including a lot of the image generation,
01:59:56
◼
►
I think they had said at one point,
01:59:57
◼
►
that they do that on-device.
01:59:59
◼
►
But there is an awareness that, oh, this is not
02:00:02
◼
►
going to work on-device.
02:00:03
◼
►
I've got to send this to something
02:00:04
◼
►
with more compute power.
02:00:06
◼
►
And so they're using servers that are, in turn,
02:00:09
◼
►
using Apple Silicon that draws on the security properties
02:00:13
◼
►
of Swift, among other things, which I'm not entirely clear
02:00:15
◼
►
what that means.
02:00:15
◼
►
It doesn't mean memory safety and stuff.
02:00:17
◼
►
This private cloud compute finally
02:00:19
◼
►
makes sense of the rumor we talked about in past episode
02:00:22
◼
►
about using Apple Silicon and servers.
02:00:24
◼
►
Finally makes sense, right?
02:00:25
◼
►
Not because of the secure on-device.
02:00:27
◼
►
It's because this is stuff they would run on-device.
02:00:30
◼
►
They're just farming it out.
02:00:31
◼
►
And if you're going to farm it out,
02:00:32
◼
►
you have to farm it out too.
02:00:33
◼
►
You don't have to.
02:00:34
◼
►
But it's much easier to farm it out to the same architecture.
02:00:37
◼
►
I would run it on Apple Silicon, but it would burn your CPU.
02:00:39
◼
►
Or you don't have enough RAM.
02:00:40
◼
►
Well, guess what?
02:00:41
◼
►
Apple makes bigger Apple Silicon chips.
02:00:43
◼
►
Finally, it's like, why would they use the M2 Ultra?
02:00:45
◼
►
This is why.
02:00:46
◼
►
It's Apple Silicon.
02:00:48
◼
►
Think of it as just an outboard giant processor for your phone
02:00:51
◼
►
that you call upon briefly to do a thing
02:00:53
◼
►
and get the answer back.
02:00:55
◼
►
I feel so much better.
02:00:56
◼
►
I'm like, why are they doing this?
02:00:57
◼
►
Why are they making a server?
02:00:58
◼
►
And so, yeah, they'll give you the image
02:01:01
◼
►
of the thing that's running on that server.
02:01:03
◼
►
And they'll do a cryptographic thing where
02:01:04
◼
►
you can prove that iOS won't talk to it unless it's been--
02:01:07
◼
►
the one piece they didn't mention
02:01:08
◼
►
is there's got to be a third party involved in here.
02:01:10
◼
►
Otherwise, we're just taking Apple's word for it.
02:01:11
◼
►
That will only let you use the published ones.
02:01:13
◼
►
But they're bending over backwards.
02:01:15
◼
►
Like, they're going almost as far
02:01:16
◼
►
enough to give you the source code to it.
02:01:18
◼
►
It's saying, we're going to do outboard processing.
02:01:21
◼
►
But we don't want any of your data.
02:01:23
◼
►
These things can't log.
02:01:24
◼
►
They have no storage subsystem.
02:01:26
◼
►
They're running like a version of Apple's operating system
02:01:28
◼
►
that takes those parts of the operating system out.
02:01:31
◼
►
There's no support for persistent storage.
02:01:34
◼
►
There's no file system.
02:01:39
◼
►
Like, it's just so-- you see this a lot in cloud computing
02:01:41
◼
►
where they'll have servers that can't log, that don't save
02:01:44
◼
►
any information.
02:01:45
◼
►
This is what they're doing because they
02:01:46
◼
►
don't want this information.
02:01:47
◼
►
It's cheaper for them not to have it.
02:01:49
◼
►
And they are really, really going to great lengths
02:01:51
◼
►
to try to make it so that an outside observer could say,
02:01:54
◼
►
yes, they're honestly not saving my stuff.
02:01:58
◼
►
But they do want to be able to do things faster than they can
02:02:01
◼
►
on your phone or with more RAM than they can on your phone.
02:02:04
◼
►
This is a very clever solution.
02:02:05
◼
►
I'm much more optimistic about it now than I was before.
02:02:08
◼
►
Yeah, and the other thing that I think worth mentioning
02:02:10
◼
►
is Marco alluded to a quasi-talk show that we went to.
02:02:13
◼
►
And then we ignored it after that.
02:02:15
◼
►
But what we had done was during the State of the Union,
02:02:19
◼
►
actually, they had iJustine interview John Giannandrea,
02:02:23
◼
►
I think was the pronunciation.
02:02:25
◼
►
Tim Cook didn't say--
02:02:26
◼
►
Tim Cook just called him JG.
02:02:27
◼
►
That's what everyone calls him.
02:02:28
◼
►
John Giannandrea.
02:02:30
◼
►
But anyways, they had a conversation.
02:02:32
◼
►
And it was like half an hour long.
02:02:33
◼
►
And it was mostly softballs and mostly it
02:02:37
◼
►
appeared to be prepared, both remarks and questions.
02:02:41
◼
►
But one of the things that Justine had asked was, well,
02:02:44
◼
►
you never really talked about the environment.
02:02:46
◼
►
And this all comes back together because I forget who it was.
02:02:49
◼
►
But one of them said, look, all of our chips
02:02:52
◼
►
began life as iPhone chips where power is incredibly important.
02:02:56
◼
►
And so if we're going to do all this cloud computing,
02:02:59
◼
►
why wouldn't we try to do it on something that sips power
02:03:02
◼
►
rather than slurps power?
02:03:04
◼
►
And so here again, like you were saying,
02:03:05
◼
►
John, this also helps me grok and understand
02:03:08
◼
►
why they're doing all this with Apple Silicon.
02:03:10
◼
►
And they emphasized, oh, and by the way,
02:03:12
◼
►
all data centers run on 100% renewable energy anyway.
02:03:15
◼
►
Yep, exactly right.
02:03:16
◼
►
So anyway, so experiences.
02:03:18
◼
►
Now we get to Siri.
02:03:19
◼
►
So Siri apparently serves 1.5 billion requests per day.
02:03:24
◼
►
And it was introduced 13 years ago.
02:03:28
◼
►
I think that was my first WWDC then,
02:03:30
◼
►
because that would make it 2011, wouldn't it?
02:03:32
◼
►
It doesn't matter.
02:03:32
◼
►
It was introduced in 2011.
02:03:33
◼
►
But yeah, my first was 2009.
02:03:37
◼
►
That was your first as well, right?
02:03:38
◼
►
John, sorry.
02:03:39
◼
►
I'm looking at John and pointing,
02:03:40
◼
►
which is not helpful for listeners.
02:03:42
◼
►
We don't do this in person often.
02:03:44
◼
►
So anyways, it's more natural, relevant, and personal.
02:03:47
◼
►
It has a whole new look.
02:03:48
◼
►
It's like a glowing rim light and rainbow animation.
02:03:51
◼
►
It's a cool look.
02:03:52
◼
►
I also like how there's a little bit of an indentation animation
02:03:54
◼
►
where the button is where you're squeezing it.
02:03:56
◼
►
That's kind of a cool look.
02:03:57
◼
►
We were talking about in the pundit world,
02:04:02
◼
►
are they going to rename Siri?
02:04:03
◼
►
Because the old one has such bad PR.
02:04:05
◼
►
It's so dumb.
02:04:06
◼
►
Everyone hates Siri.
02:04:07
◼
►
Maybe they'll call it Siri X or Siri 10 or something
02:04:10
◼
►
Not that they would rename it.
02:04:11
◼
►
But it rebranded it.
02:04:11
◼
►
Siri AI, another possibility, right?
02:04:13
◼
►
And then people were like, oh, no, they'll
02:04:15
◼
►
just keep this name the same.
02:04:16
◼
►
They'll tell us, really, this time it's good, right?
02:04:18
◼
►
They did something that I hadn't heard anyone predict,
02:04:20
◼
►
which is keep the name the same, which
02:04:21
◼
►
a lot of people did say that they would do.
02:04:23
◼
►
But they essentially totally rebranded Siri.
02:04:26
◼
►
The icon is different.
02:04:28
◼
►
The user interface is different.
02:04:29
◼
►
How it manifests in the OS is different.
02:04:33
◼
►
You would be forgiven for thinking that Siri is gone
02:04:35
◼
►
and has been replaced with something new.
02:04:37
◼
►
I didn't think they would change the icon.
02:04:39
◼
►
The iconic Siri look with the wavy thing, gone.
02:04:42
◼
►
Now there's a colorful infinity symbol thing or whatever.
02:04:45
◼
►
The icon's out of the menu bar.
02:04:48
◼
►
Everything about this is rebranded,
02:04:50
◼
►
except it's still Siri.
02:04:51
◼
►
This is really trying to let people know this is--
02:04:54
◼
►
you may have been annoyed with Siri,
02:04:56
◼
►
and we didn't change the name.
02:04:57
◼
►
But this is better.
02:04:58
◼
►
But everything is better, yeah.
02:04:59
◼
►
So they made a big point about how it will understand you,
02:05:02
◼
►
even if you stumble over your words, which I use Siri most
02:05:05
◼
►
when I'm in the car because I'm using it with CarPlay,
02:05:08
◼
►
and I'm responding to text messages or whatever
02:05:10
◼
►
the case may be.
02:05:10
◼
►
I don't know what my problem is.
02:05:12
◼
►
I literally talk for a living.
02:05:13
◼
►
That is literally my vocation.
02:05:15
◼
►
And yet, I am constantly stumbling over my own words.
02:05:18
◼
►
And so hopefully that'll get a lot better.
02:05:20
◼
►
It maintains the conversational context.
02:05:22
◼
►
And they gave examples that you would expect.
02:05:24
◼
►
I can't recall any of them right now.
02:05:26
◼
►
But it was what you would expect.
02:05:27
◼
►
So do this, and then OK, what about-- or you're
02:05:31
◼
►
taking several steps in a row.
02:05:32
◼
►
Because context window is a natural part of LLMs,
02:05:34
◼
►
and so this fits well with that.
02:05:36
◼
►
There's type to Siri.
02:05:37
◼
►
So you can double tap on the bottom of the screen,
02:05:39
◼
►
and then you can type kind of sort of like a chat bot, which
02:05:44
◼
►
I think there's a type to Siri already.
02:05:45
◼
►
You can type to Siri now, but they're just
02:05:46
◼
►
exposing it more broadly.
02:05:47
◼
►
Because a lot of the time, the barrier to using Siri
02:05:49
◼
►
is I don't want to talk out loud right now.
02:05:51
◼
►
In whatever context I'm in, I don't want to or can't.
02:05:53
◼
►
And so this gives it a more prominent option
02:05:56
◼
►
to something you could do before,
02:05:57
◼
►
but most people probably didn't know how to access.
02:06:00
◼
►
They're giving Siri a lot of product knowledge,
02:06:03
◼
►
which I was like--
02:06:04
◼
►
What products?
02:06:04
◼
►
What products?
02:06:05
◼
►
So they said, you can ask Siri, how do I scan a QR code?
02:06:09
◼
►
And once it processes and realizes what you're asking,
02:06:12
◼
►
it will show like a little help thing
02:06:14
◼
►
at the top of the screen saying, step one, do this.
02:06:16
◼
►
Step two, do that.
02:06:17
◼
►
Step three, do this, which I thought was phenomenal.
02:06:19
◼
►
And another example they gave very quickly
02:06:21
◼
►
is, how do I write a message now and schedule it to send later?
02:06:23
◼
►
And so it will tell you.
02:06:25
◼
►
It will teach you how to do that,
02:06:26
◼
►
which I thought was very cool.
02:06:27
◼
►
Although they didn't go through with that.
02:06:29
◼
►
It's like, do those instructions stay on the screen?
02:06:31
◼
►
How can you access the UI when they're there?
02:06:32
◼
►
But it's better than nothing.
02:06:33
◼
►
But yeah, to be clear, they didn't say this explicitly.
02:06:36
◼
►
I'm assuming it's only Apple products.
02:06:38
◼
►
Like, how do I fix my refrigerator?
02:06:40
◼
►
Like, they're not on board for that.
02:06:41
◼
►
But I will definitely use this, because very often I
02:06:44
◼
►
want to Google for something and find like a text bag.
02:06:46
◼
►
Like, how deep does it go?
02:06:48
◼
►
Can I ask it what the resolution was on like the second iPad
02:06:51
◼
►
or something?
02:06:51
◼
►
Like, I mean, Apple has this info.
02:06:55
◼
►
It's great that they're exposing it.
02:06:56
◼
►
Maybe it's mostly useful for tech podcasters,
02:06:59
◼
►
but I'm looking forward to it.
02:07:00
◼
►
It's just a K-base index at this point.
02:07:02
◼
►
Yeah, I mean, yeah.
02:07:02
◼
►
But by all means, it's like a better search
02:07:05
◼
►
engine for information that's already on Apple's website
02:07:07
◼
►
somewhere that you'll never find.
02:07:08
◼
►
Unfortunately, unfortunately, Jon, I
02:07:10
◼
►
don't think it will prepare the way for you.
02:07:12
◼
►
So I wouldn't try that.
02:07:14
◼
►
There's in-app actions.
02:07:15
◼
►
So add this photo to the email I drafted to Steve,
02:07:18
◼
►
or show me photos of Stacey in New York wearing her pink coat.
02:07:22
◼
►
Like, that example in particular,
02:07:24
◼
►
I find that one of the things I miss so deeply about Google
02:07:28
◼
►
Photos, which was also not perfect,
02:07:30
◼
►
but at the time that I abandoned it a couple of years ago,
02:07:32
◼
►
was pretty darn good, was being able to search for something
02:07:36
◼
►
with natural language.
02:07:37
◼
►
And Apple has supported this for the last couple of years,
02:07:41
◼
►
but it's not great.
02:07:42
◼
►
Yeah, they had a fixed set of words and phrases
02:07:45
◼
►
that you could use, and if it wasn't other than your--
02:07:48
◼
►
I remember, like, I have an app on my phone called Queryable,
02:07:52
◼
►
and I showed this to an Apple person at one point,
02:07:54
◼
►
and I said, well, I use this third-party app
02:07:56
◼
►
to search photos.
02:07:57
◼
►
And they're like, why don't you just use the photo search?
02:07:59
◼
►
You can just type things or whatever.
02:08:00
◼
►
And I showed them an example, and it
02:08:01
◼
►
was like ripped blue t-shirt or some phrase like that.
02:08:04
◼
►
Queryable, a third-party app that
02:08:06
◼
►
has to grind over and index all your things,
02:08:08
◼
►
but they use this type of element type thing?
02:08:09
◼
►
Like, look, it found it instantly.
02:08:11
◼
►
And you know the photos didn't have ripped blue t-shirt
02:08:14
◼
►
as any one of the keywords, so you would never find it.
02:08:16
◼
►
And finally, Apple has caught up with that and saying, yes,
02:08:18
◼
►
you just type what you want to find.
02:08:20
◼
►
We'll do our best to find it.
02:08:21
◼
►
We're not confining you to keywords.
02:08:23
◼
►
Powered by modern technology, I'm very happy to see this.
02:08:27
◼
►
I hope it works really well.
02:08:28
◼
►
Because this is one of those things--
02:08:30
◼
►
and this is what, to bring it full circle,
02:08:31
◼
►
what I was talking about earlier,
02:08:32
◼
►
and not to say that you guys disagree at all,
02:08:34
◼
►
but this is what I want to see.
02:08:35
◼
►
Like, take something that is frigging painful in my life.
02:08:38
◼
►
Like, I know that I took a picture of me and Marco
02:08:43
◼
►
on the Nurburgring.
02:08:44
◼
►
And I know that it was sometime in 2013.
02:08:46
◼
►
And yes, I could like drill in via map.
02:08:48
◼
►
But I forget where the Nurburgring is in Germany.
02:08:50
◼
►
And you're scrolling.
02:08:50
◼
►
You even find the month.
02:08:51
◼
►
There's so many photos there.
02:08:52
◼
►
And you go past it because it's just one picture.
02:08:54
◼
►
Yeah, it's so frustrating.
02:08:56
◼
►
This is the moment that I want the adults in the room
02:08:59
◼
►
to fix that problem.
02:09:01
◼
►
And as far as we know so far, they're fixing it.
02:09:04
◼
►
So I'm here for it.
02:09:06
◼
►
But they also said you can do something like, say,
02:09:08
◼
►
make this photo pop.
02:09:09
◼
►
But I guess it increases saturation or something
02:09:11
◼
►
on those lines.
02:09:11
◼
►
I have funny ways for you to hit a button in the UI.
02:09:15
◼
►
Significant enhancements to App Intents.
02:09:17
◼
►
And this was kind of hinted at or obliquely mentioned
02:09:20
◼
►
many, many, many times.
02:09:21
◼
►
But basically, the App Intents system-- and Marco,
02:09:24
◼
►
I'm happy for you to jump in whenever you're ready.
02:09:26
◼
►
But the App Intents system is powering
02:09:28
◼
►
a lot of what Siri is doing, which is exactly, I think,
02:09:30
◼
►
what Marco, you had predicted in the past.
02:09:32
◼
►
Yeah, it's what I've been hoping for.
02:09:34
◼
►
Because it's a way for apps to expose different actions,
02:09:37
◼
►
like play a podcast, send email, or whatever,
02:09:40
◼
►
to the shortcut system.
02:09:41
◼
►
And that's great for shortcuts users,
02:09:43
◼
►
but there's not that many shortcuts users.
02:09:45
◼
►
So what they're doing is expanding the system
02:09:49
◼
►
and basically adding it to the semantic index.
02:09:52
◼
►
So that way, at some point, rolling out slowly
02:09:56
◼
►
over the next year or so, Siri will first
02:10:00
◼
►
be able to access those App Intents
02:10:03
◼
►
and start doing actions like, give me
02:10:08
◼
►
a list of all the podcasts in Overcast
02:10:10
◼
►
that they never set up a shortcut for,
02:10:12
◼
►
that it can use the App Intents system with AI approaches
02:10:17
◼
►
and linguistic analysis to look at the descriptions and actions
02:10:20
◼
►
and try to figure out what you actually meant
02:10:23
◼
►
and then actually do that in those apps.
02:10:24
◼
►
What they showed today is the early foundations of that.
02:10:28
◼
►
It's going to be a while before we can actually really do that.
02:10:32
◼
►
And a lot of this stuff is kind of hand-wavy as, soon, this
02:10:35
◼
►
will be available, or later in the year, or next year.
02:10:38
◼
►
But this is good.
02:10:39
◼
►
This is exactly what I was hoping to see.
02:10:41
◼
►
This is a great first step.
02:10:43
◼
►
Yep, couldn't agree more.
02:10:44
◼
►
They also gave another great example.
02:10:45
◼
►
Siri, when is my mom's flight landing?
02:10:47
◼
►
And it was pulling together not only the email that
02:10:50
◼
►
has her flight number, but also what is the actual arrival
02:10:54
◼
►
time for that flight.
02:10:55
◼
►
And again, this is smart, useful, useful ways
02:10:59
◼
►
to solve problems for people.
02:11:01
◼
►
I have a question about that, though.
02:11:02
◼
►
A lot of the examples they were showing were like, oh,
02:11:04
◼
►
and we pulled this from an email or whatever.
02:11:07
◼
►
And they did show the Superhuman Email App at one point,
02:11:09
◼
►
but my question is, I don't use the mail app.
02:11:11
◼
►
Does it have no access to my email because it's from Google?
02:11:14
◼
►
I understand it's a third-party integration problem.
02:11:16
◼
►
Google's not going to want to share that with you.
02:11:18
◼
►
Google already does a lot of these things.
02:11:19
◼
►
Google will read my emails, knows where my flights are,
02:11:21
◼
►
gives me summaries, and so on and so forth.
02:11:23
◼
►
But it seems like, because I use Gmail, nothing in my email
02:11:26
◼
►
will be exposed to Siri, which will make it less useful for me.
02:11:28
◼
►
And that is actually a problem for Apple,
02:11:30
◼
►
because a lot of people do use third-party mail clients.
02:11:32
◼
►
And I hope Apple at least comes up with a way
02:11:35
◼
►
to integrate with Siri for third-party email apps that then
02:11:40
◼
►
Google can ignore for three years like they did with--
02:11:42
◼
►
what was it?
02:11:43
◼
►
Multitasking in iOS.
02:11:44
◼
►
What was the feature they didn't add to iOS for you?
02:11:46
◼
►
Yeah, for the iPad, right?
02:11:47
◼
►
I mean, this is probably all part of the spotlight APIs.
02:11:52
◼
►
I don't know to what degree--
02:11:54
◼
►
I don't know if we know yet, through documentation
02:11:56
◼
►
and everything, to what degree the existing spotlight APIs are
02:11:59
◼
►
being used to feed the semantic index from third-party apps.
02:12:02
◼
►
I don't think we know that.
02:12:03
◼
►
But that is the way to do it.
02:12:06
◼
►
And so that's probably one of those other areas
02:12:08
◼
►
that we'll also see, like, over time, we're
02:12:10
◼
►
going to probably see them start making these APIs slowly more
02:12:14
◼
►
integrated, more public with the semantic index,
02:12:16
◼
►
and allow third-party apps to add data to it.
02:12:20
◼
►
Whether the apps will is a very different question.
02:12:23
◼
►
And Google is not motivated to do this.
02:12:25
◼
►
I mean, Google has no spotlight supports.
02:12:27
◼
►
Google has its own search, which is very good.
02:12:29
◼
►
But it's kind of a shame that the usefulness of Siri
02:12:32
◼
►
is-- depends highly on having access to things
02:12:36
◼
►
like your email that it just may not have access
02:12:38
◼
►
to if you don't use Apple Mail.
02:12:40
◼
►
So they said it's a new era for Siri.
02:12:42
◼
►
Then you can enhance your writing.
02:12:44
◼
►
We spoke about most of this already.
02:12:45
◼
►
But there's smart reply in mail.
02:12:47
◼
►
And what I thought was interesting was,
02:12:51
◼
►
like, I write to the boys, hey, when
02:12:53
◼
►
are you going to San Jose?
02:12:56
◼
►
What is your flight number?
02:12:57
◼
►
When are you getting in?
02:12:58
◼
►
Et cetera, et cetera.
02:12:58
◼
►
So I have a list of questions, right?
02:13:00
◼
►
What they had was like a wizard sort of interface
02:13:04
◼
►
where you would just say, OK, my flight number is 1234.
02:13:06
◼
►
I get in on Sunday.
02:13:07
◼
►
And I'll be in at 5 PM or whatever.
02:13:09
◼
►
And then it would-- based on my answer, their answers,
02:13:12
◼
►
I guess-- it would draft an email that would say, hey,
02:13:15
◼
►
I'm getting into such and such time and blah, blah, blah.
02:13:17
◼
►
And I thought that was very neat.
02:13:18
◼
►
I mean, and people are like, oh, don't you
02:13:19
◼
►
want to write that email yourself?
02:13:21
◼
►
Especially on a phone, this is like-- if you're on the go,
02:13:23
◼
►
you don't have time to tap out an email.
02:13:24
◼
►
But you just want to say, yes, I'll be there.
02:13:26
◼
►
And I'll be there at 8 or no, I'm not coming.
02:13:27
◼
►
And you don't want to have to type out that email.
02:13:29
◼
►
This is a useful feature.
02:13:31
◼
►
You called it a wizard using the Microsoft terminology.
02:13:35
◼
►
It's turning what would be a typing exercise into a button
02:13:37
◼
►
pressing exercise.
02:13:38
◼
►
And when you're on the go, especially on the watch--
02:13:40
◼
►
I don't know if this is exposed on the watch--
02:13:41
◼
►
but even on the phone, sometimes you
02:13:43
◼
►
don't want to sit there and grab your phone with two hands
02:13:44
◼
►
and type, type, type or whatever.
02:13:46
◼
►
I give this feature a big thumbs up.
02:13:48
◼
►
Mail, previews and mail.
02:13:50
◼
►
So what I was going to say is previews and mail,
02:13:52
◼
►
and now summaries.
02:13:52
◼
►
What does that even mean?
02:13:53
◼
►
So when you're looking at your inbox, for example,
02:13:55
◼
►
and you'll see the first two or three lines of text
02:13:59
◼
►
from that email, oftentimes it's like, hey, how's it going?
02:14:02
◼
►
Hey, we spoke about this.
02:14:04
◼
►
Well, now what that's going to show is a summary of the email.
02:14:07
◼
►
Two very big thumbs up for me, if that's what's happening,
02:14:11
◼
►
or if it works well, I guess I should say.
02:14:14
◼
►
And it also will bubble up priority messages.
02:14:16
◼
►
Same thing with notifications.
02:14:18
◼
►
Priority at the top, you'll get summaries, et cetera.
02:14:20
◼
►
They specifically enumerated, oh,
02:14:22
◼
►
if the group chat is popping off,
02:14:24
◼
►
you'll get a summary of it, which is great.
02:14:26
◼
►
Focus has a reduce interruptions mode.
02:14:28
◼
►
And they showed a screenshot of maybe important--
02:14:31
◼
►
and I think it was like a rideshare or something
02:14:33
◼
►
I forget exactly what it was.
02:14:35
◼
►
They had a section about expressing yourself.
02:14:37
◼
►
And they talked about genmoji.
02:14:40
◼
►
So what you can do is you can type a T-Rex wearing
02:14:43
◼
►
a tuxedo on a surfboard.
02:14:44
◼
►
And then you'll get an emoji-looking thing
02:14:48
◼
►
of a T-Rex wearing a tuxedo on a surfboard.
02:14:50
◼
►
If this works, that's really cool.
02:14:52
◼
►
It's basically an emoji generator
02:14:53
◼
►
that generates new art in the style of Apple's emoji.
02:14:58
◼
►
Which is great.
02:14:59
◼
►
This is a clever idea to choose to do this particular feature
02:15:03
◼
►
because the images generated are low resolution.
02:15:05
◼
►
That's true.
02:15:06
◼
►
That's faster to generate.
02:15:07
◼
►
Oh, that's interesting.
02:15:09
◼
►
They picked very tiny images.
02:15:10
◼
►
So very often, those AI image generators
02:15:13
◼
►
will make you a thumbnail first.
02:15:14
◼
►
And if you really like it, it'll do the longer processing
02:15:16
◼
►
for the bigger thing.
02:15:17
◼
►
But these are all fast and presumably on device
02:15:20
◼
►
and presumably trained on Apple's own emoji.
02:15:21
◼
►
That was one of the questions, by the way,
02:15:23
◼
►
that I just asked.
02:15:23
◼
►
They said-- and you may be wondering, listen to this--
02:15:26
◼
►
they asked Apple, what did you use
02:15:29
◼
►
to train all your AI models?
02:15:33
◼
►
And their answer was not great.
02:15:35
◼
►
I was hoping that they would have touted it in the thing.
02:15:37
◼
►
And by the way, everything we train these with
02:15:40
◼
►
is information that we own.
02:15:41
◼
►
But what they said instead was, we trained it
02:15:44
◼
►
on publicly available information on the web,
02:15:49
◼
►
They didn't have a story kind of like Adobe or whatever of like,
02:15:51
◼
►
look, we paid for our own all the information
02:15:54
◼
►
we trained this on.
02:15:54
◼
►
It's not on any of your user data.
02:15:56
◼
►
It's just on stock photos that we bought or licensed.
02:15:59
◼
►
We licensed things from New York Times.
02:16:00
◼
►
They didn't say that.
02:16:01
◼
►
They trained it on publicly available information.
02:16:05
◼
►
So Apple is not currently entirely immune
02:16:08
◼
►
to whatever the fallout is of the legal ramifications
02:16:11
◼
►
of training AI stuff.
02:16:13
◼
►
Yep, so they have an image playground,
02:16:17
◼
►
which this is where we're starting to jump
02:16:20
◼
►
the shark a little bit.
02:16:21
◼
►
But it could be cool.
02:16:23
◼
►
So what this is is it's in line, or I
02:16:24
◼
►
believe they said in a dedicated app.
02:16:26
◼
►
And you can create playful images.
02:16:28
◼
►
There are themes, costumes, accessories, places, and more.
02:16:31
◼
►
It all happens on device.
02:16:33
◼
►
And you can use different styles,
02:16:34
◼
►
like we mentioned before, animation, sketch,
02:16:35
◼
►
or illustration.
02:16:36
◼
►
There are suggestions related to personal context.
02:16:39
◼
►
You can do this, I think, in many different places.
02:16:43
◼
►
And this is creating like a-- what was the image generator
02:16:45
◼
►
thing you just said a second ago?
02:16:46
◼
►
The stable diffusion.
02:16:48
◼
►
It's giving like a stable diffusion style image.
02:16:51
◼
►
This is 2024 clip art.
02:16:52
◼
►
Yeah, actually.
02:16:53
◼
►
But they really showed it being used as clip art.
02:16:55
◼
►
You need an image or something.
02:16:57
◼
►
Now you can just describe what it is.
02:16:58
◼
►
Or if you did a sketch of something,
02:17:00
◼
►
they showed someone they drew like an outline of something,
02:17:02
◼
►
you can just say, take this and make it into a picture.
02:17:03
◼
►
And they even showed, hey, maybe you
02:17:05
◼
►
didn't provide an illustration.
02:17:06
◼
►
Maybe you wrote a note or a document.
02:17:08
◼
►
And you just circled the blank area next to it.
02:17:11
◼
►
And it says, make me an image.
02:17:12
◼
►
And it will look at the text and figure based on that text,
02:17:14
◼
►
here's what the image should be.
02:17:16
◼
►
I presume that this was trained only on known licensed images,
02:17:21
◼
►
because this is a big danger zone.
02:17:22
◼
►
But if they train it only on like if there's no porn there,
02:17:26
◼
►
it's not going to generate those type of things.
02:17:28
◼
►
It seems very constrained.
02:17:30
◼
►
And the interface is wacky and weird and really maybe
02:17:34
◼
►
it's like a glowing blob and these things floating
02:17:37
◼
►
I'm not sure that's the right choice for this feature.
02:17:39
◼
►
But anyway, if you need to generate AI looking stock art
02:17:43
◼
►
that everyone will know was AI generated,
02:17:46
◼
►
you can use this feature to do it.
02:17:48
◼
►
It's available to third parties.
02:17:49
◼
►
It's available as a dedicated app.
02:17:50
◼
►
It appears in lots of places.
02:17:52
◼
►
It's blobby and weird.
02:17:53
◼
►
And I think this is the most sort of out there feature
02:17:56
◼
►
they decided to add that is a questionable utility
02:17:58
◼
►
of questionable legality based on what they've told us.
02:18:01
◼
►
And I think all of the stuff that it generates
02:18:04
◼
►
is kind of recognizable as having been generated.
02:18:07
◼
►
But it's better than, I guess, doing
02:18:09
◼
►
what other people-- what people did before features like this,
02:18:11
◼
►
which is that you just Google.
02:18:12
◼
►
You just type what you want in Google.
02:18:14
◼
►
You make it an image search.
02:18:15
◼
►
You grab some image you found on the web.
02:18:16
◼
►
You yank it and put it in your thing.
02:18:18
◼
►
And this is probably better than that.
02:18:19
◼
►
They mentioned a few other things.
02:18:21
◼
►
Photo editing, they have a cleanup tool,
02:18:23
◼
►
magic eraser style thing, searching
02:18:24
◼
►
using natural language, which we talked about.
02:18:27
◼
►
Memory movies, which I actually really enjoy those.
02:18:29
◼
►
They're clearly a very naive implementation.
02:18:32
◼
►
But they're fun, and I guess they're
02:18:34
◼
►
going to get a lot better.
02:18:35
◼
►
Or you could even type a description,
02:18:36
◼
►
and it'll assemble the movie for you.
02:18:38
◼
►
They even said including chapters.
02:18:39
◼
►
I'm not sure if they literally mean chapters
02:18:41
◼
►
or if they mean different phases.
02:18:43
◼
►
Like a title card or whatever.
02:18:44
◼
►
And by the way, the way the third party
02:18:46
◼
►
thing of scribbling over an image or whatever,
02:18:48
◼
►
that's their magic wand tool.
02:18:50
◼
►
It's part of like pencil kit.
02:18:51
◼
►
The little pencil thing that you see
02:18:52
◼
►
lets you pick like a highlighter or a pencil, a pen,
02:18:54
◼
►
or whatever.
02:18:55
◼
►
Now you have a new tool, which is like a magician's magic wand.
02:18:58
◼
►
And that's the thing you use in any document where
02:19:00
◼
►
you're using pencil kit.
02:19:01
◼
►
And that thing appears.
02:19:02
◼
►
You can just grab the magic wand and circle something
02:19:04
◼
►
that you drew, and it will make an image out of it.
02:19:07
◼
►
And then Craig comes back to say that notes will record
02:19:10
◼
►
and transcribe audio.
02:19:12
◼
►
And then I believe he said you can also
02:19:14
◼
►
do this on a phone call.
02:19:15
◼
►
And part of that is that it will notify you.
02:19:18
◼
►
They didn't explain how.
02:19:19
◼
►
But notify you and the other party, I should make it clear.
02:19:23
◼
►
They will notify both parties that the recording has started.
02:19:26
◼
►
And that will be part of the phone call.
02:19:28
◼
►
And then it will record and transcribe it.
02:19:30
◼
►
Yeah, and summarize it afterwards.
02:19:32
◼
►
So all common voice meeting features.
02:19:35
◼
►
And then all this is available for free on new OSs.
02:19:38
◼
►
Then they talked about, hey, what
02:19:39
◼
►
if you need to do something more?
02:19:41
◼
►
Like something more intense that requires more general knowledge,
02:19:44
◼
►
et cetera, et cetera.
02:19:45
◼
►
So we've partnered with ChatGPT and GPT 4.0.
02:19:49
◼
►
And Siri can leverage ChatGPT.
02:19:51
◼
►
And what we've talked about, and we are not the only ones,
02:19:53
◼
►
is, well, how does Apple make it clear
02:19:56
◼
►
that if this gets gross or weird or whatever, that's not on us.
02:19:59
◼
►
That's them over there.
02:20:00
◼
►
That's the double popped collar weirdos over there.
02:20:03
◼
►
Don't blame us.
02:20:04
◼
►
And so what happens is as you're using Siri, it will say, hey--
02:20:07
◼
►
I forget exactly how it's verbalized.
02:20:09
◼
►
But basically, I can't do this.
02:20:10
◼
►
ChatGPT might be able to.
02:20:11
◼
►
Oh, it doesn't say I can't do this.
02:20:12
◼
►
Right, exactly.
02:20:13
◼
►
That's the thing about this feature.
02:20:14
◼
►
They were like, how is this going to manifest?
02:20:16
◼
►
How are they going to present it?
02:20:17
◼
►
The fact is they don't have anything like this.
02:20:21
◼
►
Now, if they did have something like this,
02:20:22
◼
►
how would they use it?
02:20:23
◼
►
We don't know.
02:20:24
◼
►
Because they don't have anything like this.
02:20:26
◼
►
But basically, you talk to Siri, and I'm
02:20:29
◼
►
sure it doesn't say I can't do this.
02:20:30
◼
►
What it does is helpfully offer, hey,
02:20:33
◼
►
do you want me to send this to ChatGPT?
02:20:35
◼
►
As if people know what the hell ChatGPT is.
02:20:38
◼
►
People know.
02:20:38
◼
►
And you could say yes or you can say no.
02:20:40
◼
►
And if you say yes, it will do it, and it will bring it back.
02:20:43
◼
►
And they're really sort of isolating it to lay the blame.
02:20:46
◼
►
And I was kind of surprised when they said, and by the way,
02:20:49
◼
►
this may work with other things besides ChatGPT in the future.
02:20:52
◼
►
They even named Google Gemini.
02:20:54
◼
►
They said, you know, Google Gemini,
02:20:55
◼
►
we were talking with them, and the rumors that you read-- no,
02:20:57
◼
►
they didn't say this.
02:20:58
◼
►
But they said, hey, we may integrate
02:21:01
◼
►
with other third-party large language models.
02:21:04
◼
►
What they didn't say is we're also internally
02:21:06
◼
►
working to make our model as good as theirs
02:21:08
◼
►
so we can use it.
02:21:09
◼
►
They do have their own models.
02:21:10
◼
►
Everything we've talked about so far
02:21:12
◼
►
is Apple's own models running on Apple's own servers
02:21:14
◼
►
and Apple's own device.
02:21:15
◼
►
And they emphasize this in the keynote.
02:21:17
◼
►
Just to be clear, everything you've seen, it's us.
02:21:20
◼
►
It's all us.
02:21:20
◼
►
It's privacy-preserving.
02:21:22
◼
►
But then they didn't say this.
02:21:24
◼
►
We don't have this.
02:21:25
◼
►
There's a thing we don't have that we
02:21:26
◼
►
know people are interested in.
02:21:28
◼
►
And we wanted to provide access to it.
02:21:29
◼
►
And the way they're doing it is sometimes when you talk to Siri,
02:21:32
◼
►
it suggests that you talk to somebody else.
02:21:35
◼
►
And so they will go to ChatGPT.
02:21:37
◼
►
This will do composition, image generation, no account required.
02:21:42
◼
►
There's nothing logged.
02:21:45
◼
►
ChatGPT subscribers can optionally
02:21:47
◼
►
connect their account to get more paid features,
02:21:49
◼
►
et cetera, et cetera.
02:21:50
◼
►
They said, you're in control of when ChatGPT is used.
02:21:53
◼
►
It's coming later this year.
02:21:54
◼
►
And it's support for other AI models in the future.
02:21:57
◼
►
And so basically, that's AI for the rest of us, as they said.
02:22:01
◼
►
iPhone 15 Pro and iPad and Mac with M1 or later.
02:22:05
◼
►
US English this summer.
02:22:06
◼
►
Everyone else pound sand for the time being.
02:22:08
◼
►
And iPad, M1, and later, too.
02:22:09
◼
►
Sorry, yes, yes, yes.
02:22:11
◼
►
This is pretty great.
02:22:12
◼
►
I mean, I think we need to wrap up because we're
02:22:15
◼
►
going to run along here.
02:22:17
◼
►
I'm very happy with what they've announced today.
02:22:20
◼
►
I think it is exactly the kind of thing
02:22:23
◼
►
we would expect from Apple and kind of at the top of what
02:22:26
◼
►
we would expect from Apple.
02:22:27
◼
►
It's not underwhelming.
02:22:30
◼
►
There's no major limitations or compromises that we can see yet.
02:22:34
◼
►
I think it looks like a really solid set of updates.
02:22:36
◼
►
And I like that where they're going with their AI features
02:22:40
◼
►
does seem to be exactly in line with both what
02:22:43
◼
►
we would expect from Apple and what we would hope from Apple.
02:22:46
◼
►
So overall, we'll see over the coming months,
02:22:49
◼
►
as we dive into the APIs and see what the limitations are,
02:22:52
◼
►
and then as we actually get to use these betas,
02:22:54
◼
►
like we'll see kind of where the rough edges still are
02:22:56
◼
►
or what features aren't there yet.
02:22:57
◼
►
But overall, as a way for them to have set the direction,
02:23:00
◼
►
I'm very happy with what this is.
02:23:03
◼
►
All these things are so subject to, OK, well,
02:23:05
◼
►
we have to actually try to use them.
02:23:06
◼
►
Because the things they describe are great
02:23:07
◼
►
until we see what answers they give them.
02:23:09
◼
►
With these sort of AI/LM things, that's the big question.
02:23:12
◼
►
Like, will it do a good job?
02:23:14
◼
►
We like how it's set up.
02:23:16
◼
►
We like, as I said, the architecture
02:23:17
◼
►
and their private clouds and the privacy preserving.
02:23:19
◼
►
And we like how it integrates.
02:23:21
◼
►
And we like everything about it.
02:23:22
◼
►
But the bottom line is, you're going to get a result.
02:23:25
◼
►
Is the result useful?
02:23:26
◼
►
Does it get it wrong?
02:23:27
◼
►
Like, this has always been the problem with Siri.
02:23:29
◼
►
Siri ostensibly can do a bunch of things.
02:23:30
◼
►
But often you ask it to do them and it can't do them.
02:23:33
◼
►
Will it be consistent more than Siri is?
02:23:35
◼
►
Will it be faster?
02:23:36
◼
►
Like, these are all things that we'll find out
02:23:38
◼
►
when we start running the betas and see how it works out.
02:23:40
◼
►
But the architecture and the arrangement
02:23:42
◼
►
and the selection of features they've laid out
02:23:44
◼
►
all look good.
02:23:45
◼
►
It's just a question of execution now.
02:23:47
◼
►
And we hope they do that well.
02:23:49
◼
►
- All right, thank you to our sponsors this week.
02:23:52
◼
►
Trade Coffee and Delete Me.
02:23:54
◼
►
And thank you especially to our members.
02:23:56
◼
►
You support us directly.
02:23:57
◼
►
We are so thankful for that.
02:23:59
◼
►
You can join atp.fm/join.
02:24:03
◼
►
What are we doing for overtime this week?
02:24:04
◼
►
- I think we're going to be talking about
02:24:06
◼
►
the Apple Park WWDC experience.
02:24:09
◼
►
Which I'm very excited to talk about.
02:24:11
◼
►
Everything except maybe the food will be in overtime.
02:24:14
◼
►
We'll probably, we'll give everyone the food stuff
02:24:16
◼
►
in just a moment.
02:24:17
◼
►
- So overtime is our member exclusive segment.
02:24:19
◼
►
You can join and listen atp.fm/join.
02:24:22
◼
►
Thank you so much everyone and we'll talk to you next week.
02:24:25
◼
►
(upbeat music)
02:24:28
◼
►
♪ Now the show is over ♪
02:24:30
◼
►
♪ They didn't even mean to begin ♪
02:24:32
◼
►
♪ 'Cause it was accidental ♪
02:24:34
◼
►
♪ Accidental ♪
02:24:35
◼
►
♪ Oh it was accidental ♪
02:24:37
◼
►
♪ Accidental ♪
02:24:38
◼
►
♪ John didn't do any research ♪
02:24:40
◼
►
♪ Marco and Casey wouldn't let him ♪
02:24:43
◼
►
♪ 'Cause it was accidental ♪
02:24:45
◼
►
♪ Accidental ♪
02:24:46
◼
►
♪ It was accidental ♪
02:24:47
◼
►
♪ Accidental ♪
02:24:49
◼
►
♪ And you can find the show notes at atp.fm ♪
02:24:54
◼
►
♪ And if you're into Mastodon ♪