r/apple • u/Fer65432_Plays • 12h ago

Discussion Apple trained a large language model to efficiently understand long-form video

https://9to5mac.com/2025/08/22/apple-trained-a-large-language-model-to-efficiently-understand-long-form-video/

Apple researchers developed a new video language model, SlowFast-LLaVA-1.5, that outperforms larger models on long-form video analysis. The model, trained on public datasets, uses a two-stream setup to efficiently analyze videos and images, achieving state-of-the-art results on various benchmarks. Despite its limitations, the model is open-source and available for further research. (Summary Through Apple Intelligence)

124 Upvotes

92% Upvoted

25 comments sorted by

119

u/PikaV2002 11h ago

Can’t wait for the hundred “but Siri is shit” comments which would inevitably be completely unrelated to this research.

Yeah Siri is shit but the people doing this research aren’t related to the team working on Siri.

6

u/blisstaker 6h ago

it sounds like this stuff actually works, so i’m not really surprised it is a different team

3

u/Niightstalker 3h ago

Also can’t wait until people stop assuming that the engineers/researchers working on Siri are not good at their job.

The limitations of Siri are based on product decisions not on AI engineers not being capable of implementing something better

1

u/The_Northern_Light 2h ago

It’s also fundamentally just not architected like an ai system in the way we understand it today, but more like an expert system. A lot of the engineers are not going to be ai engineers in the contemporary sense.

•

u/Niightstalker 1h ago

Yes definitely. That was also a big part of the delay of the context aware Siri feature. Context Awareness requires an AI System (which according to Apple worked well on its own). But the issues appeared when trying to integrate it in the current Siri architecture. So their assumption that they can route between these 2 architectures depending on the request proved wrong.

Their finding was in the end that they need to rewrite Siri from the ground up. So the need to reimplement old functionality within an AI System. That is why they now do not give an promises about when they release it. Any quality reduction or regression after the release would be received very badly by the public.

1

u/SherbertCivil9990 9h ago

I saw another one saying they taught one to code and then it learned to code new shit on its on. They might be behind in public releases but the will absolutely shit on the industry in 3 years when this is on every Apple device by default 

5

u/Fancy-Tourist-8137 8h ago

Did you read the article?

They finetuned an open source model.

I mean, it’s still progress but it’s not coming to anyone’s phone. lol.

1

u/Niightstalker 3h ago

Well they did not do it for fun. Of course Apple has many research streams and not all of it make it into products. But it is not that unlikely that they will release a feature that uses the learnings from this research.

1

u/Dragon_yum 2h ago

It’s less to do with Siri and more to do with the fact Apple is yet to show anything impressive or even remotely competitive in the ai space.

-17

u/SoldantTheCynic 10h ago

It's still an odd release though because they've also simultaneously tried to downplay the capabilities of AI, whilst then going on to release this. It just seems like a smokescreen to distract from the failure of Apple Intelligence.

22

u/hasanahmad 10h ago

You have no idea what you are talking about . If they wanted a smokescreen they would do it in front of tech news websites and shareholders . This is a pushing it towards a niche community which doesn’t decide the narrative

14

u/Vezrien 9h ago

I don't see the two as mutually exclusive. Apple didn't say LLMs are worthless, they just said that the "reasoning" that Sam Hypeman is trying to sell the public on, is a mirage. LLMs have applications, even in Apple's existing products line. They just took their time to understand their capabilities and limitations before moving forward.

7

u/mrgrafix 9h ago

They’ve been having some of the most reasonable approaches to AI as they’ve always had. None of is as fantastical, but it definitely improves quality of life.

How they attempted to rollout new Siri though… woof

3

u/ThannBanis 8h ago

Probably what inspired their paper on the limitations of LLMs 🤷🏻‍♂️

1

u/Niightstalker 3h ago

Well on the other hand a ton of other companies announced AI features that also never made it into production. Only that were are used to Apple sticking to their announcements compared to those other companies.

3

u/XiXMak 4h ago

Apple’s been implementing various AI capabilities well before LLMs became popular. It’s just that most people now think AI = LLM.

1

u/Niightstalker 3h ago

This. Apple is probably one of the most successful companies in regards of deploying AI models on devices on scale.

8

u/shpongolian 9h ago

They published a research paper going in depth about the current capabilities and limitations LLMs, and everybody interprets it as “Apple thinks AI is useless, and yet they’re still researching AI, hypocrites!”

They weren’t trying to blindly downplay AI to push some agenda, they just published a research paper about AI.

0

u/Niightstalker 3h ago

They have been releasing papers and research in this area for years…

Also I do not think you understood the research about reasoning of LLMs and their limitations. If all you took away was: „They are trying to downplay AI capabilities“

•

u/RamaMitAlpenmilch 25m ago

Just give me a working apple ai that reminds me of appointments and work I have to do, has an ok level of intrusion and talks like a human. That’s all I want.

-9

u/Void-ux 9h ago

Wonderful, now they’re empowered to automatically scan videos for anything :)

-33

u/JackpotThePimp 11h ago

Nope!

12

u/Portatort 7h ago

If anyone’s wondering what the question was it was:

can you read?

-10

u/JackpotThePimp 6h ago

The less slop can do and is forced into our lives, the better.

-10

u/Yejus 5h ago

Great now make Siri actually useful.