AI Cell Phone & System
Last updated
Was this helpful?
Last updated
Was this helpful?
Apple released a new model called Ferret UI tailored for comprehending and interacting with mobile user interfaces (UIs). Ferret-UI enhances Ferret by integrating "any resolution" support to handle the elongated aspect ratios and small UI elements typical of mobile screens. It can perform tasks such as icon recognition, text finding, and widget listing. The model was trained on a comprehensive dataset and benchmarked against other UI understanding models, demonstrating superior performance in elementary and advanced UI tasks.
The paper "Ferret-UI: Grounded Mobile UI Understanding with Multimodal LLMs"
Updates:
Apple and OpenAI have reportedly reached an official agreement to integrate OpenAI's technology into Apple's upcoming iOS 18. This partnership will allow Apple to incorporate ChatGPT features into the next iteration of its iPhone operating system, enhancing the AI capabilities of its devices. The deal is expected to be announced at Apple's Worldwide Developers Conference (WWDC) next month, where several new AI features for iOS 18 will be unveiled.
Samsung launched its first AI-powered smartphone in early 2024, introducing a wide array of AI features in the new S24 series/OneUI 6.0. These features include message generation, real-time translation, web page summarization, voice memo summarization, enhanced image editing, and more. Following the OneUI 6.1 update, these AI capabilities have been extended to a broader range of older models.
You can read the full paper .
