Mobile-Agent: The Powerful Mobile Device Operation Assistant Family

English | 简体中文 | 日本語

---

📺Demo

Mobile-Agent-v3 (Note: The video is not accelerated)

YouTube

Bilibili

PC-Agent

Chrome and DingTalk

Search.NBA.FMVP.and.send.to.friend.mp4

Word

Write.an.introduction.of.Alibaba.in.Word.mp4

Mobile-Agent-v2

Mobile-Agent-v2.mp4

Mobile-Agent

Mobile-Agent.mp4

📢News

• 🔥🔥[9.26] Mobile-Agent-v2 has been accepted by The Thirty-eighth Annual Conference on Neural Information Processing Systems (NeurIPS 2024).
• 🔥[8.23] We proposed PC-Agent, a PC operation assistant supporting both Mac and Windows platforms.
• 🔥[7.29] Mobile-Agent won the best demo award at the The 23rd China National Conference on Computational Linguistics (CCL 2024). On the CCL 2024, we displayed the upcoming Mobile-Agent-v3. It has smaller memory overhead (8 GB), faster reasoning speed (10s-15s per operation), and all uses open source models. Video demo, please see the last section 📺Demo.
• [6.27] We proposed Demo that can upload mobile phone screenshots to experience Mobile-Agent-V2 in Hugging Face and ModelScope. You don’t need to configure models and devices, and you can experience it immediately.
• [6. 4] Modelscope-Agent has supported Mobile-Agent-V2, based on Android Adb Env, please check in the application.
• [6. 4] We proposed Mobile-Agent-v2, a mobile device operation assistant with effective navigation via multi-agent collaboration.
• [3.10] Mobile-Agent has been accepted by the ICLR 2024 Workshop on Large Language Model (LLM) Agents.

📱Version

• Mobile-Agent-v3
• Mobile-Agent-v2 - Mobile Device Operation Assistant with Effective Navigation via Multi-Agent Collaboration
• Mobile-Agent - Autonomous Multi-Modal Mobile Device Agent with Visual Perception

⭐Star History

📑Citation

If you find Mobile-Agent useful for your research and applications, please cite using this BibTeX:

@article{wang2024mobile2,
  title={Mobile-Agent-v2: Mobile Device Operation Assistant with Effective Navigation via Multi-Agent Collaboration},
  author={Wang, Junyang and Xu, Haiyang and Jia, Haitao and Zhang, Xi and Yan, Ming and Shen, Weizhou and Zhang, Ji and Huang, Fei and Sang, Jitao},
  journal={arXiv preprint arXiv:2406.01014},
  year={2024}
}

@article{wang2024mobile,
  title={Mobile-Agent: Autonomous Multi-Modal Mobile Device Agent with Visual Perception},
  author={Wang, Junyang and Xu, Haiyang and Ye, Jiabo and Yan, Ming and Shen, Weizhou and Zhang, Ji and Huang, Fei and Sang, Jitao},
  journal={arXiv preprint arXiv:2401.16158},
  year={2024}
}

📦Related Projects

• AppAgent: Multimodal Agents as Smartphone Users
• mPLUG-Owl & mPLUG-Owl2: Modularized Multimodal Large Language Model
• Qwen-VL: A Versatile Vision-Language Model for Understanding, Localization, Text Reading, and Beyond
• GroundingDINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detection
• CLIP: Contrastive Language-Image Pretraining