You can not select more than 25 topics
Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.
79 lines
6.7 KiB
79 lines
6.7 KiB
--- |
|
comments: true |
|
description: Execute object detection in real-time on your iOS devices utilizing YOLO models. Leverage the power of the Apple Neural Engine and Core ML for fast and efficient object detection. |
|
keywords: Ultralytics, iOS app, object detection, YOLO models, real time, Apple Neural Engine, Core ML, FP16, INT8, quantization |
|
--- |
|
|
|
# Ultralytics iOS App: Real-time Object Detection with YOLO Models |
|
|
|
<a href="https://bit.ly/ultralytics_hub" target="_blank"> |
|
<img width="100%" src="https://user-images.githubusercontent.com/26833433/281124469-6b3b0945-dbb1-44c8-80a9-ef6bc778b299.jpg" alt="Ultralytics HUB preview image"></a> |
|
<br> |
|
<div align="center"> |
|
<a href="https://github.com/ultralytics"><img src="https://github.com/ultralytics/assets/raw/main/social/logo-social-github.png" width="3%" alt="Ultralytics GitHub"></a> |
|
<img src="https://github.com/ultralytics/assets/raw/main/social/logo-transparent.png" width="3%"> |
|
<a href="https://www.linkedin.com/company/ultralytics/"><img src="https://github.com/ultralytics/assets/raw/main/social/logo-social-linkedin.png" width="3%" alt="Ultralytics LinkedIn"></a> |
|
<img src="https://github.com/ultralytics/assets/raw/main/social/logo-transparent.png" width="3%"> |
|
<a href="https://twitter.com/ultralytics"><img src="https://github.com/ultralytics/assets/raw/main/social/logo-social-twitter.png" width="3%" alt="Ultralytics Twitter"></a> |
|
<img src="https://github.com/ultralytics/assets/raw/main/social/logo-transparent.png" width="3%"> |
|
<a href="https://youtube.com/ultralytics"><img src="https://github.com/ultralytics/assets/raw/main/social/logo-social-youtube.png" width="3%" alt="Ultralytics YouTube"></a> |
|
<img src="https://github.com/ultralytics/assets/raw/main/social/logo-transparent.png" width="3%"> |
|
<a href="https://www.tiktok.com/@ultralytics"><img src="https://github.com/ultralytics/assets/raw/main/social/logo-social-tiktok.png" width="3%" alt="Ultralytics TikTok"></a> |
|
<img src="https://github.com/ultralytics/assets/raw/main/social/logo-transparent.png" width="3%"> |
|
<a href="https://www.instagram.com/ultralytics/"><img src="https://github.com/ultralytics/assets/raw/main/social/logo-social-instagram.png" width="3%" alt="Ultralytics Instagram"></a> |
|
<img src="https://github.com/ultralytics/assets/raw/main/social/logo-transparent.png" width="3%"> |
|
<a href="https://ultralytics.com/discord"><img src="https://github.com/ultralytics/assets/raw/main/social/logo-social-discord.png" width="3%" alt="Ultralytics Discord"></a> |
|
<br> |
|
<br> |
|
<a href="https://apps.apple.com/xk/app/ultralytics/id1583935240" style="text-decoration:none;"> |
|
<img src="https://raw.githubusercontent.com/ultralytics/assets/master/app/app-store.svg" width="15%" alt="" /></a> |
|
</div> |
|
|
|
The Ultralytics iOS App is a powerful tool that allows you to run YOLO models directly on your iPhone or iPad for real-time object detection. This app utilizes the Apple Neural Engine and Core ML for model optimization and acceleration, enabling fast and efficient object detection. |
|
|
|
## Quantization and Acceleration |
|
|
|
To achieve real-time performance on your iOS device, YOLO models are quantized to either FP16 or INT8 precision. Quantization is a process that reduces the numerical precision of the model's weights and biases, thus reducing the model's size and the amount of computation required. This results in faster inference times without significantly affecting the model's accuracy. |
|
|
|
### FP16 Quantization |
|
|
|
FP16 (or half-precision) quantization converts the model's 32-bit floating-point numbers to 16-bit floating-point numbers. This reduces the model's size by half and speeds up the inference process, while maintaining a good balance between accuracy and performance. |
|
|
|
### INT8 Quantization |
|
|
|
INT8 (or 8-bit integer) quantization further reduces the model's size and computation requirements by converting its 32-bit floating-point numbers to 8-bit integers. This quantization method can result in a significant speedup, but it may lead to a slight reduction in accuracy. |
|
|
|
## Apple Neural Engine |
|
|
|
The Apple Neural Engine (ANE) is a dedicated hardware component integrated into Apple's A-series and M-series chips. It's designed to accelerate machine learning tasks, particularly for neural networks, allowing for faster and more efficient execution of your YOLO models. |
|
|
|
By combining quantized YOLO models with the Apple Neural Engine, the Ultralytics iOS App achieves real-time object detection on your iOS device without compromising on accuracy or performance. |
|
|
|
| Release Year | iPhone Name | Chipset Name | Node Size | ANE TOPs | |
|
|--------------|------------------------------------------------------|-------------------------------------------------------|-----------|----------| |
|
| 2017 | [iPhone X](https://en.wikipedia.org/wiki/IPhone_X) | [A11 Bionic](https://en.wikipedia.org/wiki/Apple_A11) | 10 nm | 0.6 | |
|
| 2018 | [iPhone XS](https://en.wikipedia.org/wiki/IPhone_XS) | [A12 Bionic](https://en.wikipedia.org/wiki/Apple_A12) | 7 nm | 5 | |
|
| 2019 | [iPhone 11](https://en.wikipedia.org/wiki/IPhone_11) | [A13 Bionic](https://en.wikipedia.org/wiki/Apple_A13) | 7 nm | 6 | |
|
| 2020 | [iPhone 12](https://en.wikipedia.org/wiki/IPhone_12) | [A14 Bionic](https://en.wikipedia.org/wiki/Apple_A14) | 5 nm | 11 | |
|
| 2021 | [iPhone 13](https://en.wikipedia.org/wiki/IPhone_13) | [A15 Bionic](https://en.wikipedia.org/wiki/Apple_A15) | 5 nm | 15.8 | |
|
| 2022 | [iPhone 14](https://en.wikipedia.org/wiki/IPhone_14) | [A16 Bionic](https://en.wikipedia.org/wiki/Apple_A16) | 4 nm | 17.0 | |
|
|
|
Please note that this list only includes iPhone models from 2017 onwards, and the ANE TOPs values are approximate. |
|
|
|
## Getting Started with the Ultralytics iOS App |
|
|
|
To get started with the Ultralytics iOS App, follow these steps: |
|
|
|
1. Download the Ultralytics App from the [App Store](https://apps.apple.com/xk/app/ultralytics/id1583935240). |
|
|
|
2. Launch the app on your iOS device and sign in with your Ultralytics account. If you don't have an account yet, create one [here](https://hub.ultralytics.com/). |
|
|
|
3. Once signed in, you will see a list of your trained YOLO models. Select a model to use for object detection. |
|
|
|
4. Grant the app permission to access your device's camera. |
|
|
|
5. Point your device's camera at objects you want to detect. The app will display bounding boxes and class labels in real-time as it detects objects. |
|
|
|
6. Explore the app's settings to adjust the detection threshold, enable or disable specific object classes, and more. |
|
|
|
With the Ultralytics iOS App, you can now leverage the power of YOLO models for real-time object detection on your iPhone or iPad, powered by the Apple Neural Engine and optimized with FP16 or INT8 quantization.
|
|
|