Ultralytics Assistant
3 months ago
committed by
GitHub
commit
a3d14bae44
13 changed files with 310 additions and 43 deletions
@ -0,0 +1,160 @@ |
||||
--- |
||||
comments: true |
||||
description: Discover how TrackZone leverages Ultralytics YOLO11 to precisely track objects within specific zones, enabling real-time insights for crowd analysis, surveillance, and targeted monitoring. |
||||
keywords: TrackZone, object tracking, YOLO11, Ultralytics, real-time object detection, AI, deep learning, crowd analysis, surveillance, zone-based tracking, resource optimization |
||||
--- |
||||
|
||||
# TrackZone using Ultralytics YOLO11 |
||||
|
||||
## What is TrackZone? |
||||
|
||||
TrackZone specializes in monitoring objects within designated areas of a frame instead of the whole frame. Built on [Ultralytics YOLO11](https://github.com/ultralytics/ultralytics/), it integrates object detection and tracking specifically within zones for videos and live camera feeds. YOLO11's advanced algorithms and [deep learning](https://www.ultralytics.com/glossary/deep-learning-dl) technologies make it a perfect choice for real-time use cases, offering precise and efficient object tracking in applications like crowd monitoring and surveillance. |
||||
|
||||
## Advantages of Object Tracking in Zones (TrackZone) |
||||
|
||||
- **Targeted Analysis:** Tracking objects within specific zones allows for more focused insights, enabling precise monitoring and analysis of areas of interest, such as entry points or restricted zones. |
||||
- **Improved Efficiency:** By narrowing the tracking scope to defined zones, TrackZone reduces computational overhead, ensuring faster processing and optimal performance. |
||||
- **Enhanced Security:** Zonal tracking improves surveillance by monitoring critical areas, aiding in the early detection of unusual activity or security breaches. |
||||
- **Scalable Solutions:** The ability to focus on specific zones makes TrackZone adaptable to various scenarios, from retail spaces to industrial settings, ensuring seamless integration and scalability. |
||||
|
||||
## Real World Applications |
||||
|
||||
| Agriculture | Transportation | |
||||
| :-----------------------------------------------------------------------------------------------------------------------------------------------------------------: | :-------------------------------------------------------------------------------------------------------------------------------------------------------------------: | |
||||
|  |  | |
||||
| Plants Tracking in Field Using Ultralytics YOLO11 | Vehicles Tracking on Road using Ultralytics YOLO11 | |
||||
|
||||
!!! example "TrackZone using YOLO11 Example" |
||||
|
||||
=== "CLI" |
||||
|
||||
```bash |
||||
# Run a trackzone example |
||||
yolo solutions trackzone show=True |
||||
|
||||
# Pass a source video |
||||
yolo solutions trackzone show=True source="path/to/video/file.mp4" |
||||
|
||||
# Pass region coordinates |
||||
yolo solutions trackzone show=True region=[(150, 150), (1130, 150), (1130, 570), (150, 570)] |
||||
``` |
||||
|
||||
=== "Python" |
||||
|
||||
```python |
||||
import cv2 |
||||
|
||||
from ultralytics import solutions |
||||
|
||||
cap = cv2.VideoCapture("path/to/video/file.mp4") |
||||
assert cap.isOpened(), "Error reading video file" |
||||
w, h, fps = (int(cap.get(x)) for x in (cv2.CAP_PROP_FRAME_WIDTH, cv2.CAP_PROP_FRAME_HEIGHT, cv2.CAP_PROP_FPS)) |
||||
|
||||
# Define region points |
||||
region_points = [(150, 150), (1130, 150), (1130, 570), (150, 570)] |
||||
|
||||
# Video writer |
||||
video_writer = cv2.VideoWriter("object_counting_output.avi", cv2.VideoWriter_fourcc(*"mp4v"), fps, (w, h)) |
||||
|
||||
# Init TrackZone (Object Tracking in Zones, not complete frame) |
||||
trackzone = solutions.TrackZone( |
||||
show=True, # Display the output |
||||
region=region_points, # Pass region points |
||||
model="yolo11n.pt", # You can use any model that Ultralytics support, i.e. YOLOv9, YOLOv10 |
||||
# line_width=2, # Adjust the line width for bounding boxes and text display |
||||
# classes=[0, 2], # If you want to count specific classes i.e. person and car with COCO pretrained model. |
||||
) |
||||
|
||||
# Process video |
||||
while cap.isOpened(): |
||||
success, im0 = cap.read() |
||||
if not success: |
||||
print("Video frame is empty or video processing has been successfully completed.") |
||||
break |
||||
im0 = trackzone.trackzone(im0) |
||||
video_writer.write(im0) |
||||
|
||||
cap.release() |
||||
video_writer.release() |
||||
cv2.destroyAllWindows() |
||||
``` |
||||
|
||||
### Argument `TrackZone` |
||||
|
||||
Here's a table with the `TrackZone` arguments: |
||||
|
||||
| Name | Type | Default | Description | |
||||
| ------------ | ------ | ---------------------------------------------------- | ---------------------------------------------------- | |
||||
| `model` | `str` | `None` | Path to Ultralytics YOLO Model File | |
||||
| `region` | `list` | `[(150, 150), (1130, 150), (1130, 570), (150, 570)]` | List of points defining the object tracking region. | |
||||
| `line_width` | `int` | `2` | Line thickness for bounding boxes. | |
||||
| `show` | `bool` | `False` | Flag to control whether to display the video stream. | |
||||
|
||||
### Arguments `model.track` |
||||
|
||||
{% include "macros/track-args.md" %} |
||||
|
||||
## FAQ |
||||
|
||||
### How do I track objects in a specific area or zone of a video frame using Ultralytics YOLO11? |
||||
|
||||
Tracking objects in a defined area or zone of a video frame is straightforward with Ultralytics YOLO11. Simply use the command provided below to initiate tracking. This approach ensures efficient analysis and accurate results, making it ideal for applications like surveillance, crowd management, or any scenario requiring zonal tracking. |
||||
|
||||
```bash |
||||
yolo solutions trackzone source="path/to/video/file.mp4" show=True |
||||
``` |
||||
|
||||
### How can I use TrackZone in Python with Ultralytics YOLO11? |
||||
|
||||
With just a few lines of code, you can set up object tracking in specific zones, making it easy to integrate into your projects. |
||||
|
||||
```python |
||||
import cv2 |
||||
|
||||
from ultralytics import solutions |
||||
|
||||
cap = cv2.VideoCapture("path/to/video/file.mp4") |
||||
assert cap.isOpened(), "Error reading video file" |
||||
w, h, fps = (int(cap.get(x)) for x in (cv2.CAP_PROP_FRAME_WIDTH, cv2.CAP_PROP_FRAME_HEIGHT, cv2.CAP_PROP_FPS)) |
||||
|
||||
# Define region points |
||||
region_points = [(150, 150), (1130, 150), (1130, 570), (150, 570)] |
||||
|
||||
# Video writer |
||||
video_writer = cv2.VideoWriter("object_counting_output.avi", cv2.VideoWriter_fourcc(*"mp4v"), fps, (w, h)) |
||||
|
||||
# Init TrackZone (Object Tracking in Zones, not complete frame) |
||||
trackzone = solutions.TrackZone( |
||||
show=True, # Display the output |
||||
region=region_points, # Pass region points |
||||
model="yolo11n.pt", |
||||
) |
||||
|
||||
# Process video |
||||
while cap.isOpened(): |
||||
success, im0 = cap.read() |
||||
if not success: |
||||
print("Video frame is empty or video processing has been successfully completed.") |
||||
break |
||||
im0 = trackzone.trackzone(im0) |
||||
video_writer.write(im0) |
||||
|
||||
cap.release() |
||||
video_writer.release() |
||||
cv2.destroyAllWindows() |
||||
``` |
||||
|
||||
### How do I configure the zone points for video processing using Ultralytics TrackZone? |
||||
|
||||
Configuring zone points for video processing with Ultralytics TrackZone is simple and customizable. You can directly define and adjust the zones through a Python script, allowing precise control over the areas you want to monitor. |
||||
|
||||
```python |
||||
# Define region points |
||||
region_points = [(150, 150), (1130, 150), (1130, 570), (150, 570)] |
||||
|
||||
# Init TrackZone (Object Tracking in Zones, not complete frame) |
||||
trackzone = solutions.TrackZone( |
||||
show=True, # Display the output |
||||
region=region_points, # Pass region points |
||||
) |
||||
``` |
||||
@ -0,0 +1,11 @@ |
||||
| Argument | Type | Default | Description | |
||||
| ---------------- | -------------- | -------------------------------------------------- | ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ | |
||||
| `region` | `list` | `[(20, 400), (1080, 400), (1080, 360), (20, 360)]` | Defines the region points for object counting, queue monitoring, trackzone or speed estimation. The points are defined as coordinates forming a polygonal area for analysis. | |
||||
| `show_in` | `bool` | `True` | Indicates whether to display objects that are counted as entering the defined region. Essential for real-world analytics, such as monitoring ingress trends. | |
||||
| `show_out` | `bool` | `True` | Indicates whether to display objects that are counted as exiting the defined region. Useful for applications requiring egress tracking and analytics. | |
||||
| `colormap` | `int or tuple` | `COLORMAP_PARULA` | Specifies the OpenCV-supported colormap for heatmap visualization. Default is `COLORMAP_PARULA`, but other colormaps can be used for different visualization preferences. | |
||||
| `up_angle` | `float` | `145.0` | Angle threshold for detecting the "up" position in workouts monitoring. Can be adjusted based on the position of keypoints for different exercises. | |
||||
| `down_angle` | `float` | `90.0` | Angle threshold for detecting the "down" position in workouts monitoring. Adjust this based on keypoint positions for specific exercises. | |
||||
| `kpts` | `list` | `[6, 8, 10]` | List of keypoints used for monitoring workouts. These keypoints correspond to body joints or parts, such as shoulders, elbows, and wrists, for exercises like push-ups, pull-ups, squats, ab-workouts. | |
||||
| `analytics_type` | `str` | `line` | Specifies the type of analytics visualization to generate. Options include `"line"`, `"pie"`, `"bar"`, or `"area"`. The default is `"line"` for trend visualization. | |
||||
| `json_file` | `str` | `None` | Path to the JSON file defining regions for parking systems or similar applications. Enables flexible configuration of analysis areas. | |
||||
@ -0,0 +1,68 @@ |
||||
# Ultralytics YOLO 🚀, AGPL-3.0 license |
||||
|
||||
import cv2 |
||||
import numpy as np |
||||
|
||||
from ultralytics.solutions.solutions import BaseSolution |
||||
from ultralytics.utils.plotting import Annotator, colors |
||||
|
||||
|
||||
class TrackZone(BaseSolution): |
||||
""" |
||||
A class to manage region-based object tracking in a video stream. |
||||
|
||||
This class extends the BaseSolution class and provides functionality for tracking objects within a specific region |
||||
defined by a polygonal area. Objects outside the region are excluded from tracking. It supports dynamic initialization |
||||
of the region, allowing either a default region or a user-specified polygon. |
||||
|
||||
Attributes: |
||||
region (ndarray): The polygonal region for tracking, represented as a convex hull. |
||||
|
||||
Methods: |
||||
trackzone: Processes each frame of the video, applying region-based tracking. |
||||
|
||||
Examples: |
||||
>>> tracker = TrackZone() |
||||
>>> frame = cv2.imread("frame.jpg") |
||||
>>> processed_frame = tracker.trackzone(frame) |
||||
>>> cv2.imshow("Tracked Frame", processed_frame) |
||||
""" |
||||
|
||||
def __init__(self, **kwargs): |
||||
"""Initializes the TrackZone class for tracking objects within a defined region in video streams.""" |
||||
super().__init__(**kwargs) |
||||
default_region = [(150, 150), (1130, 150), (1130, 570), (150, 570)] |
||||
self.region = cv2.convexHull(np.array(self.region or default_region, dtype=np.int32)) |
||||
|
||||
def trackzone(self, im0): |
||||
""" |
||||
Processes the input frame to track objects within a defined region. |
||||
|
||||
This method initializes the annotator, creates a mask for the specified region, extracts tracks |
||||
only from the masked area, and updates tracking information. Objects outside the region are ignored. |
||||
|
||||
Args: |
||||
im0 (numpy.ndarray): The input image or frame to be processed. |
||||
|
||||
Returns: |
||||
(numpy.ndarray): The processed image with tracking id and bounding boxes annotations. |
||||
|
||||
Examples: |
||||
>>> tracker = TrackZone() |
||||
>>> frame = cv2.imread("path/to/image.jpg") |
||||
>>> tracker.trackzone(frame) |
||||
""" |
||||
self.annotator = Annotator(im0, line_width=self.line_width) # Initialize annotator |
||||
# Create a mask for the region and extract tracks from the masked image |
||||
masked_frame = cv2.bitwise_and(im0, im0, mask=cv2.fillPoly(np.zeros_like(im0[:, :, 0]), [self.region], 255)) |
||||
self.extract_tracks(masked_frame) |
||||
|
||||
cv2.polylines(im0, [self.region], isClosed=True, color=(255, 255, 255), thickness=self.line_width * 2) |
||||
|
||||
# Iterate over boxes, track ids, classes indexes list and draw bounding boxes |
||||
for box, track_id, cls in zip(self.boxes, self.track_ids, self.clss): |
||||
self.annotator.box_label(box, label=f"{self.names[cls]}:{track_id}", color=colors(track_id, True)) |
||||
|
||||
self.display_output(im0) # display output with base class function |
||||
|
||||
return im0 # return output image for more usage |
||||
Loading…
Reference in new issue