29 Oct 11:14

blakeblackshear

33825f6

0.15.0 Beta 1 Pre-release

Pre-release

Beta Documentation: https://deploy-preview-13787--frigate-docs.netlify.app/

Images

ghcr.io/blakeblackshear/frigate:0.15.0-beta1
ghcr.io/blakeblackshear/frigate:0.15.0-beta1-standard-arm64
ghcr.io/blakeblackshear/frigate:0.15.0-beta1-tensorrt
ghcr.io/blakeblackshear/frigate:0.15.0-beta1-tensorrt-jp4
ghcr.io/blakeblackshear/frigate:0.15.0-beta1-tensorrt-jp5
ghcr.io/blakeblackshear/frigate:0.15.0-beta1-rk
ghcr.io/blakeblackshear/frigate:0.15.0-beta1-rocm
ghcr.io/blakeblackshear/frigate:0.15.0-beta1-h8l

Major Changes for 0.15.0

Breaking Changes

There are several breaking changes in this release, Frigate will attempt to update the configuration automatically. In some cases manual changes may be required. It is always recommended to back up your current config and database before upgrading:

Simply copy your current config file to a new location
Stop Frigate and make a copy of the frigate.db file

Rewritten SHM system
- The SHM system has been rewritten to be more stable. This means that more shared memory (SHM) will be used by default but the total usage will not fluctuate, and Frigate will not fail from SHM overflowing. A new calculation is done on startup, so if your shm_size is too low then a warning will be printed in the log stating that it needs to be increased.
Recording configuration changed
- The record config has been refactored to allow for direct control of how long alerts and detections are retained. These values will be automatically populated from your current config, but you may want to adjust the values that are set after updating. See the updated docs here.
ffmpeg updates
- ffmpeg has been updated to version 7. Some Intel users may need to change what hwaccel preset they are using (preset-vaapi may need to now be preset-intel-qsv-h264 or preset-intel-qsv-h265).
- ffmpeg is no longer part of $PATH. In most cases this is handled automatically, but go2rtc exec streams will need to add the full path for ffmpeg which in most cases will be /usr/lib/ffmpeg/7.0/bin/ffmpeg

Explore

The new Explore pane in Frigate 0.15 makes it easy to explore every object tracked by Frigate. It offers a variety of filters and supports keyword and phrase-based text search, searching for similar images, and searching through descriptive text generated by AI models.

AI/ML Search

Frigate 0.15 introduces two powerful search features: Semantic Search and GenAI Search. Semantic Search can be enabled on its own, while GenAI Search works in addition to Semantic Search.

Semantic Search

Semantic Search uses a CLIP model to generate embeddings (numerical representations of images) for the thumbnails of your tracked objects, enabling searches based on text descriptions or visual similarity. This is all done locally.

For instance, if Frigate detects and tracks a car, you can use similarity search to see other instances where Frigate detected and tracked that same car. You can also quickly search your tracked objects using an "image caption" approach. Searching for "red car driving on a residential street" or "person in a blue shirt walking on the sidewalk at dawn" or even "a person wearing a black t-shirt with the word 'SPORT' on it" will produce some stunning results.

Semantic Search works by running an AI model locally on your system. Small or underpowered systems like a Raspberry Pi will not run Semantic Search reliably or at all. A dedicated GPU and 16GB of RAM is recommended for best performance.

See the Semantic Search docs for system requirements, setup instructions, and usage tips.

Generative AI

GenAI Search employs generative AI models to create descriptive text for the thumbnails of your tracked objects, which are stored in the Frigate database to enhance future searches. Supported providers include Google Gemini, Ollama, and OpenAI, so you can choose whether you want to send data to the cloud or use a locally hosted provider.

See the GenAI docs for setup instructions and use case suggestions.

Improved Tools for Debugging

Review Item Details Pane

A new Review Item Details pane can be viewed by clicking / tapping on the gray chip on a review item in the Review pane. This shows more information about the review item as well as thumbnails or snapshots for individual objects (if enabled). The pane also provides links to share the review item, download it, submit images to Frigate+, view object lifecycles, and more.

Object Lifecycle Pane

The Recordings Timeline from Frigate 0.13 has been improved upon and returns to 0.15 as the Object Lifecycle, viewable in the Review Details pane as well as the new Explore page. The new pane shows the significant moments during the object's lifecycle: when it was first seen, when it entered a zone, became stationary, etc. It also provides information about the object's area and size ratio to assist in configuring Frigate to tune out false positives.

Native Notifications

Frigate now supports notifications using the WebPush protocol. This allows Frigate to deliver notifications to devices that have registered to receive notifications in the Frigate settings, delivering them in a timely and secure manner. Currently, notifications will be delivered for all review items marked as alerts. More options for native notifications will be supported in the future.

See the notifications docs.

New Object Detectors

ONNX

ONNX is an open model standard which allows for a single model format that can run on different types of GPUs. The default, tensorrt, and rocm Frigate build variants include GPU support for efficient object detection via ONNX models, simplifying configuration and support more models. There are no default included ONNX models for object detection.

AMD MiGraphX

Support has been added for AMD GPUs via ROCm and MiGraphX. Currently there is no default included model for this detector.

Hailo-8

Support has been added for the Hailo8 and Hailo-8L hardware for object detection on both arm64 and amd64 platforms.

Other UI Changes

Rework the Storage metrics pane to be more clear how much storage each camera is using
Camera stream info button has been added to the camera metrics page allowing easy access to see camera codec information
Add button for downloading the full set of logs
The timeline handlebar will now automatically scroll while viewing recordings
Review items and exports can now be shared via your browser's sharing pane or via direct link url. A secure context is required for the browser/OS sharing pane to function
Add the ability to rename camera groups
Add middle mouse button support in the Review pane to open full recordings view in a new tab
Add Nvidia GPU encode and decode stats to system metrics
New desktop keyboard shortcuts. In addition to the numerous keyboard shortcuts available with 0.14, 0.15 adds several more. In Live view, the numeric keys (1-9) will move PTZ cameras to presets. In Review, Page Up and Page Down will scroll through review items
Accessibility updates for users with screen readers

Other Backend Changes

FFMPEG updated to 7.0
OpenVINO updated to 2024.3
Use FastAPI instead of Flask for the Frigate API
Add service manager infrastructure
Install onevpl tools and update drivers for Intel
If record is disabled for a camera then that camera will not save frames to the preview during that time
Fix stalled connections to certain onvif cameras
Fix autotracking absolute zoom interpolation logic

Assets 2

452 Join discussion

29 Aug 22:32

blakeblackshear

v0.14.1

f4f3cfa

0.14.1 Release Latest

Latest

Images

ghcr.io/blakeblackshear/frigate:0.14.1
ghcr.io/blakeblackshear/frigate:0.14.1-standard-arm64
ghcr.io/blakeblackshear/frigate:0.14.1-tensorrt
ghcr.io/blakeblackshear/frigate:0.14.1-tensorrt-jp4
ghcr.io/blakeblackshear/frigate:0.14.1-tensorrt-jp5
ghcr.io/blakeblackshear/frigate:0.14.1-rk

This is a maintenance release for Frigate 0.14 that includes bugfixes as well as performance and stability improvements.

What's Changed

Fix auth when serving Frigate at a subpath (#12815)
Fix iOS export buttons (#12755)
Ensure review cameras are sorted by config UI order if specified (#12789)
Fix default model for rknn detector (#12807)
Add button to mark alert as reviewed in filmstrip (#12878)
Add confirmation dialog before deleting review items (#12950)
Fix manual events (#12951)
Add pan/pinch/zoom capability on Frigate+ view snapshots (#12953)
Hide recording button when disabled in config (#12997)
Recordings view fixes (#13005)
Fix missing last hour preview in recordings view (#13027)
Fix export name and NaN showing in Frigate+ slider (#13030)
Prevent error when github sends bad data (#13077)
Add shortcut key "r" to mark items as reviewed in Review pane (#13087)
Fix Frigate+ view from inadvertently reloading (#13160)
Fix live player from getting stuck while loading streams and from lagging behind in poor network conditions (#13143)
Ensure previews that are generated late are not falsely excluded (#13193)
Ensure only enabled birdseye cameras are considered active (#13194)
UI fixes (#13246)
Fix cgroup detecting 0 cpu cores (#13271)
Add tooltip for icons in review event list (#13334)
Don't allow periods in zone or camera group names (#13400)
Add portal to the live player tooltip (#13389)

Assets 2

08 Aug 13:18

blakeblackshear

v0.14.0

da913d8

0.14.0 Release

Images

ghcr.io/blakeblackshear/frigate:0.14.0
ghcr.io/blakeblackshear/frigate:0.14.0-standard-arm64
ghcr.io/blakeblackshear/frigate:0.14.0-tensorrt
ghcr.io/blakeblackshear/frigate:0.14.0-tensorrt-jp4
ghcr.io/blakeblackshear/frigate:0.14.0-tensorrt-jp5
ghcr.io/blakeblackshear/frigate:0.14.0-rk

Changes since RC2

None

Major Changes for 0.14.0

Breaking Changes

There are several breaking changes in this release, Frigate will attempt to update the configuration automatically. In some cases manual changes may be required. It is always recommended to backup your current config and database before upgrading:

Simply copy your current config file to a new location
Stop Frigate and make a copy of the frigate.db file

Your existing events will not be visible in Frigate's new UI

An entirely new way of reviewing camera footage has been implemented in Frigate 0.14, and existing events could not be migrated
Recordings can still be viewed in the new UI using the recordings viewer (From Live view, click/tap on a camera and select the History button at the top left)
You may want to export any starred/favorite events before upgrading
If you are using the Home Assistant integration, events can still be viewed there
Recording (enabled: True for record in your config) is required to see review items and motion data in the UI

Zone/mask coordinates are now stored in the config as relative values

Frigate's configuration migrator will read your existing mask/zone coordinates and convert them for relative use internally on startup
Using the built-in mask/zone editor will make your config file incompatible with prior versions of Frigate
If you have mask/zone coordinate values that exceed the detect resolution, it will be ignored and you will see warnings in the log. Delete the mask or zone from your config and then use the editor in the UI to recreate it.

The UI's live mode is now intelligently selected

The live_mode config option is now deprecated and should be removed.

Backwards incompatible database changes

There are a number of changes made to Frigate's database, which are not backwards compatible. A backup of the database is automatically made on startup, but a manual backup is highly recommended.

Other breaking changes

RTMP was deprecated in 0.13 and has been fully removed in 0.14. You will need to remove any rtmp references in your config file.
OpenVINO has been upgraded, and Intel Neural Compute sticks are no longer supported. Support for YOLO-NAS models has been added. Additionally, AUTO mode now maps to GPU internally to avoid some unresolved issues with AUTO. The existing YOLO-X model will not work in this version.

Brand New UI

Frigate 0.14's UI has been completely rewritten (helpful walkthrough video from a user) and optimized for desktop and mobile devices, aiming to simplify the user experience by focusing on two specific goals:

Allow you to quickly see what's currently happening or what just happened on your cameras. The new Live view features a real-time dashboard with live camera feeds and a filmstrip of animated thumbnails showing recent activity.
Make reviewing video footage more efficient. Frigate intelligently identifies parts of your timeline for review by leveraging the underlying data about motion and tracked objects. The new Review area implements a scrollable grid of thumbnails alongside a timeline where a hover or swipe begins a preview playback. Review items can be configured to be pre-categorized into alerts or detections based on cameras and/or zones. The review area also provides a motion review mode, allowing real-time scrubbing of video footage for any objects of interest that Frigate may have missed.

Frigate 0.14's UI will likely change the way you review your camera footage. It's a big change, but we love it and hope you do too. See the announcement post for more information regarding the motivation, ideas, and design decisions behind the new UI.

Dashboard

The new home page for Frigate is intended to be a real-time dashboard for your cameras. Recent alerts are represented by animated thumbnails in a filmstrip view above your camera feeds. Your camera images update once per minute when no detectable activity is occurring to conserve bandwidth and resources. As soon as any motion is detected, cameras seamlessly switch to a full-resolution live stream.

Custom camera groups are now supported. Add any of your cameras (including the Birdseye camera) to user-definable groups and easily toggle between them.
On desktops and tablets, cameras in a camera group can be resized and rearranged via dragging.

Live View

Clicking a camera from the dashboard will bring up a full-resolution live view where you can quickly access historical footage, use PTZ controls, toggle camera audio, use two-way talk, and more. Zooming with pinch or a scroll wheel is also supported.

Review

The Review area of Frigate 0.14 is for quickly reviewing historical footage of interest from your cameras. Review items are indicated on a vertical timeline and displayed as a grid of previews - bandwidth-optimized, low frame rate, low resolution videos. Hovering over or swiping a preview plays the video and marks it as reviewed. If more in-depth analysis is required, the preview can be clicked/tapped and the full frame rate, full resolution recording is displayed. Review items are filterable by date, object type, and camera.

Alerts and Detections

Not every segment of video captured by Frigate may be of the same level of interest to you. Video of people who enter your property are a different priority than those walking by on the sidewalk. For this reason, Frigate 0.14 categorizes review items as alerts or detections. By default, all person and car objects are considered alerts. You can refine categorization of your review items by configuring required zones for them.

See the review docs for more information

Motion review

In Frigate 0.13, there isn’t a way to see motion activity on a timeline and watch video at that time. The ability to scrub video for things Frigate missed has been one of the most common feature requests. Within the Motion tab of the Review section, you can now scrub through the timeline for all cameras simultaneously with a timeline showing relative motion activity. In order to avoid scrubbing over time periods already included in alerts and detections, you can also scrub in motion only mode.

History

In Frigate 0.14, full frame rate, full resolution camera footage (called "recordings" in earlier versions) can be viewed and scrubbed via a timeline. Previews of your other cameras are displayed and scrubbed alongside the main selected camera.

Exporting footage from the History view has been drastically improved. Choose predefined time periods, enter a time directly, or drag handles on the timeline to select an export range.
Past exports can be viewed, renamed, deleted, and downloaded from the dedicated Export pane, accessible from the navigation bar.

Other Notable UI Changes

System stats - New charts and graphs with colored segments to track system usage history and more quickly identify problems or issues.
Status bar - A new status bar gives at-a-glance CPU/GPU usage as well as any problems or issues with Frigate.
New log viewer - The log viewer now provides a pane with links to solutions for common issues.
Real-time motion tuning - Tune motion detection settings for your cameras without editing your config file and restarting.
New mask and zone editor - Edit your masks and zones with a much-improved editor.

Authentication

Frigate now supports authentication. Frigate manages users and authentication using JWT tokens via a cookie or authorization header. Additionally, a new proxy section in the config allows you to use the user header passed from common authentication proxies such as authelia, authentik, oauth2_proxy, etc.

Authentication is enforced on a new port 8971, and port 5000 is still unauthenticated for backwards compatibility. If you want to use Frigate's authentication, update your reverse proxy to point at port 8971 instead of 5000.
Support for role based authorization (admin/user roles) will come in a future release and will support upstream authentication proxies.
The Home Assistant integration needs to be pointed at port 5000. Some recommended configuration examples are in the updated docs.

See the documentation for more information.

TLS

Since Authentication should really be used over secure connections, TLS is also enabled by default for port 8971. It can be disabled in the config file with the following yaml:

tls:
  enabled: False

Custom certificates can also be used following the tls docs.

Frigate+

Frigate 0.14 now offers a dedicated page for Frigate+ submissions, allowing more spec...

Assets 2

213 Join discussion

03 Aug 13:12

blakeblackshear

v0.14.0-rc2

da913d8

0.14.0 Release Candidate 2 Pre-release

Pre-release

Images

ghcr.io/blakeblackshear/frigate:0.14.0-rc2
ghcr.io/blakeblackshear/frigate:0.14.0-rc2-standard-arm64
ghcr.io/blakeblackshear/frigate:0.14.0-rc2-tensorrt
ghcr.io/blakeblackshear/frigate:0.14.0-rc2-tensorrt-jp4
ghcr.io/blakeblackshear/frigate:0.14.0-rc2-tensorrt-jp5
ghcr.io/blakeblackshear/frigate:0.14.0-rc2-rk

Changes since RC1

Minor UI updates, small bugfixes, and performance improvements.

Major Changes for 0.14.0

Breaking Changes

There are several breaking changes in this release, Frigate will attempt to update the configuration automatically. In some cases manual changes may be required. It is always recommended to backup your current config and database before upgrading:

Simply copy your current config file to a new location
Stop Frigate and make a copy of the frigate.db file

Your existing events will not be visible in Frigate's new UI

An entirely new way of reviewing camera footage has been implemented in Frigate 0.14, and existing events could not be migrated
Recordings can still be viewed in the new UI using the recordings viewer (From Live view, click/tap on a camera and select the History button at the top left)
You may want to export any starred/favorite events before upgrading
If you are using the Home Assistant integration, events can still be viewed there
Recording (enabled: True for record in your config) is required to see review items and motion data in the UI

Zone/mask coordinates are now stored in the config as relative values

Frigate's configuration migrator will read your existing mask/zone coordinates and convert them for relative use internally on startup
Using the built-in mask/zone editor will make your config file incompatible with prior versions of Frigate
If you have mask/zone coordinate values that exceed the detect resolution, it will be ignored and you will see warnings in the log. Delete the mask or zone from your config and then use the editor in the UI to recreate it.

The UI's live mode is now intelligently selected

The live_mode config option is now deprecated and should be removed.

Backwards incompatible database changes

There are a number of changes made to Frigate's database, which are not backwards compatible. A backup of the database is automatically made on startup, but a manual backup is highly recommended.

Other breaking changes

RTMP was deprecated in 0.13 and has been fully removed in 0.14. You will need to remove any rtmp references in your config file.
OpenVINO has been upgraded, and Intel Neural Compute sticks are no longer supported. Support for YOLO-NAS models has been added. Additionally, AUTO mode now maps to GPU internally to avoid some unresolved issues with AUTO. The existing YOLO-X model will not work in this version.

Brand New UI

Frigate 0.14's UI has been completely rewritten (guided demo, helpful walkthrough video from a user) and optimized for desktop and mobile devices, aiming to simplify the user experience by focusing on two specific goals:

Allow you to quickly see what's currently happening or what just happened on your cameras. The new Live view features a real-time dashboard with live camera feeds and a filmstrip of animated thumbnails showing recent activity.
Make reviewing video footage more efficient. Frigate intelligently identifies parts of your timeline for review by leveraging the underlying data about motion and tracked objects. The new Review area implements a scrollable grid of thumbnails alongside a timeline where a hover or swipe begins a preview playback. Review items can be configured to be pre-categorized into alerts or detections based on cameras and/or zones. The review area also provides a motion review mode, allowing real-time scrubbing of video footage for any objects of interest that Frigate may have missed.