Object Detection From Webcam Stream Guide #9336

freddyaboulton · 2024-09-12T16:11:44Z

Description

Adds an a guide on detecting objects from the webcam stream. Also adds a "Streaming" section to the guides.

🎯 PRs Should Target Issues

Before your create a PR, please check to see if there is an existing issue for this change. If not, please create an issue before you create this PR, unless the fix is very small.

Not adhering to this guideline will result in the PR being closed.

Tests

PRs will only be merged if tests pass on CI. To run the tests locally, please set up your Gradio environment locally and run the tests: bash scripts/run_all_tests.sh
You may need to run the linters: bash scripts/format_backend.sh and bash scripts/format_frontend.sh

gradio-pr-bot · 2024-09-12T16:12:22Z

🪼 branch checks and previews

•	Name	Status	URL
	Spaces	ready!	Spaces preview
	Website	ready!	Website preview
	Storybook	ready!	Storybook preview
🦄	Changes	detected!	Details

Install Gradio from this PR

pip install https://gradio-pypi-previews.s3.amazonaws.com/dd97fb5ef830c4066dccff167d1c23af0ecbc07f/gradio-4.44.0-py3-none-any.whl

Install Gradio Python Client from this PR

pip install "gradio-client @ git+https://github.com/gradio-app/gradio@dd97fb5ef830c4066dccff167d1c23af0ecbc07f#subdirectory=client/python"

Install Gradio JS Client from this PR

npm install https://gradio-npm-previews.s3.amazonaws.com/dd97fb5ef830c4066dccff167d1c23af0ecbc07f/gradio-client-1.6.0-beta.1.tgz

Use Lite from this PR

<script type="module" src="https://gradio-lite-previews.s3.amazonaws.com/dd97fb5ef830c4066dccff167d1c23af0ecbc07f/dist/lite.js""></script>

gradio-pr-bot · 2024-09-12T16:12:29Z

🦄 change detected

This Pull Request includes changes to the following packages.

Package	Version
`gradio`	`minor`

Maintainers can select this checkbox to manually select packages to update.

With the following changelog entry.

Object Detection From Webcam Stream Guide

Maintainers or the PR author can modify the PR title to modify this entry.

Something isn't right?

Maintainers can change the version label to modify the version bump.
If the bot has failed to detect any changes, or if this pull request needs to update multiple packages to different versions or requires a more comprehensive changelog entry, maintainers can update the changelog file directly.

guides/07_streaming/02_object-detection-from-webcam.md

* clients * add changeset --------- Co-authored-by: gradio-pr-bot <[email protected]>

* Delete js/lite/src/theme.css from the Git managed file tree as it's dynamically generated * Remove lite-related npm scripts from spa/package.json * add changeset --------- Co-authored-by: gradio-pr-bot <[email protected]>

* first draft * add code * tip * add changeset * delete dead code * Type check notebook * consolidate like section with guide * Add comments * add value * Lint * lint * guide --------- Co-authored-by: gradio-pr-bot <[email protected]> Co-authored-by: Abubakar Abid <[email protected]>

* * update icon buttons * add image editor specific icon button * tweak hover * margin tweak * add changeset * improve gr.Video button UI * radius tweak * ensure even spacing * fix typechecks * add changeset * revert irrelevant changes * typefix * fix image editor buttons * fix download link icon * disable undo if no change events dispatched in model3d and video * use icons with iconbuttonwrapper * add iconbuttonwrapper around gallery share btn * Revert "add iconbuttonwrapper around gallery share btn" This reverts commit 4605302. * add changeset * design fixes * add changeset * move status tracker progress to bottom of component * add changeset * use iconbutton for like/dislike * fix lint error * fix type errors * type errors * fix test * revert undo icon change * btn spacing --------- Co-authored-by: gradio-pr-bot <[email protected]>

* Added gradio-in-r * add changeset * section * remove * tweaks * delete changeset * R * Updated using-gradio-in-other-programming-languages.md --------- Co-authored-by: Abubakar Abid <[email protected]> Co-authored-by: gradio-pr-bot <[email protected]>

* Add Lite E2E test to check a matplotlib problem which was fixed in #9312 * Restore js/app/test/image_remote_url.spec.ts, which was deleted in #8716 * Fix tootils import * Format * Fix processing_utils.resolve_with_google_dns to use the HTTPX client instead of urllib so it works on Lite * add changeset * add changeset * Move js/app/test/image_remote_url.spec.ts -> js/spa/test/image_remote_url.spec.ts * Use pyodide.http in resolve_with_google_dns on Lite --------- Co-authored-by: gradio-pr-bot <[email protected]>

…iles explicitly allowed by developer (#9348) * changes * add changeset * format * fix type * type * add test --------- Co-authored-by: gradio-pr-bot <[email protected]>

* fix markdown overflowing table * add changeset * revert undo icon * add changeset * Revert "revert undo icon" This reverts commit 855b012. * add changeset --------- Co-authored-by: gradio-pr-bot <[email protected]>

demo/yolov10_webcam_stream/run.py

guides/07_streaming/02_object-detection-from-webcam.md

abidlabs · 2024-09-18T04:23:50Z

This looks great @freddyaboulton. I agree about creating a separate section on Streaming for visbility. However, right now, it only contains example applications. What do you think about moving the two streaming guides (streaming inputs and streaming outputs) to this section as well?

abidlabs · 2024-09-18T04:25:20Z

For the demo, I experienced a ton of lag, but it could be because I was on a pretty bad wifi connection. Nevertheless, could you try the demo on a slower connection through the browser and see how it works for you? If there's anything we can do to optimize the experience for slow connections, I think that'd be great

If the deme is running well for you, LGTM, everything else is pretty minor

* remove unnecessary redirects * add changeset * fix * formatting --------- Co-authored-by: gradio-pr-bot <[email protected]>

* changes * add changeset --------- Co-authored-by: gradio-pr-bot <[email protected]>

…n `gr.Chatbot` (#9358) * change format * format * add changeset * revert * revert --------- Co-authored-by: gradio-pr-bot <[email protected]>

* update package.json * add changeset * add changeset * update pnpm lock * add changeset --------- Co-authored-by: gradio-pr-bot <[email protected]>

* fix wrap alignment * add changeset --------- Co-authored-by: gradio-pr-bot <[email protected]>

* fix sha * fix name * fix name

freddyaboulton · 2024-09-18T23:31:27Z

Thank you @abidlabs for the review! Yes the lag on spaces is on my radar.

abidlabs · 2024-09-18T23:36:54Z

Sweet, I'll take another pass very shortly

freddyaboulton · 2024-09-18T23:42:51Z

What do you think about moving the two streaming guides (streaming inputs and streaming outputs) to this section as well?

I like where the streaming guides currently are. What I decided to do is link from the basic streaming guides to the "end-to-end" example guides.

guides/04_additional-features/02_streaming-outputs.md

guides/07_streaming/02_object-detection-from-webcam.md

abidlabs

LGTM @freddyaboulton! Great demos and docs

freddyaboulton · 2024-09-19T15:34:15Z

Thank you for catching the typos!

guides

cfe4247

freddyaboulton added 3 commits September 12, 2024 12:36

Add demo

3a28eac

guide

dadda8c

Merge branch '5.0-dev' into object-detection-guide

c9130ed

freddyaboulton commented Sep 12, 2024

View reviewed changes

guides/07_streaming/02_object-detection-from-webcam.md Show resolved Hide resolved

freddyaboulton marked this pull request as ready for review September 12, 2024 21:40

abidlabs and others added 10 commits September 16, 2024 11:01

Add info about Powershell client (#9343)

3d54d4e

* clients * add changeset --------- Co-authored-by: gradio-pr-bot <[email protected]>

Remove lite/theme.css from the Git-managed file tree (#9335)

a9b5182

* Delete js/lite/src/theme.css from the Git managed file tree as it's dynamically generated * Remove lite-related npm scripts from spa/package.json * add changeset --------- Co-authored-by: gradio-pr-bot <[email protected]>

Added gradio-in-r (#9340)

c8510c1

* Added gradio-in-r * add changeset * section * remove * tweaks * delete changeset * R * Updated using-gradio-in-other-programming-languages.md --------- Co-authored-by: Abubakar Abid <[email protected]> Co-authored-by: gradio-pr-bot <[email protected]>

Do not attach content_disposition_type = "attachment" headers for f…

4ddb5db

…iles explicitly allowed by developer (#9348) * changes * add changeset * format * fix type * type * add test --------- Co-authored-by: gradio-pr-bot <[email protected]>

Fix overflowing markdown in Chatbot (#9260)

d04ab18

* fix markdown overflowing table * add changeset * revert undo icon * add changeset * Revert "revert undo icon" This reverts commit 855b012. * add changeset --------- Co-authored-by: gradio-pr-bot <[email protected]>

demo name

bae18df

Merge branch '5.0-dev' into object-detection-guide

ee3a05a

freddyaboulton requested review from abidlabs, aliabid94, aliabd, dawoodkhan82, pngwn and hannahblair September 16, 2024 17:13

abidlabs reviewed Sep 18, 2024

View reviewed changes

demo/yolov10_webcam_stream/run.py Show resolved Hide resolved

abidlabs reviewed Sep 18, 2024

View reviewed changes

demo/yolov10_webcam_stream/run.py Show resolved Hide resolved

abidlabs reviewed Sep 18, 2024

View reviewed changes

demo/yolov10_webcam_stream/run.py Outdated Show resolved Hide resolved

abidlabs reviewed Sep 18, 2024

View reviewed changes

guides/07_streaming/02_object-detection-from-webcam.md Outdated Show resolved Hide resolved

hannahblair and others added 13 commits September 18, 2024 18:44

run format

9dc7bb6

Testing CI (#9379)

ee0ae3c

* remove unnecessary redirects * add changeset * fix * formatting --------- Co-authored-by: gradio-pr-bot <[email protected]>

Fixes website build in 5.0-dev (#9382)

69b5fdc

* changes * add changeset --------- Co-authored-by: gradio-pr-bot <[email protected]>

Small tweaks to improve the DX for the "tuples"/"messages" argument i…

633e75c

…n `gr.Chatbot` (#9358) * change format * format * add changeset * revert * revert --------- Co-authored-by: gradio-pr-bot <[email protected]>

Update babylon.js to v7 for gr.Model3D (#9377)

7a725c4

* update package.json * add changeset * add changeset * update pnpm lock * add changeset --------- Co-authored-by: gradio-pr-bot <[email protected]>

Fix gr.ImageEditor toolbar cutoff (#9371)

498996e

* fix wrap alignment * add changeset --------- Co-authored-by: gradio-pr-bot <[email protected]>

add lite upload (#9385)

deef3b7

fix sha (#9386)

f4b335c

Fix lite ci (#9387)

9d017ae

* fix sha * fix name * fix name

Add code

788f5cb

feedback

3b9019b

merge latest

f69b7fe

link

5552aca

freddyaboulton force-pushed the object-detection-guide branch from 56cefde to 5552aca Compare September 18, 2024 23:14

gradio-pr-bot and others added 3 commits September 18, 2024 23:15

add changeset

96fc032

code

a7fc03d

check

43fe4df

abidlabs reviewed Sep 19, 2024

View reviewed changes

guides/04_additional-features/02_streaming-outputs.md Outdated Show resolved Hide resolved

Update guides/04_additional-features/02_streaming-outputs.md

e7ce4c5

abidlabs reviewed Sep 19, 2024

View reviewed changes

guides/07_streaming/02_object-detection-from-webcam.md Outdated Show resolved Hide resolved

Update guides/07_streaming/02_object-detection-from-webcam.md

0fd2b0d

abidlabs approved these changes Sep 19, 2024

View reviewed changes

Merge branch '5.0-dev' into object-detection-guide

dd97fb5

abidlabs merged commit 736046f into 5.0-dev Sep 19, 2024
20 checks passed

abidlabs deleted the object-detection-guide branch September 19, 2024 05:51

gradio-pr-bot mentioned this pull request Sep 19, 2024

chore: update versions (beta) #9263

Merged

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Object Detection From Webcam Stream Guide #9336

Object Detection From Webcam Stream Guide #9336

freddyaboulton commented Sep 12, 2024

gradio-pr-bot commented Sep 12, 2024 •

edited

Loading

gradio-pr-bot commented Sep 12, 2024 •

edited

Loading

Something isn't right?

abidlabs commented Sep 18, 2024

abidlabs commented Sep 18, 2024

freddyaboulton commented Sep 18, 2024

abidlabs commented Sep 18, 2024

freddyaboulton commented Sep 18, 2024

abidlabs left a comment

freddyaboulton commented Sep 19, 2024

Object Detection From Webcam Stream Guide #9336

Object Detection From Webcam Stream Guide #9336

Conversation

freddyaboulton commented Sep 12, 2024

Description

🎯 PRs Should Target Issues

Tests

gradio-pr-bot commented Sep 12, 2024 • edited Loading

🪼 branch checks and previews

gradio-pr-bot commented Sep 12, 2024 • edited Loading

🦄 change detected

This Pull Request includes changes to the following packages.

With the following changelog entry.

Something isn't right?

abidlabs commented Sep 18, 2024

abidlabs commented Sep 18, 2024

freddyaboulton commented Sep 18, 2024

abidlabs commented Sep 18, 2024

freddyaboulton commented Sep 18, 2024

abidlabs left a comment

Choose a reason for hiding this comment

freddyaboulton commented Sep 19, 2024

gradio-pr-bot commented Sep 12, 2024 •

edited

Loading

gradio-pr-bot commented Sep 12, 2024 •

edited

Loading