Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Live vod archive not downloading #360

Closed
Aerglonus opened this issue Feb 1, 2024 · 14 comments
Closed

Live vod archive not downloading #360

Aerglonus opened this issue Feb 1, 2024 · 14 comments

Comments

@Aerglonus
Copy link

Aerglonus commented Feb 1, 2024 •
edited
Loading

Watched channel triggers (live archiving) correctly but it doesn't download anything and the video download task does not show any log info about downloading the stream or an error and it doesn't stop after channel goes offline, I need to manually remove the queue item because the trying to stop it from the "Stop queue item" button doesn't work since it throws "error getting pid".

When archiving a vod using url/id it shows the video download logs properly.

API container log:

2024-02-01 05:33:15 {"level":"info","time":"2024-02-01T04:33:15-06:00","message":"config file not found at /data/config.json, creating new one"}
2024-02-01 05:33:17 {"level":"info","time":"2024-02-01T04:33:17-06:00","message":"authenticated with twitch"}
2024-02-01 05:33:21 {"level":"info","time":"2024-02-01T04:33:21-06:00","message":"setting up check watched channel videos schedule"}
2024-02-01 05:33:21 {"level":"info","time":"2024-02-01T04:33:21-06:00","message":"running check watched channel videos schedule"}
2024-02-01 05:35:09 {"level":"info","time":"2024-02-01T04:35:09-06:00","message":"Manually starting task check_live"}
2024-02-01 05:33:12 usermod: no changes
2024-02-01 05:33:12 
2024-02-01 05:33:12 -------------------------------------
2024-02-01 05:33:12 User uid:    911
2024-02-01 05:33:12 User gid:    911
2024-02-01 05:33:12 -------------------------------------
2024-02-01 05:33:12 
2024-02-01 05:33:15 Version    : 
2024-02-01 05:33:15 Git Hash   : d2941111ae2d3f6c8dbd7572b1bfd958736fed46
2024-02-01 05:33:15 Build Time : 2023-09-10T18:34:51Z
2024-02-01 05:33:16 
2024-02-01 05:33:16    ____    __
2024-02-01 05:33:16   / __/___/ /  ___
2024-02-01 05:33:16  / _// __/ _ \/ _ \
2024-02-01 05:33:16 /___/\__/_//_/\___/ v4.11.1
2024-02-01 05:33:16 High performance, minimalist Go web framework
2024-02-01 05:33:16 https://echo.labstack.com
2024-02-01 05:33:16 ____________________________________O/_______
2024-02-01 05:33:16                                     O\
2024-02-01 05:33:16 ⇨ http server started on [::]:4000
2024-02-01 05:37:04 echo: http: panic serving 172.30.0.1:37742: interface conversion: interface {} is []config.ProxyListItem, not []interface {}
2024-02-01 05:37:04 goroutine 206 [running]:
2024-02-01 05:37:04 net/http.(*conn).serve.func1()
2024-02-01 05:37:04 /usr/local/go/src/net/http/server.go:1854 +0xbf
2024-02-01 05:37:04 panic({0x1120980, 0xc0007098c0})
2024-02-01 05:37:04 /usr/local/go/src/runtime/panic.go:890 +0x263
2024-02-01 05:37:04 github.com/zibbp/ganymede/internal/config.(*Service).GetConfig(0x0?, {0xc00057f670?, 0x40dbca?})
2024-02-01 05:37:04 /app/internal/config/config.go:156 +0x70d
2024-02-01 05:37:04 github.com/zibbp/ganymede/internal/transport/http.(*Handler).GetConfig(0x7fba4cc2d8c0?, {0x1cb9b08, 0xc000643c50})
2024-02-01 05:37:04 /app/internal/transport/http/config.go:71 +0x36
2024-02-01 05:37:04 github.com/zibbp/ganymede/internal/auth.UserRoleMiddleware.func1.1({0x1cb9b08?, 0xc000643c50?})
2024-02-01 05:37:04 /app/internal/auth/middleware.go:107 +0x17b
2024-02-01 05:37:04 github.com/zibbp/ganymede/internal/auth.GetUserMiddleware.func1({0x1cb9938, 0xc000a92c80})
2024-02-01 05:37:04 /app/internal/auth/middleware.go:78 +0x404
2024-02-01 05:37:04 github.com/zibbp/ganymede/internal/auth.GuardMiddleware.func1({0x1cb9938, 0xc000a92c80})
2024-02-01 05:37:04 /app/internal/auth/middleware.go:59 +0x4e3
2024-02-01 05:37:04 github.com/labstack/echo/v4.(*Echo).add.func1({0x1cb9938, 0xc000a92c80})
2024-02-01 05:37:04 /go/pkg/mod/github.com/labstack/echo/[email protected]/echo.go:582 +0x51
2024-02-01 05:37:04 github.com/labstack/echo/v4/middleware.CORSWithConfig.func1.1({0x1cb9938, 0xc000a92c80})
2024-02-01 05:37:04 /go/pkg/mod/github.com/labstack/echo/[email protected]/middleware/cors.go:264 +0x8b8
2024-02-01 05:37:04 github.com/labstack/echo/v4.(*Echo).ServeHTTP(0xc0004bc6c0, {0x1ca71c0?, 0xc000d116c0}, 0xc0003ad500)
2024-02-01 05:37:04 /go/pkg/mod/github.com/labstack/echo/[email protected]/echo.go:669 +0x3d1
2024-02-01 05:37:04 net/http.serverHandler.ServeHTTP({0xc000d7de00?}, {0x1ca71c0, 0xc000d116c0}, 0xc0003ad500)
2024-02-01 05:37:04 /usr/local/go/src/net/http/server.go:2936 +0x316
2024-02-01 05:37:04 net/http.(*conn).serve(0xc000614120, {0x1ca7d58, 0xc000021380})
2024-02-01 05:37:04 /usr/local/go/src/net/http/server.go:1995 +0x612
2024-02-01 05:37:04 created by net/http.(*Server).Serve
2024-02-01 05:37:04 /usr/local/go/src/net/http/server.go:3089 +0x5ed
2024-02-01 05:37:04 echo: http: panic serving 172.30.0.1:54364: interface conversion: interface {} is []config.ProxyListItem, not []interface {}
2024-02-01 05:37:04 goroutine 79 [running]:
2024-02-01 05:37:04 net/http.(*conn).serve.func1()
2024-02-01 05:37:04 /usr/local/go/src/net/http/server.go:1854 +0xbf
2024-02-01 05:37:04 panic({0x1120980, 0xc0005b0660})
2024-02-01 05:37:04 /usr/local/go/src/runtime/panic.go:890 +0x263
2024-02-01 05:37:04 github.com/zibbp/ganymede/internal/config.(*Service).GetConfig(0x0?, {0xc00010f670?, 0x40dbca?})
2024-02-01 05:37:04 /app/internal/config/config.go:156 +0x70d
2024-02-01 05:37:04 github.com/zibbp/ganymede/internal/transport/http.(*Handler).GetConfig(0x7fba4cdf2158?, {0x1cb9b08, 0xc000560c78})
2024-02-01 05:37:04 /app/internal/transport/http/config.go:71 +0x36
2024-02-01 05:37:04 github.com/zibbp/ganymede/internal/auth.UserRoleMiddleware.func1.1({0x1cb9b08?, 0xc000560c78?})
2024-02-01 05:37:04 /app/internal/auth/middleware.go:107 +0x17b
2024-02-01 05:40:55 {"level":"info","time":"2024-02-01T04:40:55-06:00","message":"Manually starting task check_live"}
2024-02-01 05:37:04 github.com/zibbp/ganymede/internal/auth.GetUserMiddleware.func1({0x1cb9938, 0xc000405b80})
2024-02-01 05:37:04 /app/internal/auth/middleware.go:78 +0x404
2024-02-01 05:37:04 github.com/zibbp/ganymede/internal/auth.GuardMiddleware.func1({0x1cb9938, 0xc000405b80})
2024-02-01 05:37:04 /app/internal/auth/middleware.go:59 +0x4e3
2024-02-01 05:37:04 github.com/labstack/echo/v4.(*Echo).add.func1({0x1cb9938, 0xc000405b80})
2024-02-01 05:37:04 /go/pkg/mod/github.com/labstack/echo/[email protected]/echo.go:582 +0x51
2024-02-01 05:37:04 github.com/labstack/echo/v4/middleware.CORSWithConfig.func1.1({0x1cb9938, 0xc000405b80})
2024-02-01 05:37:04 /go/pkg/mod/github.com/labstack/echo/[email protected]/middleware/cors.go:264 +0x8b8
2024-02-01 05:37:04 github.com/labstack/echo/v4.(*Echo).ServeHTTP(0xc0004bc6c0, {0x1ca71c0?, 0xc0004d0c40}, 0xc0004c0b00)
2024-02-01 05:37:04 /go/pkg/mod/github.com/labstack/echo/[email protected]/echo.go:669 +0x3d1
2024-02-01 05:37:04 net/http.serverHandler.ServeHTTP({0xc000d7c990?}, {0x1ca71c0, 0xc0004d0c40}, 0xc0004c0b00)
2024-02-01 05:37:04 /usr/local/go/src/net/http/server.go:2936 +0x316
2024-02-01 05:37:04 net/http.(*conn).serve(0xc000546510, {0x1ca7d58, 0xc000021380})
2024-02-01 05:37:04 /usr/local/go/src/net/http/server.go:1995 +0x612
2024-02-01 05:37:04 created by net/http.(*Server).Serve
2024-02-01 05:37:04 /usr/local/go/src/net/http/server.go:3089 +0x5ed
2024-02-01 05:37:04 echo: http: panic serving 172.30.0.1:35124: interface conversion: interface {} is []config.ProxyListItem, not []interface {}
2024-02-01 05:37:04 goroutine 1110 [running]:
2024-02-01 05:37:04 net/http.(*conn).serve.func1()
2024-02-01 05:37:04 /usr/local/go/src/net/http/server.go:1854 +0xbf
2024-02-01 05:37:04 panic({0x1120980, 0xc00055d2f0})
2024-02-01 05:37:04 /usr/local/go/src/runtime/panic.go:890 +0x263
2024-02-01 05:37:04 github.com/zibbp/ganymede/internal/config.(*Service).GetConfig(0x0?, {0xc00010f670?, 0x40dbca?})
2024-02-01 05:37:04 /app/internal/config/config.go:156 +0x70d
2024-02-01 05:37:04 github.com/zibbp/ganymede/internal/transport/http.(*Handler).GetConfig(0x7fba4cb44618?, {0x1cb9b08, 0xc0007992c0})
2024-02-01 05:37:04 /app/internal/transport/http/config.go:71 +0x36
2024-02-01 05:37:04 github.com/zibbp/ganymede/internal/auth.UserRoleMiddleware.func1.1({0x1cb9b08?, 0xc0007992c0?})
2024-02-01 05:37:04 /app/internal/auth/middleware.go:107 +0x17b
2024-02-01 05:37:04 github.com/zibbp/ganymede/internal/auth.GetUserMiddleware.func1({0x1cb9938, 0xc00041e0a0})
2024-02-01 05:37:04 /app/internal/auth/middleware.go:78 +0x404
2024-02-01 05:37:04 github.com/zibbp/ganymede/internal/auth.GuardMiddleware.func1({0x1cb9938, 0xc00041e0a0})
2024-02-01 05:37:04 /app/internal/auth/middleware.go:59 +0x4e3
2024-02-01 05:37:04 github.com/labstack/echo/v4.(*Echo).add.func1({0x1cb9938, 0xc00041e0a0})
2024-02-01 05:37:04 /go/pkg/mod/github.com/labstack/echo/[email protected]/echo.go:582 +0x51
2024-02-01 05:37:04 github.com/labstack/echo/v4/middleware.CORSWithConfig.func1.1({0x1cb9938, 0xc00041e0a0})
2024-02-01 05:37:04 /go/pkg/mod/github.com/labstack/echo/[email protected]/middleware/cors.go:264 +0x8b8
2024-02-01 05:37:04 github.com/labstack/echo/v4.(*Echo).ServeHTTP(0xc0004bc6c0, {0x1ca71c0?, 0xc000b757a0}, 0xc000c61300)
2024-02-01 05:37:04 /go/pkg/mod/github.com/labstack/echo/[email protected]/echo.go:669 +0x3d1
2024-02-01 05:37:04 net/http.serverHandler.ServeHTTP({0xc0005b0720?}, {0x1ca71c0, 0xc000b757a0}, 0xc000c61300)
2024-02-01 05:37:04 /usr/local/go/src/net/http/server.go:2936 +0x316
2024-02-01 05:37:04 net/http.(*conn).serve(0xc00070e090, {0x1ca7d58, 0xc000021380})
2024-02-01 05:37:04 /usr/local/go/src/net/http/server.go:1995 +0x612
2024-02-01 05:37:04 created by net/http.(*Server).Serve
2024-02-01 05:37:04 /usr/local/go/src/net/http/server.go:3089 +0x5ed
2024-02-01 05:37:05 echo: http: panic serving 172.30.0.1:35134: interface conversion: interface {} is []config.ProxyListItem, not []interface {}
2024-02-01 05:37:05 goroutine 1209 [running]:
2024-02-01 05:37:05 net/http.(*conn).serve.func1()
2024-02-01 05:37:05 /usr/local/go/src/net/http/server.go:1854 +0xbf
2024-02-01 05:37:05 panic({0x1120980, 0xc0005b0b40})
2024-02-01 05:37:05 /usr/local/go/src/runtime/panic.go:890 +0x263
2024-02-01 05:37:05 github.com/zibbp/ganymede/internal/config.(*Service).GetConfig(0x0?, {0xc000149670?, 0x40dbca?})
2024-02-01 05:37:05 /app/internal/config/config.go:156 +0x70d
2024-02-01 05:37:05 github.com/zibbp/ganymede/internal/transport/http.(*Handler).GetConfig(0x7fba4cdf2158?, {0x1cb9b08, 0xc000560e40})
2024-02-01 05:37:05 /app/internal/transport/http/config.go:71 +0x36
2024-02-01 05:37:05 github.com/zibbp/ganymede/internal/auth.UserRoleMiddleware.func1.1({0x1cb9b08?, 0xc000560e40?})
2024-02-01 05:37:05 /app/internal/auth/middleware.go:107 +0x17b
2024-02-01 05:37:05 github.com/zibbp/ganymede/internal/auth.GetUserMiddleware.func1({0x1cb9938, 0xc000651680})
2024-02-01 05:37:05 /app/internal/auth/middleware.go:78 +0x404
2024-02-01 05:37:05 github.com/zibbp/ganymede/internal/auth.GuardMiddleware.func1({0x1cb9938, 0xc000651680})
2024-02-01 05:37:05 /app/internal/auth/middleware.go:59 +0x4e3
2024-02-01 05:37:05 github.com/labstack/echo/v4.(*Echo).add.func1({0x1cb9938, 0xc000651680})
2024-02-01 05:37:05 /go/pkg/mod/github.com/labstack/echo/[email protected]/echo.go:582 +0x51
2024-02-01 05:37:05 github.com/labstack/echo/v4/middleware.CORSWithConfig.func1.1({0x1cb9938, 0xc000651680})
2024-02-01 05:37:05 /go/pkg/mod/github.com/labstack/echo/[email protected]/middleware/cors.go:264 +0x8b8
2024-02-01 05:37:05 github.com/labstack/echo/v4.(*Echo).ServeHTTP(0xc0004bc6c0, {0x1ca71c0?, 0xc0004d0d20}, 0xc0004c0c00)
2024-02-01 05:37:05 /go/pkg/mod/github.com/labstack/echo/[email protected]/echo.go:669 +0x3d1
2024-02-01 05:37:05 net/http.serverHandler.ServeHTTP({0xc000709c80?}, {0x1ca71c0, 0xc0004d0d20}, 0xc0004c0c00)
2024-02-01 05:37:05 /usr/local/go/src/net/http/server.go:2936 +0x316
2024-02-01 05:37:05 net/http.(*conn).serve(0xc0006578c0, {0x1ca7d58, 0xc000021380})
2024-02-01 05:37:05 /usr/local/go/src/net/http/server.go:1995 +0x612
2024-02-01 05:37:05 created by net/http.(*Server).Serve
2024-02-01 05:37:05 /usr/local/go/src/net/http/server.go:3089 +0x5ed
2024-02-01 05:37:07 echo: http: panic serving 172.30.0.1:35144: interface conversion: interface {} is []config.ProxyListItem, not []interface {}
2024-02-01 05:37:07 goroutine 1114 [running]:
2024-02-01 05:37:07 net/http.(*conn).serve.func1()
2024-02-01 05:37:07 /usr/local/go/src/net/http/server.go:1854 +0xbf
2024-02-01 05:37:07 panic({0x1120980, 0xc00055d3e0})
2024-02-01 05:37:07 /usr/local/go/src/runtime/panic.go:890 +0x263
2024-02-01 05:37:07 github.com/zibbp/ganymede/internal/config.(*Service).GetConfig(0x0?, {0xc000083670?, 0x40dbca?})
2024-02-01 05:37:07 /app/internal/config/config.go:156 +0x70d
2024-02-01 05:37:07 github.com/zibbp/ganymede/internal/transport/http.(*Handler).GetConfig(0x7fba4cb44618?, {0x1cb9b08, 0xc0007993c8})
2024-02-01 05:37:07 /app/internal/transport/http/config.go:71 +0x36
2024-02-01 05:37:07 github.com/zibbp/ganymede/internal/auth.UserRoleMiddleware.func1.1({0x1cb9b08?, 0xc0007993c8?})
2024-02-01 05:37:07 /app/internal/auth/middleware.go:107 +0x17b
2024-02-01 05:37:07 github.com/zibbp/ganymede/internal/auth.GetUserMiddleware.func1({0x1cb9938, 0xc000651860})
2024-02-01 05:37:07 /app/internal/auth/middleware.go:78 +0x404
2024-02-01 05:37:07 github.com/zibbp/ganymede/internal/auth.GuardMiddleware.func1({0x1cb9938, 0xc000651860})
2024-02-01 05:37:07 /app/internal/auth/middleware.go:59 +0x4e3
2024-02-01 05:37:07 github.com/labstack/echo/v4.(*Echo).add.func1({0x1cb9938, 0xc000651860})
2024-02-01 05:37:07 /go/pkg/mod/github.com/labstack/echo/[email protected]/echo.go:582 +0x51
2024-02-01 05:37:07 github.com/labstack/echo/v4/middleware.CORSWithConfig.func1.1({0x1cb9938, 0xc000651860})
2024-02-01 05:37:07 /go/pkg/mod/github.com/labstack/echo/[email protected]/middleware/cors.go:264 +0x8b8
2024-02-01 05:37:07 github.com/labstack/echo/v4.(*Echo).ServeHTTP(0xc0004bc6c0, {0x1ca71c0?, 0xc0004d0e00}, 0xc000c61400)
2024-02-01 05:37:07 /go/pkg/mod/github.com/labstack/echo/[email protected]/echo.go:669 +0x3d1
2024-02-01 05:37:07 net/http.serverHandler.ServeHTTP({0xc0005b0c00?}, {0x1ca71c0, 0xc0004d0e00}, 0xc000c61400)
2024-02-01 05:37:07 /usr/local/go/src/net/http/server.go:2936 +0x316
2024-02-01 05:37:07 net/http.(*conn).serve(0xc00070e7e0, {0x1ca7d58, 0xc000021380})
2024-02-01 05:37:07 /usr/local/go/src/net/http/server.go:1995 +0x612
2024-02-01 05:37:07 created by net/http.(*Server).Serve
2024-02-01 05:37:07 /usr/local/go/src/net/http/server.go:3089 +0x5ed
2024-02-01 05:37:11 echo: http: panic serving 172.30.0.1:36216: interface conversion: interface {} is []config.ProxyListItem, not []interface {}
2024-02-01 05:37:11 goroutine 1181 [running]:
2024-02-01 05:37:11 net/http.(*conn).serve.func1()
2024-02-01 05:37:11 /usr/local/go/src/net/http/server.go:1854 +0xbf
2024-02-01 05:37:11 panic({0x1120980, 0xc0005b1050})
2024-02-01 05:37:11 /usr/local/go/src/runtime/panic.go:890 +0x263
2024-02-01 05:37:11 github.com/zibbp/ganymede/internal/config.(*Service).GetConfig(0x0?, {0xc000149670?, 0x40dbca?})
2024-02-01 05:37:11 /app/internal/config/config.go:156 +0x70d
2024-02-01 05:37:11 github.com/zibbp/ganymede/internal/transport/http.(*Handler).GetConfig(0x7fba4cdf2158?, {0x1cb9b08, 0xc000561008})
2024-02-01 05:37:11 /app/internal/transport/http/config.go:71 +0x36
2024-02-01 05:37:11 github.com/zibbp/ganymede/internal/auth.UserRoleMiddleware.func1.1({0x1cb9b08?, 0xc000561008?})
2024-02-01 05:37:11 /app/internal/auth/middleware.go:107 +0x17b
2024-02-01 05:37:11 github.com/zibbp/ganymede/internal/auth.GetUserMiddleware.func1({0x1cb9938, 0xc000a92be0})
2024-02-01 05:37:11 /app/internal/auth/middleware.go:78 +0x404
2024-02-01 05:37:11 github.com/zibbp/ganymede/internal/auth.GuardMiddleware.func1({0x1cb9938, 0xc000a92be0})
2024-02-01 05:37:11 /app/internal/auth/middleware.go:59 +0x4e3
2024-02-01 05:37:11 github.com/labstack/echo/v4.(*Echo).add.func1({0x1cb9938, 0xc000a92be0})
2024-02-01 05:37:11 /go/pkg/mod/github.com/labstack/echo/[email protected]/echo.go:582 +0x51
2024-02-01 05:37:11 github.com/labstack/echo/v4/middleware.CORSWithConfig.func1.1({0x1cb9938, 0xc000a92be0})
2024-02-01 05:37:11 /go/pkg/mod/github.com/labstack/echo/[email protected]/middleware/cors.go:264 +0x8b8
2024-02-01 05:37:11 github.com/labstack/echo/v4.(*Echo).ServeHTTP(0xc0004bc6c0, {0x1ca71c0?, 0xc000b75880}, 0xc0003ad800)
2024-02-01 05:37:11 /go/pkg/mod/github.com/labstack/echo/[email protected]/echo.go:669 +0x3d1
2024-02-01 05:37:11 net/http.serverHandler.ServeHTTP({0xc00055d500?}, {0x1ca71c0, 0xc000b75880}, 0xc0003ad800)
2024-02-01 05:37:11 /usr/local/go/src/net/http/server.go:2936 +0x316
2024-02-01 05:37:11 net/http.(*conn).serve(0xc0007a0ea0, {0x1ca7d58, 0xc000021380})
2024-02-01 05:37:11 /usr/local/go/src/net/http/server.go:1995 +0x612
2024-02-01 05:37:11 created by net/http.(*Server).Serve
2024-02-01 05:37:11 /usr/local/go/src/net/http/server.go:3089 +0x5ed
2024-02-01 05:38:04 echo: http: panic serving 172.30.0.1:43304: interface conversion: interface {} is []config.ProxyListItem, not []interface {}
2024-02-01 05:38:04 goroutine 1118 [running]:
2024-02-01 05:38:04 net/http.(*conn).serve.func1()
2024-02-01 05:38:04 /usr/local/go/src/net/http/server.go:1854 +0xbf
2024-02-01 05:38:04 panic({0x1120980, 0xc00055d980})
2024-02-01 05:38:04 /usr/local/go/src/runtime/panic.go:890 +0x263
2024-02-01 05:38:04 github.com/zibbp/ganymede/internal/config.(*Service).GetConfig(0x0?, {0xc000083670?, 0x40dbca?})
2024-02-01 05:38:04 /app/internal/config/config.go:156 +0x70d
2024-02-01 05:38:04 github.com/zibbp/ganymede/internal/transport/http.(*Handler).GetConfig(0x7fba4cb44618?, {0x1cb9b08, 0xc000799590})
2024-02-01 05:38:04 /app/internal/transport/http/config.go:71 +0x36
2024-02-01 05:38:04 github.com/zibbp/ganymede/internal/auth.UserRoleMiddleware.func1.1({0x1cb9b08?, 0xc000799590?})
2024-02-01 05:38:04 /app/internal/auth/middleware.go:107 +0x17b
2024-02-01 05:38:04 github.com/zibbp/ganymede/internal/auth.GetUserMiddleware.func1({0x1cb9938, 0xc0006fab40})
2024-02-01 05:38:04 /app/internal/auth/middleware.go:78 +0x404
2024-02-01 05:38:04 github.com/zibbp/ganymede/internal/auth.GuardMiddleware.func1({0x1cb9938, 0xc0006fab40})
2024-02-01 05:38:04 /app/internal/auth/middleware.go:59 +0x4e3
2024-02-01 05:38:04 github.com/labstack/echo/v4.(*Echo).add.func1({0x1cb9938, 0xc0006fab40})
2024-02-01 05:38:04 /go/pkg/mod/github.com/labstack/echo/[email protected]/echo.go:582 +0x51
2024-02-01 05:38:04 github.com/labstack/echo/v4/middleware.CORSWithConfig.func1.1({0x1cb9938, 0xc0006fab40})
2024-02-01 05:38:04 /go/pkg/mod/github.com/labstack/echo/[email protected]/middleware/cors.go:264 +0x8b8
2024-02-01 05:38:04 github.com/labstack/echo/v4.(*Echo).ServeHTTP(0xc0004bc6c0, {0x1ca71c0?, 0xc000d11880}, 0xc0003ada00)
2024-02-01 05:38:04 /go/pkg/mod/github.com/labstack/echo/[email protected]/echo.go:669 +0x3d1
2024-02-01 05:38:04 net/http.serverHandler.ServeHTTP({0xc00055d560?}, {0x1ca71c0, 0xc000d11880}, 0xc0003ada00)
2024-02-01 05:38:04 /usr/local/go/src/net/http/server.go:2936 +0x316
2024-02-01 05:38:04 net/http.(*conn).serve(0xc00070ef30, {0x1ca7d58, 0xc000021380})
2024-02-01 05:38:04 /usr/local/go/src/net/http/server.go:1995 +0x612
2024-02-01 05:38:04 created by net/http.(*Server).Serve
2024-02-01 05:38:04 /usr/local/go/src/net/http/server.go:3089 +0x5ed
2024-02-01 05:55:10 {"level":"warn","time":"2024-02-01T04:55:10-06:00","message":"queue item not found while updating task vod download thumbnail for live stream 927c9e29-c0ed-11ee-ab13-0242ac1e0005"}
2024-02-01 05:59:53 {"level":"error","error":"exit status 1","time":"2024-02-01T04:59:53-06:00","message":"error getting pid for queue item: exit status 1"}

Video download tasks not showing any log:
alt text

Stop queue item button throwing error:

Note: This is a fresh install, since i started having this issue on another install that was working fine a couple of days ago, decided to run a fresh install with the most recent docker compose file to check if it was failing because of my setup.
@Zibbp
Copy link
Owner

Zibbp commented Feb 2, 2024 •
edited
Loading

Hi, I first see that you're running a very old version. If this is not intentional, please backup your currently deployment and update your images first. A big release got published not too long ago which includes a docker compose change. Please see the 2.0 release notes.

Second, can you post your livestream item from the config (data/config.json)?

This is what mine looks like and it works fine.

  "livestream": {
    "proxies": [
      {
        "header": "",
        "url": "https://eu.luminous.dev"
      },
      {
        "header": "x-donate-to:https://ttv.lol/donate",
        "url": "https://api.ttv.lol"
      }
    ],
    "proxy_enabled": true,
    "proxy_parameters": "%3Fplayer%3Dtwitchweb%26type%3Dany%26allow_source%3Dtrue%26allow_audio_only%3Dtrue%26allow_spectre%3Dfalse%26fast_bread%3Dtrue",
    "proxy_whitelist": [
      ""
    ]
  },

@Aerglonus
Copy link
Author

Here is the config (is default one) :

  "livestream": {
    "proxies": [
      {
        "header": "",
        "url": "https://eu.luminous.dev"
      },
      {
        "header": "x-donate-to:https://ttv.lol/donate",
        "url": "https://api.ttv.lol"
      }
    ],
    "proxy_enabled": false,
    "proxy_parameters": "%3Fplayer%3Dtwitchweb%26type%3Dany%26allow_source%3Dtrue%26allow_audio_only%3Dtrue%26allow_spectre%3Dfalse%26fast_bread%3Dtrue",
    "proxy_whitelist": [
      ""
    ]
  },

After updating the images the task not longer stays in a loop doing nothing now it instantly fails but it doesn't show why in the task log (still not showing any logs in task).

Here is the API container log:

2024-02-01 23:01:09 usermod: no changes
2024-02-01 23:01:09 
2024-02-01 23:01:09 -------------------------------------
2024-02-01 23:01:09 User uid:    911
2024-02-01 23:01:09 User gid:    911
2024-02-01 23:01:09 -------------------------------------
2024-02-01 23:01:09 
2024-02-01 23:01:12 Version    : 
2024-02-01 23:01:12 Git Hash   : 3bbd4a38f76ca055e1b82716ba41f7c32d998fc6
2024-02-01 23:01:12 Build Time : 2024-01-07T18:43:45Z
2024-02-01 23:01:12 2024/02/01 22:01:12 INFO  No logger configured for temporal client. Created default one.
2024-02-01 23:01:12 
2024-02-01 23:01:12    ____    __
2024-02-01 23:01:12   / __/___/ /  ___
2024-02-01 23:01:12  / _// __/ _ \/ _ \
2024-02-01 23:01:12 {"level":"info","time":"2024-02-01T22:01:12-06:00","message":"config file found at /data/config.json, loading"}
2024-02-01 23:01:12 {"level":"info","time":"2024-02-01T22:01:12-06:00","message":"config file loaded: /data/config.json"}
2024-02-01 23:01:12 {"level":"debug","time":"2024-02-01T22:01:12-06:00","message":"config file loaded: /data/config.json"}
2024-02-01 23:01:12 {"level":"info","time":"2024-02-01T22:01:12-06:00","message":"Connected to temporal at 192.168.1.65:7233"}
2024-02-01 23:01:12 {"level":"info","time":"2024-02-01T22:01:12-06:00","message":"authenticated with twitch"}
2024-02-01 23:01:17 {"level":"info","time":"2024-02-01T22:01:17-06:00","message":"Starting worker with config: {MAX_CHAT_DOWNLOAD_EXECUTIONS:5 MAX_CHAT_RENDER_EXECUTIONS:3 MAX_VIDEO_DOWNLOAD_EXECUTIONS:5 MAX_VIDEO_CONVERT_EXECUTIONS:3 TEMPORAL_URL:192.168.1.65:7233}"}
2024-02-01 23:01:17 {"level":"info","time":"2024-02-01T22:01:17-06:00","message":"config file found at /data/config.json, loading"}
2024-02-01 23:01:17 {"level":"info","time":"2024-02-01T22:01:17-06:00","message":"config file loaded: /data/config.json"}
2024-02-01 23:01:17 {"level":"debug","time":"2024-02-01T22:01:17-06:00","message":"config file loaded: /data/config.json"}
2024-02-01 23:01:17 {"level":"debug","time":"2024-02-01T22:01:17-06:00","message":"authenticating with twitch"}
2024-02-01 23:01:17 {"level":"info","time":"2024-02-01T22:01:17-06:00","message":"setting up check watched channel videos schedule"}
2024-02-01 23:01:17 {"level":"info","time":"2024-02-01T22:01:17-06:00","message":"running check watched channel videos schedule"}
2024-02-01 23:01:17 {"level":"info","time":"2024-02-01T22:01:17-06:00","message":"authenticated with twitch"}
2024-02-01 23:01:17 {"level":"debug","time":"2024-02-01T22:01:17-06:00","message":"setting up database connection"}
2024-02-01 23:01:12 /___/\__/_//_/\___/ v4.11.3
2024-02-01 23:01:12 High performance, minimalist Go web framework
2024-02-01 23:01:12 https://echo.labstack.com
2024-02-01 23:01:12 ____________________________________O/_______
2024-02-01 23:01:12                                     O\
2024-02-01 23:01:12 ⇨ http server started on [::]:4000
2024-02-01 23:01:17 {"level":"info","Namespace":"default","TaskQueue":"archive","WorkerID":"ca2c1658c383","time":"2024-02-01T22:01:17-06:00","message":"Started Worker"}
2024-02-01 23:01:17 {"level":"info","Namespace":"default","TaskQueue":"chat-download","WorkerID":"ca2c1658c383","time":"2024-02-01T22:01:17-06:00","message":"Started Worker"}
2024-02-01 23:01:17 {"level":"info","Namespace":"default","TaskQueue":"chat-render","WorkerID":"ca2c1658c383","time":"2024-02-01T22:01:17-06:00","message":"Started Worker"}
2024-02-01 23:01:17 {"level":"info","Namespace":"default","TaskQueue":"video-download","WorkerID":"ca2c1658c383","time":"2024-02-01T22:01:17-06:00","message":"Started Worker"}
2024-02-01 23:01:17 {"level":"info","Namespace":"default","TaskQueue":"video-convert","WorkerID":"ca2c1658c383","time":"2024-02-01T22:01:17-06:00","message":"Started Worker"}
2024-02-01 23:01:47 {"level":"debug","Attempt":1,"ChildWorkflowID":"2acb5d9c-e3bc-458e-8c51-400c59c8074b_5","Namespace":"default","RunID":"2acb5d9c-e3bc-458e-8c51-400c59c8074b","TaskQueue":"archive","WorkerID":"ca2c1658c383","WorkflowID":"c91d9efb-c17f-11ee-a7b2-0242ac1a0004","WorkflowType":"CreateDirectoryWorkflow","time":"2024-02-01T22:01:47-06:00","message":"ExecuteChildWorkflow"}
2024-02-01 23:01:47 {"level":"debug","ActivityID":"5","ActivityType":"CreateDirectory","Attempt":1,"Namespace":"default","RunID":"8ef387d5-80de-4c88-aacc-6559a78e8f54","TaskQueue":"archive","WorkerID":"ca2c1658c383","WorkflowID":"2acb5d9c-e3bc-458e-8c51-400c59c8074b_5","WorkflowType":"CreateDirectoryWorkflow","time":"2024-02-01T22:01:47-06:00","message":"ExecuteActivity"}
2024-02-01 23:01:47 {"level":"debug","time":"2024-02-01T22:01:47-06:00","message":"creating folder: hatsalsa/2024-02-02-50311295501-live-c91d9efb-c17f-11ee-a7b2-0242ac1a0004"}
2024-02-01 23:01:47 {"level":"debug","Attempt":1,"ChildWorkflowID":"2acb5d9c-e3bc-458e-8c51-400c59c8074b_14","Namespace":"default","RunID":"2acb5d9c-e3bc-458e-8c51-400c59c8074b","TaskQueue":"archive","WorkerID":"ca2c1658c383","WorkflowID":"c91d9efb-c17f-11ee-a7b2-0242ac1a0004","WorkflowType":"DownloadTwitchLiveThumbnailsWorkflow","time":"2024-02-01T22:01:47-06:00","message":"ExecuteChildWorkflow"}
2024-02-01 23:01:47 {"level":"debug","ActivityID":"5","ActivityType":"DownloadTwitchLiveThumbnails","Attempt":1,"Namespace":"default","RunID":"488a632a-bb8a-4493-8557-ddd2c9628f9b","TaskQueue":"archive","WorkerID":"ca2c1658c383","WorkflowID":"2acb5d9c-e3bc-458e-8c51-400c59c8074b_14","WorkflowType":"DownloadTwitchLiveThumbnailsWorkflow","time":"2024-02-01T22:01:47-06:00","message":"ExecuteActivity"}
2024-02-01 23:01:47 {"level":"debug","time":"2024-02-01T22:01:47-06:00","message":"getting live streams using the following query param: ?user_login=hatsalsa"}
2024-02-01 23:01:48 {"level":"debug","time":"2024-02-01T22:01:48-06:00","message":"downloading file: https://static-cdn.jtvnw.net/previews-ttv/live_user_hatsalsa-1920x1080.jpg"}
2024-02-01 23:01:48 {"level":"debug","time":"2024-02-01T22:01:48-06:00","message":"downloading file: https://static-cdn.jtvnw.net/previews-ttv/live_user_hatsalsa-640x360.jpg"}
2024-02-01 23:01:48 {"level":"debug","time":"2024-02-01T22:01:48-06:00","message":"checking if tasks are done for video 50311295501"}
2024-02-01 23:01:48 {"level":"debug","Attempt":1,"ChildWorkflowID":"2acb5d9c-e3bc-458e-8c51-400c59c8074b_23","Namespace":"default","RunID":"2acb5d9c-e3bc-458e-8c51-400c59c8074b","TaskQueue":"archive","WorkerID":"ca2c1658c383","WorkflowID":"c91d9efb-c17f-11ee-a7b2-0242ac1a0004","WorkflowType":"SaveTwitchLiveVideoInfoWorkflow","time":"2024-02-01T22:01:48-06:00","message":"ExecuteChildWorkflow"}
2024-02-01 23:01:48 {"level":"debug","ActivityID":"5","ActivityType":"SaveTwitchLiveVideoInfo","Attempt":1,"Namespace":"default","RunID":"910e479d-2304-4bf1-a935-bc49fb641617","TaskQueue":"archive","WorkerID":"ca2c1658c383","WorkflowID":"2acb5d9c-e3bc-458e-8c51-400c59c8074b_23","WorkflowType":"SaveTwitchLiveVideoInfoWorkflow","time":"2024-02-01T22:01:48-06:00","message":"ExecuteActivity"}
2024-02-01 23:01:48 {"level":"debug","time":"2024-02-01T22:01:48-06:00","message":"getting live streams using the following query param: ?user_login=hatsalsa"}
2024-02-01 23:01:48 {"level":"debug","time":"2024-02-01T22:01:48-06:00","message":"checking if tasks are done for video 50311295501"}
2024-02-01 23:01:48 {"level":"debug","Attempt":1,"ChildWorkflowID":"2acb5d9c-e3bc-458e-8c51-400c59c8074b_32","Namespace":"default","RunID":"2acb5d9c-e3bc-458e-8c51-400c59c8074b","TaskQueue":"archive","WorkerID":"ca2c1658c383","WorkflowID":"c91d9efb-c17f-11ee-a7b2-0242ac1a0004","WorkflowType":"ArchiveTwitchLiveVideoWorkflow","time":"2024-02-01T22:01:48-06:00","message":"ExecuteChildWorkflow"}
2024-02-01 23:01:48 {"level":"debug","Attempt":1,"ChildWorkflowID":"9e61900d-7ffa-4786-9120-be11db125265_5","Namespace":"default","RunID":"9e61900d-7ffa-4786-9120-be11db125265","TaskQueue":"archive","WorkerID":"ca2c1658c383","WorkflowID":"2acb5d9c-e3bc-458e-8c51-400c59c8074b_32","WorkflowType":"DownloadTwitchLiveVideoWorkflow","time":"2024-02-01T22:01:48-06:00","message":"ExecuteChildWorkflow"}
2024-02-01 23:01:49 {"level":"debug","ActivityID":"5","ActivityType":"DownloadTwitchLiveVideo","Attempt":1,"Namespace":"default","RunID":"b6ba40c2-27fa-4f2a-b5ed-238cbdca86c0","TaskQueue":"archive","WorkerID":"ca2c1658c383","WorkflowID":"9e61900d-7ffa-4786-9120-be11db125265_5","WorkflowType":"DownloadTwitchLiveVideoWorkflow","time":"2024-02-01T22:01:49-06:00","message":"ExecuteActivity"}
2024-02-01 23:01:49 {"level":"debug","time":"2024-02-01T22:01:49-06:00","message":"streamlink live args: [--progress=force --force https://twitch.tv/hatsalsa best,best --twitch-low-latency --twitch-disable-hosting -o /tmp/50311295501_c91d9efb-c17f-11ee-a7b2-0242ac1a0004-video.mp4]"}
2024-02-01 23:01:49 {"level":"debug","time":"2024-02-01T22:01:49-06:00","message":"running: streamlink --progress=force --force https://twitch.tv/hatsalsa best,best --twitch-low-latency --twitch-disable-hosting -o /tmp/50311295501_c91d9efb-c17f-11ee-a7b2-0242ac1a0004-video.mp4"}
2024-02-01 23:01:49 {"level":"debug","time":"2024-02-01T22:01:49-06:00","message":"notifying chat download that video download is about to start"}
2024-02-01 23:01:49 2024/02/01 22:01:49 INFO  No logger configured for temporal client. Created default one.
2024-02-01 23:01:49 {"level":"info","time":"2024-02-01T22:01:49-06:00","message":"Connected to temporal at 192.168.1.65:7233"}
2024-02-01 23:01:49 {"level":"error","ActivityType":"DownloadTwitchLiveVideo","Attempt":1,"Error":"error sending signal to workflow to start chat download: WorkflowId is not set on request.","Namespace":"default","RunID":"b6ba40c2-27fa-4f2a-b5ed-238cbdca86c0","TaskQueue":"archive","WorkerID":"ca2c1658c383","WorkflowID":"9e61900d-7ffa-4786-9120-be11db125265_5","time":"2024-02-01T22:01:49-06:00","message":"Activity error."}

Summary from workflow tab:
Web capture_1-2-2024_23654_192 168 1 65

@Zibbp
Copy link
Owner

Zibbp commented Feb 3, 2024

Can you try the :main image tag for the API image?

@Aerglonus
Copy link
Author

Using :main image on the API container the video download task for live archive still instantly fails

API container log:

2024-02-02 23:38:51 usermod: no changes
2024-02-02 23:38:51 
2024-02-02 23:38:51 -------------------------------------
2024-02-02 23:38:51 User uid:    911
2024-02-02 23:38:51 User gid:    911
2024-02-02 23:38:51 -------------------------------------
2024-02-02 23:38:51 
2024-02-02 23:38:54 Version    : 
2024-02-02 23:38:54 Git Hash   : 0efea717ca2b74040f1afab3406f228b2e0b3159
2024-02-02 23:38:54 Build Time : 2024-01-16T23:29:41Z
2024-02-02 23:38:54 2024/02/02 22:38:54 INFO  No logger configured for temporal client. Created default one.
2024-02-02 23:38:54 
2024-02-02 23:38:54    ____    __
2024-02-02 23:38:54   / __/___/ /  ___
2024-02-02 23:38:54  / _// __/ _ \/ _ \
2024-02-02 23:38:54 /___/\__/_//_/\___/ v4.11.3
2024-02-02 23:38:54 High performance, minimalist Go web framework
2024-02-02 23:38:54 https://echo.labstack.com
2024-02-02 23:38:54 ____________________________________O/_______
2024-02-02 23:38:54                                     O\
2024-02-02 23:38:54 ⇨ http server started on [::]:4000
2024-02-02 23:38:54 {"level":"info","time":"2024-02-02T22:38:54-06:00","message":"config file found at /data/config.json, loading"}
2024-02-02 23:38:54 {"level":"info","time":"2024-02-02T22:38:54-06:00","message":"config file loaded: /data/config.json"}
2024-02-02 23:38:54 {"level":"debug","time":"2024-02-02T22:38:54-06:00","message":"config file loaded: /data/config.json"}
2024-02-02 23:38:54 {"level":"info","time":"2024-02-02T22:38:54-06:00","message":"Connected to temporal at 192.168.1.65:7233"}
2024-02-02 23:38:55 {"level":"info","time":"2024-02-02T22:38:55-06:00","message":"authenticated with twitch"}
2024-02-02 23:38:59 {"level":"info","time":"2024-02-02T22:38:59-06:00","message":"Starting worker with config: {MAX_CHAT_DOWNLOAD_EXECUTIONS:5 MAX_CHAT_RENDER_EXECUTIONS:3 MAX_VIDEO_DOWNLOAD_EXECUTIONS:5 MAX_VIDEO_CONVERT_EXECUTIONS:3 TEMPORAL_URL:192.168.1.65:7233}"}
2024-02-02 23:38:59 {"level":"info","time":"2024-02-02T22:38:59-06:00","message":"config file found at /data/config.json, loading"}
2024-02-02 23:38:59 {"level":"info","time":"2024-02-02T22:38:59-06:00","message":"config file loaded: /data/config.json"}
2024-02-02 23:38:59 {"level":"debug","time":"2024-02-02T22:38:59-06:00","message":"config file loaded: /data/config.json"}
2024-02-02 23:38:59 {"level":"debug","time":"2024-02-02T22:38:59-06:00","message":"authenticating with twitch"}
2024-02-02 23:38:59 {"level":"info","time":"2024-02-02T22:38:59-06:00","message":"setting up check watched channel videos schedule"}
2024-02-02 23:38:59 {"level":"info","time":"2024-02-02T22:38:59-06:00","message":"running check watched channel videos schedule"}
2024-02-02 23:38:59 {"level":"info","time":"2024-02-02T22:38:59-06:00","message":"authenticated with twitch"}
2024-02-02 23:38:59 {"level":"debug","time":"2024-02-02T22:38:59-06:00","message":"setting up database connection"}
2024-02-02 23:41:09 {"level":"debug","time":"2024-02-02T22:41:09-06:00","message":"creating folder: hatsalsa/2024-02-03-43551667387-live-73900d03-c24e-11ee-9502-0242ac160005"}
2024-02-02 23:41:10 {"level":"debug","time":"2024-02-02T22:41:10-06:00","message":"getting live streams using the following query param: ?user_login=hatsalsa"}
2024-02-02 23:41:10 {"level":"debug","time":"2024-02-02T22:41:10-06:00","message":"downloading file: https://static-cdn.jtvnw.net/previews-ttv/live_user_hatsalsa-1920x1080.jpg"}
2024-02-02 23:41:11 {"level":"debug","time":"2024-02-02T22:41:11-06:00","message":"downloading file: https://static-cdn.jtvnw.net/previews-ttv/live_user_hatsalsa-640x360.jpg"}
2024-02-02 23:41:11 {"level":"debug","time":"2024-02-02T22:41:11-06:00","message":"checking if tasks are done for video 43551667387"}
2024-02-02 23:41:11 {"level":"debug","time":"2024-02-02T22:41:11-06:00","message":"getting live streams using the following query param: ?user_login=hatsalsa"}
2024-02-02 23:41:11 {"level":"debug","time":"2024-02-02T22:41:11-06:00","message":"checking if tasks are done for video 43551667387"}
2024-02-02 23:41:12 {"level":"debug","time":"2024-02-02T22:41:12-06:00","message":"starting heartbeat download-livevideo-43551667387"}
2024-02-02 23:41:12 {"level":"debug","time":"2024-02-02T22:41:12-06:00","message":"streamlink live args: [--progress=force --force https://twitch.tv/hatsalsa best,best --twitch-low-latency --twitch-disable-hosting -o /tmp/43551667387_73900d03-c24e-11ee-9502-0242ac160005-video.mp4]"}
2024-02-02 23:41:12 {"level":"debug","time":"2024-02-02T22:41:12-06:00","message":"running: streamlink --progress=force --force https://twitch.tv/hatsalsa best,best --twitch-low-latency --twitch-disable-hosting -o /tmp/43551667387_73900d03-c24e-11ee-9502-0242ac160005-video.mp4"}
2024-02-02 23:41:12 {"level":"debug","time":"2024-02-02T22:41:12-06:00","message":"notifying chat download that video download is about to start"}
2024-02-02 23:41:12 {"level":"info","time":"2024-02-02T22:41:12-06:00","message":"Connected to temporal at 192.168.1.65:7233"}
2024-02-02 23:41:12 {"level":"debug","time":"2024-02-02T22:41:12-06:00","message":"stopping heartbeat download-livevideo-43551667387"}
2024-02-02 23:38:59 {"level":"info","Namespace":"default","TaskQueue":"video-convert","WorkerID":"819b29ad2158","time":"2024-02-02T22:38:59-06:00","message":"Started Worker"}
2024-02-02 23:38:59 {"level":"info","Namespace":"default","TaskQueue":"archive","WorkerID":"819b29ad2158","time":"2024-02-02T22:38:59-06:00","message":"Started Worker"}
2024-02-02 23:38:59 {"level":"info","Namespace":"default","TaskQueue":"chat-download","WorkerID":"819b29ad2158","time":"2024-02-02T22:38:59-06:00","message":"Started Worker"}
2024-02-02 23:39:00 {"level":"info","Namespace":"default","TaskQueue":"chat-render","WorkerID":"819b29ad2158","time":"2024-02-02T22:39:00-06:00","message":"Started Worker"}
2024-02-02 23:39:00 {"level":"info","Namespace":"default","TaskQueue":"video-download","WorkerID":"819b29ad2158","time":"2024-02-02T22:39:00-06:00","message":"Started Worker"}
2024-02-02 23:41:09 {"level":"debug","Attempt":1,"ChildWorkflowID":"37c267d0-0812-4c3d-a3d6-abe47ff15d5d_5","Namespace":"default","RunID":"37c267d0-0812-4c3d-a3d6-abe47ff15d5d","TaskQueue":"archive","WorkerID":"819b29ad2158","WorkflowID":"73900d03-c24e-11ee-9502-0242ac160005","WorkflowType":"CreateDirectoryWorkflow","time":"2024-02-02T22:41:09-06:00","message":"ExecuteChildWorkflow"}
2024-02-02 23:41:09 {"level":"debug","ActivityID":"5","ActivityType":"CreateDirectory","Attempt":1,"Namespace":"default","RunID":"bc9e9d31-40b3-4596-9dc3-1de7a60ab2f7","TaskQueue":"archive","WorkerID":"819b29ad2158","WorkflowID":"37c267d0-0812-4c3d-a3d6-abe47ff15d5d_5","WorkflowType":"CreateDirectoryWorkflow","time":"2024-02-02T22:41:09-06:00","message":"ExecuteActivity"}
2024-02-02 23:41:10 {"level":"debug","Attempt":1,"ChildWorkflowID":"37c267d0-0812-4c3d-a3d6-abe47ff15d5d_14","Namespace":"default","RunID":"37c267d0-0812-4c3d-a3d6-abe47ff15d5d","TaskQueue":"archive","WorkerID":"819b29ad2158","WorkflowID":"73900d03-c24e-11ee-9502-0242ac160005","WorkflowType":"DownloadTwitchLiveThumbnailsWorkflow","time":"2024-02-02T22:41:10-06:00","message":"ExecuteChildWorkflow"}
2024-02-02 23:41:10 {"level":"debug","ActivityID":"5","ActivityType":"DownloadTwitchLiveThumbnails","Attempt":1,"Namespace":"default","RunID":"92a5a342-263b-41ae-a215-b6cbea69c655","TaskQueue":"archive","WorkerID":"819b29ad2158","WorkflowID":"37c267d0-0812-4c3d-a3d6-abe47ff15d5d_14","WorkflowType":"DownloadTwitchLiveThumbnailsWorkflow","time":"2024-02-02T22:41:10-06:00","message":"ExecuteActivity"}
2024-02-02 23:41:11 {"level":"debug","Attempt":1,"ChildWorkflowID":"37c267d0-0812-4c3d-a3d6-abe47ff15d5d_23","Namespace":"default","RunID":"37c267d0-0812-4c3d-a3d6-abe47ff15d5d","TaskQueue":"archive","WorkerID":"819b29ad2158","WorkflowID":"73900d03-c24e-11ee-9502-0242ac160005","WorkflowType":"SaveTwitchLiveVideoInfoWorkflow","time":"2024-02-02T22:41:11-06:00","message":"ExecuteChildWorkflow"}
2024-02-02 23:41:11 {"level":"debug","ActivityID":"5","ActivityType":"SaveTwitchLiveVideoInfo","Attempt":1,"Namespace":"default","RunID":"19d0a05f-e608-44d8-ba46-5ce3dd0d10e3","TaskQueue":"archive","WorkerID":"819b29ad2158","WorkflowID":"37c267d0-0812-4c3d-a3d6-abe47ff15d5d_23","WorkflowType":"SaveTwitchLiveVideoInfoWorkflow","time":"2024-02-02T22:41:11-06:00","message":"ExecuteActivity"}
2024-02-02 23:41:11 {"level":"debug","Attempt":1,"ChildWorkflowID":"37c267d0-0812-4c3d-a3d6-abe47ff15d5d_32","Namespace":"default","RunID":"37c267d0-0812-4c3d-a3d6-abe47ff15d5d","TaskQueue":"archive","WorkerID":"819b29ad2158","WorkflowID":"73900d03-c24e-11ee-9502-0242ac160005","WorkflowType":"ArchiveTwitchLiveVideoWorkflow","time":"2024-02-02T22:41:11-06:00","message":"ExecuteChildWorkflow"}
2024-02-02 23:41:11 {"level":"debug","Attempt":1,"ChildWorkflowID":"7423d297-ad90-4895-9ffd-77c567186fa2_5","Namespace":"default","RunID":"7423d297-ad90-4895-9ffd-77c567186fa2","TaskQueue":"archive","WorkerID":"819b29ad2158","WorkflowID":"37c267d0-0812-4c3d-a3d6-abe47ff15d5d_32","WorkflowType":"DownloadTwitchLiveVideoWorkflow","time":"2024-02-02T22:41:11-06:00","message":"ExecuteChildWorkflow"}
2024-02-02 23:41:12 {"level":"debug","ActivityID":"5","ActivityType":"DownloadTwitchLiveVideo","Attempt":1,"Namespace":"default","RunID":"466040c4-6ccd-4d19-9685-4ee2978bc1ce","TaskQueue":"archive","WorkerID":"819b29ad2158","WorkflowID":"7423d297-ad90-4895-9ffd-77c567186fa2_5","WorkflowType":"DownloadTwitchLiveVideoWorkflow","time":"2024-02-02T22:41:12-06:00","message":"ExecuteActivity"}
2024-02-02 23:41:12 2024/02/02 22:41:12 INFO  No logger configured for temporal client. Created default one.
2024-02-02 23:41:12 {"level":"error","ActivityType":"DownloadTwitchLiveVideo","Attempt":1,"Error":"error sending signal to workflow to start chat download: WorkflowId is not set on request.","Namespace":"default","RunID":"466040c4-6ccd-4d19-9685-4ee2978bc1ce","TaskQueue":"archive","WorkerID":"819b29ad2158","WorkflowID":"7423d297-ad90-4895-9ffd-77c567186fa2_5","time":"2024-02-02T22:41:12-06:00","message":"Activity error."}

workflow summary:
Web capture_2-2-2024_234214_192 168 1 65

@Zibbp
Copy link
Owner

Zibbp commented Feb 8, 2024

How/Where is Ganymede being run? X86 or ARM? Synology NAS, Linux VM? Any errors in the ganymede-temporal container when this happens?

@Aerglonus
Copy link
Author

The logs from above are running on Docker for windows through WSL

- Host: Windows 11
- Operating System: Ubuntu 22.04.3 LTS
- Kernel: Linux 5.15.123.1-microsoft-standard-WSL2
- Architecture: x86-64
- Distributor ID: Ubuntu
- Description:    Ubuntu 22.04.3 LTS
- Release:        22.04

Here is the current ganymede-temporal after the task fails:

2024-02-08 18:25:27 {"level":"info","ts":"2024-02-08T23:25:27.868Z","msg":"Use rpc address 127.0.0.1:7233 for cluster active.","component":"metadata-initializer","logging-call-at":"fx.go:736"}
2024-02-08 18:25:27 {"level":"info","ts":"2024-02-08T23:25:27.880Z","msg":"historyClient: ownership caching disabled","service":"history","logging-call-at":"client.go:82"}
2024-02-08 18:25:27 {"level":"info","ts":"2024-02-08T23:25:27.890Z","msg":"Created gRPC listener","service":"history","address":"127.0.0.1:40751","logging-call-at":"rpc.go:152"}
2024-02-08 18:25:27 {"level":"info","ts":"2024-02-08T23:25:27.897Z","msg":"Created gRPC listener","service":"matching","address":"127.0.0.1:43721","logging-call-at":"rpc.go:152"}
2024-02-08 18:25:27 {"level":"info","ts":"2024-02-08T23:25:27.897Z","msg":"historyClient: ownership caching disabled","service":"matching","logging-call-at":"client.go:82"}
2024-02-08 18:25:27 {"level":"info","ts":"2024-02-08T23:25:27.907Z","msg":"historyClient: ownership caching disabled","service":"frontend","logging-call-at":"client.go:82"}
2024-02-08 18:25:27 {"level":"info","ts":"2024-02-08T23:25:27.908Z","msg":"Created gRPC listener","service":"frontend","address":"0.0.0.0:7233","logging-call-at":"rpc.go:152"}
2024-02-08 18:25:27 {"level":"info","ts":"2024-02-08T23:25:27.908Z","msg":"Service is not requested, skipping initialization.","service":"internal-frontend","logging-call-at":"fx.go:477"}
2024-02-08 18:25:27 {"level":"info","ts":"2024-02-08T23:25:27.918Z","msg":"historyClient: ownership caching disabled","service":"worker","logging-call-at":"client.go:82"}
2024-02-08 18:25:27 Starting UI server...
2024-02-08 18:25:27 
2024-02-08 18:25:27    ____    __
2024-02-08 18:25:27   / __/___/ /  ___
2024-02-08 18:25:27  / _// __/ _ \/ _ \
2024-02-08 18:25:27 /___/\__/_//_/\___/ v4.9.0
2024-02-08 18:25:27 High performance, minimalist Go web framework
2024-02-08 18:25:27 https://echo.labstack.com
2024-02-08 18:25:27 ____________________________________O/_______
2024-02-08 18:25:27                                     O\
2024-02-08 18:25:27 ⇨ http server started on [::]:8233
2024-02-08 18:25:27 {"level":"info","ts":"2024-02-08T23:25:27.919Z","msg":"Starting server for services","value":{"frontend":{},"history":{},"matching":{},"worker":{}},"logging-call-at":"server_impl.go:94"}
2024-02-08 18:25:27 {"level":"info","ts":"2024-02-08T23:25:27.919Z","msg":"PProf listen on ","port":46655,"logging-call-at":"pprof.go:73"}
2024-02-08 18:25:27 {"level":"info","ts":"2024-02-08T23:25:27.922Z","msg":"fifo scheduler started","service":"history","component":"memory-scheduled-queue-processor","logging-call-at":"fifo_scheduler.go:96"}
2024-02-08 18:25:27 {"level":"info","ts":"2024-02-08T23:25:27.923Z","msg":"fifo scheduler started","service":"history","logging-call-at":"fifo_scheduler.go:96"}
2024-02-08 18:25:27 {"level":"info","ts":"2024-02-08T23:25:27.923Z","msg":"interleaved weighted round robin task scheduler started","service":"history","logging-call-at":"interleaved_weighted_round_robin.go:197"}
2024-02-08 18:25:27 {"level":"info","ts":"2024-02-08T23:25:27.925Z","msg":"RuntimeMetricsReporter started","service":"frontend","logging-call-at":"runtime.go:138"}
2024-02-08 18:25:27 {"level":"info","ts":"2024-02-08T23:25:27.925Z","msg":"frontend starting","service":"frontend","logging-call-at":"service.go:336"}
2024-02-08 18:25:27 {"level":"info","ts":"2024-02-08T23:25:27.925Z","msg":"RuntimeMetricsReporter started","service":"worker","logging-call-at":"runtime.go:138"}
2024-02-08 18:25:27 {"level":"info","ts":"2024-02-08T23:25:27.926Z","msg":"worker starting","service":"worker","component":"worker","logging-call-at":"service.go:379"}
2024-02-08 18:25:27 {"level":"info","ts":"2024-02-08T23:25:27.926Z","msg":"Starting to serve on frontend listener","service":"frontend","logging-call-at":"service.go:355"}
2024-02-08 18:25:27 {"level":"info","ts":"2024-02-08T23:25:27.928Z","msg":"fifo scheduler started","service":"history","logging-call-at":"fifo_scheduler.go:96"}
2024-02-08 18:25:27 {"level":"info","ts":"2024-02-08T23:25:27.928Z","msg":"interleaved weighted round robin task scheduler started","service":"history","logging-call-at":"interleaved_weighted_round_robin.go:197"}
2024-02-08 18:25:27 {"level":"info","ts":"2024-02-08T23:25:27.928Z","msg":"RuntimeMetricsReporter started","service":"matching","logging-call-at":"runtime.go:138"}
2024-02-08 18:25:27 {"level":"info","ts":"2024-02-08T23:25:27.929Z","msg":"matching starting","service":"matching","logging-call-at":"service.go:91"}
2024-02-08 18:25:27 {"level":"info","ts":"2024-02-08T23:25:27.929Z","msg":"Starting to serve on matching listener","service":"matching","logging-call-at":"service.go:104"}
2024-02-08 18:25:27 {"level":"info","ts":"2024-02-08T23:25:27.931Z","msg":"fifo scheduler started","service":"history","logging-call-at":"fifo_scheduler.go:96"}
2024-02-08 18:25:27 {"level":"info","ts":"2024-02-08T23:25:27.932Z","msg":"interleaved weighted round robin task scheduler started","service":"history","logging-call-at":"interleaved_weighted_round_robin.go:197"}
2024-02-08 18:25:27 {"level":"info","ts":"2024-02-08T23:25:27.939Z","msg":"Membership heartbeat upserted successfully","address":"127.0.0.1","port":45629,"hostId":"57d864c6-c6d9-11ee-8f85-0242ac180006","logging-call-at":"monitor.go:256"}
2024-02-08 18:25:27 {"level":"info","ts":"2024-02-08T23:25:27.948Z","msg":"Membership heartbeat upserted successfully","address":"127.0.0.1","port":38891,"hostId":"57da16db-c6d9-11ee-8f85-0242ac180006","logging-call-at":"monitor.go:256"}
2024-02-08 18:25:27 {"level":"info","ts":"2024-02-08T23:25:27.956Z","msg":"RuntimeMetricsReporter started","service":"history","logging-call-at":"runtime.go:138"}
2024-02-08 18:25:27 {"level":"info","ts":"2024-02-08T23:25:27.957Z","msg":"history starting","service":"history","logging-call-at":"service.go:91"}
2024-02-08 18:25:27 {"level":"info","ts":"2024-02-08T23:25:27.957Z","msg":"Replication task fetchers started.","logging-call-at":"task_fetcher.go:142"}
2024-02-08 18:25:27 {"level":"info","ts":"2024-02-08T23:25:27.957Z","msg":"none","component":"shard-controller","address":"127.0.0.1:40751","lifecycle":"Started","logging-call-at":"controller_impl.go:136"}
2024-02-08 18:25:27 {"level":"info","ts":"2024-02-08T23:25:27.957Z","msg":"Starting to serve on history listener","service":"history","logging-call-at":"service.go:103"}
2024-02-08 18:25:27 {"level":"info","ts":"2024-02-08T23:25:27.957Z","msg":"bootstrap hosts fetched","bootstrap-hostports":"127.0.0.1:45629,127.0.0.1:38891","logging-call-at":"monitor.go:298"}
2024-02-08 18:25:27 {"level":"info","ts":"2024-02-08T23:25:27.957Z","msg":"bootstrap hosts fetched","bootstrap-hostports":"127.0.0.1:45629,127.0.0.1:38891","logging-call-at":"monitor.go:298"}
2024-02-08 18:25:27 {"level":"info","ts":"2024-02-08T23:25:27.957Z","msg":"sequential scheduler started","logging-call-at":"sequential_scheduler.go:96"}
2024-02-08 18:25:27 {"level":"info","ts":"2024-02-08T23:25:27.961Z","msg":"Current reachable members","component":"service-resolver","service":"frontend","addresses":["127.0.0.1:7233"],"logging-call-at":"service_resolver.go:279"}
2024-02-08 18:25:27 {"level":"info","ts":"2024-02-08T23:25:27.962Z","msg":"Frontend is now healthy","service":"frontend","logging-call-at":"workflow_handler.go:218"}
2024-02-08 18:25:27 {"level":"info","ts":"2024-02-08T23:25:27.962Z","msg":"Current reachable members","component":"service-resolver","service":"worker","addresses":["127.0.0.1:43701"],"logging-call-at":"service_resolver.go:279"}
2024-02-08 18:25:27 {"level":"info","ts":"2024-02-08T23:25:27.968Z","msg":"Membership heartbeat upserted successfully","address":"127.0.0.1","port":43775,"hostId":"57d6fa29-c6d9-11ee-8f85-0242ac180006","logging-call-at":"monitor.go:256"}
2024-02-08 18:25:27 {"level":"info","ts":"2024-02-08T23:25:27.974Z","msg":"Membership heartbeat upserted successfully","address":"127.0.0.1","port":35173,"hostId":"57d42fb4-c6d9-11ee-8f85-0242ac180006","logging-call-at":"monitor.go:256"}
2024-02-08 18:25:27 {"level":"info","ts":"2024-02-08T23:25:27.974Z","msg":"bootstrap hosts fetched","bootstrap-hostports":"127.0.0.1:38891,127.0.0.1:35173,127.0.0.1:43775,127.0.0.1:45629","logging-call-at":"monitor.go:298"}
2024-02-08 18:25:27 {"level":"info","ts":"2024-02-08T23:25:27.981Z","msg":"Current reachable members","component":"service-resolver","service":"frontend","addresses":["127.0.0.1:7233"],"logging-call-at":"service_resolver.go:279"}
2024-02-08 18:25:27 {"level":"info","ts":"2024-02-08T23:25:27.981Z","msg":"Current reachable members","component":"service-resolver","service":"matching","addresses":["127.0.0.1:43721"],"logging-call-at":"service_resolver.go:279"}
2024-02-08 18:25:27 {"level":"info","ts":"2024-02-08T23:25:27.981Z","msg":"Current reachable members","component":"service-resolver","service":"worker","addresses":["127.0.0.1:43701"],"logging-call-at":"service_resolver.go:279"}
2024-02-08 18:25:27 {"level":"info","ts":"2024-02-08T23:25:27.982Z","msg":"Current reachable members","component":"service-resolver","service":"frontend","addresses":["127.0.0.1:7233"],"logging-call-at":"service_resolver.go:279"}
2024-02-08 18:25:27 {"level":"info","ts":"2024-02-08T23:25:27.982Z","msg":"Current reachable members","component":"service-resolver","service":"matching","addresses":["127.0.0.1:43721"],"logging-call-at":"service_resolver.go:279"}
2024-02-08 18:25:27 {"level":"info","ts":"2024-02-08T23:25:27.984Z","msg":"bootstrap hosts fetched","bootstrap-hostports":"127.0.0.1:38891,127.0.0.1:35173,127.0.0.1:43775,127.0.0.1:45629","logging-call-at":"monitor.go:298"}
2024-02-08 18:25:27 {"level":"info","ts":"2024-02-08T23:25:27.987Z","msg":"Current reachable members","component":"service-resolver","service":"history","addresses":["127.0.0.1:40751"],"logging-call-at":"service_resolver.go:279"}
2024-02-08 18:25:27 {"level":"info","ts":"2024-02-08T23:25:27.987Z","msg":"none","component":"shard-controller","address":"127.0.0.1:40751","component":"shard-controller","address":"127.0.0.1:40751","shard-update":"RingMembershipChangedEvent","number-processed":1,"number-deleted":0,"logging-call-at":"ownership.go:116"}
2024-02-08 18:25:27 {"level":"info","ts":"2024-02-08T23:25:27.987Z","msg":"Current reachable members","component":"service-resolver","service":"matching","addresses":["127.0.0.1:43721"],"logging-call-at":"service_resolver.go:279"}
2024-02-08 18:25:27 {"level":"info","ts":"2024-02-08T23:25:27.988Z","msg":"none","shard-id":1,"address":"127.0.0.1:40751","lifecycle":"Started","component":"shard-context","logging-call-at":"context_impl.go:1482"}
2024-02-08 18:25:27 {"level":"info","ts":"2024-02-08T23:25:27.988Z","msg":"none","component":"shard-controller","address":"127.0.0.1:40751","numShards":1,"logging-call-at":"controller_impl.go:286"}
2024-02-08 18:25:27 {"level":"info","ts":"2024-02-08T23:25:27.988Z","msg":"Current reachable members","component":"service-resolver","service":"worker","addresses":["127.0.0.1:43701"],"logging-call-at":"service_resolver.go:279"}
2024-02-08 18:25:27 {"level":"info","ts":"2024-02-08T23:25:27.988Z","msg":"Current reachable members","component":"service-resolver","service":"worker","addresses":["127.0.0.1:43701"],"logging-call-at":"service_resolver.go:279"}
2024-02-08 18:25:27 {"level":"info","ts":"2024-02-08T23:25:27.988Z","msg":"Current reachable members","component":"service-resolver","service":"history","addresses":["127.0.0.1:40751"],"logging-call-at":"service_resolver.go:279"}
2024-02-08 18:25:27 {"level":"info","ts":"2024-02-08T23:25:27.989Z","msg":"Current reachable members","component":"service-resolver","service":"frontend","addresses":["127.0.0.1:7233"],"logging-call-at":"service_resolver.go:279"}
2024-02-08 18:25:28 {"level":"info","ts":"2024-02-08T23:25:28.013Z","msg":"Range updated for shardID","shard-id":1,"address":"127.0.0.1:40751","shard-range-id":9,"previous-shard-range-id":8,"number":0,"next-number":0,"logging-call-at":"context_impl.go:1147"}
2024-02-08 18:25:28 {"level":"info","ts":"2024-02-08T23:25:28.013Z","msg":"Acquired shard","shard-id":1,"address":"127.0.0.1:40751","logging-call-at":"context_impl.go:1839"}
2024-02-08 18:25:28 {"level":"info","ts":"2024-02-08T23:25:28.013Z","msg":"none","shard-id":1,"address":"127.0.0.1:40751","lifecycle":"Starting","component":"shard-engine","logging-call-at":"context_impl.go:1358"}
2024-02-08 18:25:28 {"level":"info","ts":"2024-02-08T23:25:28.013Z","msg":"none","shard-id":1,"address":"127.0.0.1:40751","component":"history-engine","lifecycle":"Starting","logging-call-at":"history_engine.go:286"}
2024-02-08 18:25:28 {"level":"info","ts":"2024-02-08T23:25:28.013Z","msg":"none","shard-id":1,"address":"127.0.0.1:40751","component":"timer-queue-processor","lifecycle":"Starting","logging-call-at":"queue_scheduled.go:154"}
2024-02-08 18:25:28 {"level":"info","ts":"2024-02-08T23:25:28.013Z","msg":"Task rescheduler started.","shard-id":1,"address":"127.0.0.1:40751","component":"timer-queue-processor","lifecycle":"Started","logging-call-at":"rescheduler.go:124"}
2024-02-08 18:25:28 {"level":"info","ts":"2024-02-08T23:25:28.014Z","msg":"none","shard-id":1,"address":"127.0.0.1:40751","component":"timer-queue-processor","lifecycle":"Started","logging-call-at":"queue_scheduled.go:163"}
2024-02-08 18:25:28 {"level":"info","ts":"2024-02-08T23:25:28.014Z","msg":"none","shard-id":1,"address":"127.0.0.1:40751","component":"transfer-queue-processor","lifecycle":"Starting","logging-call-at":"queue_immediate.go:114"}
2024-02-08 18:25:28 {"level":"info","ts":"2024-02-08T23:25:28.014Z","msg":"Task rescheduler started.","shard-id":1,"address":"127.0.0.1:40751","component":"transfer-queue-processor","lifecycle":"Started","logging-call-at":"rescheduler.go:124"}
2024-02-08 18:25:28 {"level":"info","ts":"2024-02-08T23:25:28.014Z","msg":"none","shard-id":1,"address":"127.0.0.1:40751","component":"transfer-queue-processor","lifecycle":"Started","logging-call-at":"queue_immediate.go:123"}
2024-02-08 18:25:28 {"level":"info","ts":"2024-02-08T23:25:28.014Z","msg":"none","shard-id":1,"address":"127.0.0.1:40751","component":"visibility-queue-processor","lifecycle":"Starting","logging-call-at":"queue_immediate.go:114"}
2024-02-08 18:25:28 {"level":"info","ts":"2024-02-08T23:25:28.014Z","msg":"Task rescheduler started.","shard-id":1,"address":"127.0.0.1:40751","component":"visibility-queue-processor","lifecycle":"Started","logging-call-at":"rescheduler.go:124"}
2024-02-08 18:25:28 {"level":"info","ts":"2024-02-08T23:25:28.014Z","msg":"none","shard-id":1,"address":"127.0.0.1:40751","component":"visibility-queue-processor","lifecycle":"Started","logging-call-at":"queue_immediate.go:123"}
2024-02-08 18:25:28 {"level":"info","ts":"2024-02-08T23:25:28.014Z","msg":"none","service":"history","component":"memory-scheduled-queue-processor","lifecycle":"Starting","logging-call-at":"memory_scheduled_queue.go:103"}
2024-02-08 18:25:28 {"level":"info","ts":"2024-02-08T23:25:28.014Z","msg":"none","service":"history","component":"memory-scheduled-queue-processor","lifecycle":"Started","logging-call-at":"memory_scheduled_queue.go:108"}
2024-02-08 18:25:28 {"level":"info","ts":"2024-02-08T23:25:28.014Z","msg":"queue reader started","shard-id":1,"address":"127.0.0.1:40751","component":"transfer-queue-processor","queue-reader-id":0,"lifecycle":"Started","logging-call-at":"reader.go:182"}
2024-02-08 18:25:28 {"level":"info","ts":"2024-02-08T23:25:28.014Z","msg":"queue reader started","shard-id":1,"address":"127.0.0.1:40751","component":"visibility-queue-processor","queue-reader-id":0,"lifecycle":"Started","logging-call-at":"reader.go:182"}
2024-02-08 18:25:28 {"level":"error","ts":"2024-02-08T23:25:28.014Z","msg":"Unable to process new range","shard-id":1,"address":"127.0.0.1:40751","component":"timer-queue-processor","error":"shard status unknown","logging-call-at":"queue_base.go:316","stacktrace":"go.temporal.io/server/common/log.(*zapLogger).Error\n\t/home/runner/go/pkg/mod/go.temporal.io/[email protected]/common/log/zap_logger.go:156\ngo.temporal.io/server/service/history/queues.(*queueBase).processNewRange\n\t/home/runner/go/pkg/mod/go.temporal.io/[email protected]/service/history/queues/queue_base.go:316\ngo.temporal.io/server/service/history/queues.(*scheduledQueue).processEventLoop\n\t/home/runner/go/pkg/mod/go.temporal.io/[email protected]/service/history/queues/queue_scheduled.go:218"}
2024-02-08 18:25:28 {"level":"info","ts":"2024-02-08T23:25:28.014Z","msg":"none","shard-id":1,"address":"127.0.0.1:40751","component":"history-engine","lifecycle":"Started","logging-call-at":"history_engine.go:295"}
2024-02-08 18:25:28 {"level":"info","ts":"2024-02-08T23:25:28.014Z","msg":"none","shard-id":1,"address":"127.0.0.1:40751","lifecycle":"Started","component":"shard-engine","logging-call-at":"context_impl.go:1361"}
2024-02-08 18:25:28 {"level":"info","ts":"2024-02-08T23:25:28.014Z","msg":"queue reader started","shard-id":1,"address":"127.0.0.1:40751","component":"timer-queue-processor","queue-reader-id":0,"lifecycle":"Started","logging-call-at":"reader.go:182"}
2024-02-08 18:25:28 {"level":"info","ts":"2024-02-08T23:25:28.029Z","msg":"temporal-sys-tq-scanner-workflow workflow successfully started","service":"worker","logging-call-at":"scanner.go:292"}
2024-02-08 18:25:28 {"level":"info","ts":"2024-02-08T23:25:28.034Z","msg":"temporal-sys-history-scanner-workflow workflow successfully started","service":"worker","logging-call-at":"scanner.go:292"}
2024-02-08 18:25:28 {"level":"info","ts":"2024-02-08T23:25:28.099Z","msg":"Current reachable members","component":"service-resolver","service":"history","addresses":["127.0.0.1:40751"],"logging-call-at":"service_resolver.go:279"}
2024-02-08 18:25:28 {"level":"info","ts":"2024-02-08T23:25:28.114Z","msg":"Current reachable members","component":"service-resolver","service":"history","addresses":["127.0.0.1:40751"],"logging-call-at":"service_resolver.go:279"}
2024-02-08 18:25:28 {"level":"info","ts":"2024-02-08T23:25:28.117Z","msg":"Current reachable members","component":"service-resolver","service":"matching","addresses":["127.0.0.1:43721"],"logging-call-at":"service_resolver.go:279"}
2024-02-08 18:25:28 {"level":"info","ts":"2024-02-08T23:25:28.152Z","msg":"Started Worker","service":"worker","Namespace":"temporal-system","TaskQueue":"temporal-sys-tq-scanner-taskqueue-0","WorkerID":"1@4db293bb5430@","logging-call-at":"scanner.go:239"}
2024-02-08 18:25:28 {"level":"info","ts":"2024-02-08T23:25:28.156Z","msg":"Started Worker","service":"worker","Namespace":"temporal-system","TaskQueue":"temporal-sys-history-scanner-taskqueue-0","WorkerID":"1@4db293bb5430@","logging-call-at":"scanner.go:239"}
2024-02-08 18:25:28 {"level":"info","ts":"2024-02-08T23:25:28.157Z","msg":"none","service":"matching","component":"matching-engine","wf-task-queue-name":"/_sys/temporal-sys-tq-scanner-taskqueue-0/1","wf-task-queue-type":"Activity","wf-namespace":"temporal-system","lifecycle":"Started","logging-call-at":"task_queue_manager.go:331"}
2024-02-08 18:25:28 {"level":"info","ts":"2024-02-08T23:25:28.158Z","msg":"none","service":"matching","component":"matching-engine","wf-task-queue-name":"4db293bb5430:d9540baa-25fb-4384-9d19-1e7dda6b349a","wf-task-queue-type":"Workflow","wf-namespace":"temporal-system","lifecycle":"Started","logging-call-at":"task_queue_manager.go:331"}
2024-02-08 18:25:28 {"level":"info","ts":"2024-02-08T23:25:28.158Z","msg":"none","service":"matching","component":"matching-engine","wf-task-queue-name":"/_sys/temporal-sys-tq-scanner-taskqueue-0/3","wf-task-queue-type":"Workflow","wf-namespace":"temporal-system","lifecycle":"Started","logging-call-at":"task_queue_manager.go:331"}
2024-02-08 18:25:28 {"level":"info","ts":"2024-02-08T23:25:28.159Z","msg":"none","service":"matching","component":"matching-engine","wf-task-queue-name":"/_sys/temporal-sys-tq-scanner-taskqueue-0/2","wf-task-queue-type":"Activity","wf-namespace":"temporal-system","lifecycle":"Started","logging-call-at":"task_queue_manager.go:331"}
2024-02-08 18:25:28 {"level":"info","ts":"2024-02-08T23:25:28.159Z","msg":"none","service":"matching","component":"matching-engine","wf-task-queue-name":"/_sys/temporal-sys-tq-scanner-taskqueue-0/2","wf-task-queue-type":"Workflow","wf-namespace":"temporal-system","lifecycle":"Started","logging-call-at":"task_queue_manager.go:331"}
2024-02-08 18:25:28 {"level":"info","ts":"2024-02-08T23:25:28.160Z","msg":"none","service":"matching","component":"matching-engine","wf-task-queue-name":"4db293bb5430:1df0c60a-0a1b-4e33-8213-87f23c4f51c9","wf-task-queue-type":"Workflow","wf-namespace":"temporal-system","lifecycle":"Started","logging-call-at":"task_queue_manager.go:331"}
2024-02-08 18:25:28 {"level":"info","ts":"2024-02-08T23:25:28.162Z","msg":"none","service":"matching","component":"matching-engine","wf-task-queue-name":"temporal-sys-tq-scanner-taskqueue-0","wf-task-queue-type":"Activity","wf-namespace":"temporal-system","lifecycle":"Started","logging-call-at":"task_queue_manager.go:331"}
2024-02-08 18:25:28 {"level":"info","ts":"2024-02-08T23:25:28.162Z","msg":"none","service":"matching","component":"matching-engine","wf-task-queue-name":"/_sys/temporal-sys-history-scanner-taskqueue-0/2","wf-task-queue-type":"Workflow","wf-namespace":"temporal-system","lifecycle":"Started","logging-call-at":"task_queue_manager.go:331"}
2024-02-08 18:25:28 {"level":"info","ts":"2024-02-08T23:25:28.162Z","msg":"none","service":"matching","component":"matching-engine","wf-task-queue-name":"/_sys/temporal-sys-history-scanner-taskqueue-0/1","wf-task-queue-type":"Activity","wf-namespace":"temporal-system","lifecycle":"Started","logging-call-at":"task_queue_manager.go:331"}
2024-02-08 18:25:28 {"level":"info","ts":"2024-02-08T23:25:28.163Z","msg":"none","service":"matching","component":"matching-engine","wf-task-queue-name":"/_sys/temporal-sys-tq-scanner-taskqueue-0/1","wf-task-queue-type":"Workflow","wf-namespace":"temporal-system","lifecycle":"Started","logging-call-at":"task_queue_manager.go:331"}
2024-02-08 18:25:28 {"level":"info","ts":"2024-02-08T23:25:28.163Z","msg":"none","service":"matching","component":"matching-engine","wf-task-queue-name":"/_sys/temporal-sys-history-scanner-taskqueue-0/2","wf-task-queue-type":"Activity","wf-namespace":"temporal-system","lifecycle":"Started","logging-call-at":"task_queue_manager.go:331"}
2024-02-08 18:25:28 {"level":"info","ts":"2024-02-08T23:25:28.163Z","msg":"none","service":"matching","component":"matching-engine","wf-task-queue-name":"/_sys/temporal-sys-tq-scanner-taskqueue-0/3","wf-task-queue-type":"Activity","wf-namespace":"temporal-system","lifecycle":"Started","logging-call-at":"task_queue_manager.go:331"}
2024-02-08 18:25:28 {"level":"info","ts":"2024-02-08T23:25:28.163Z","msg":"none","service":"matching","component":"matching-engine","wf-task-queue-name":"/_sys/temporal-sys-history-scanner-taskqueue-0/3","wf-task-queue-type":"Activity","wf-namespace":"temporal-system","lifecycle":"Started","logging-call-at":"task_queue_manager.go:331"}
2024-02-08 18:25:28 {"level":"info","ts":"2024-02-08T23:25:28.164Z","msg":"none","service":"matching","component":"matching-engine","wf-task-queue-name":"temporal-sys-history-scanner-taskqueue-0","wf-task-queue-type":"Workflow","wf-namespace":"temporal-system","lifecycle":"Started","logging-call-at":"task_queue_manager.go:331"}
2024-02-08 18:25:28 {"level":"info","ts":"2024-02-08T23:25:28.164Z","msg":"none","service":"matching","component":"matching-engine","wf-task-queue-name":"/_sys/temporal-sys-history-scanner-taskqueue-0/1","wf-task-queue-type":"Workflow","wf-namespace":"temporal-system","lifecycle":"Started","logging-call-at":"task_queue_manager.go:331"}
2024-02-08 18:25:28 {"level":"info","ts":"2024-02-08T23:25:28.164Z","msg":"none","service":"matching","component":"matching-engine","wf-task-queue-name":"temporal-sys-tq-scanner-taskqueue-0","wf-task-queue-type":"Workflow","wf-namespace":"temporal-system","lifecycle":"Started","logging-call-at":"task_queue_manager.go:331"}
2024-02-08 18:25:28 {"level":"info","ts":"2024-02-08T23:25:28.166Z","msg":"none","service":"matching","component":"matching-engine","wf-task-queue-name":"temporal-sys-history-scanner-taskqueue-0","wf-task-queue-type":"Activity","wf-namespace":"temporal-system","lifecycle":"Started","logging-call-at":"task_queue_manager.go:331"}
2024-02-08 18:25:28 {"level":"info","ts":"2024-02-08T23:25:28.201Z","msg":"none","service":"matching","component":"matching-engine","wf-task-queue-name":"4db293bb5430:354dae82-caf7-415f-a474-d14f5b1cb951","wf-task-queue-type":"Workflow","wf-namespace":"temporal-system","lifecycle":"Started","logging-call-at":"task_queue_manager.go:331"}
2024-02-08 18:25:28 {"level":"info","ts":"2024-02-08T23:25:28.203Z","msg":"none","service":"matching","component":"matching-engine","wf-task-queue-name":"temporal-sys-processor-parent-close-policy","wf-task-queue-type":"Workflow","wf-namespace":"temporal-system","lifecycle":"Started","logging-call-at":"task_queue_manager.go:331"}
2024-02-08 18:25:28 {"level":"info","ts":"2024-02-08T23:25:28.205Z","msg":"none","service":"matching","component":"matching-engine","wf-task-queue-name":"/_sys/temporal-sys-processor-parent-close-policy/3","wf-task-queue-type":"Workflow","wf-namespace":"temporal-system","lifecycle":"Started","logging-call-at":"task_queue_manager.go:331"}
2024-02-08 18:25:28 {"level":"info","ts":"2024-02-08T23:25:28.241Z","msg":"Started Worker","service":"worker","Namespace":"temporal-system","TaskQueue":"temporal-sys-processor-parent-close-policy","WorkerID":"1@4db293bb5430@","logging-call-at":"processor.go:98"}
2024-02-08 18:25:28 {"level":"info","ts":"2024-02-08T23:25:28.243Z","msg":"none","service":"matching","component":"matching-engine","wf-task-queue-name":"temporal-sys-processor-parent-close-policy","wf-task-queue-type":"Activity","wf-namespace":"temporal-system","lifecycle":"Started","logging-call-at":"task_queue_manager.go:331"}
2024-02-08 18:25:28 {"level":"info","ts":"2024-02-08T23:25:28.244Z","msg":"none","service":"matching","component":"matching-engine","wf-task-queue-name":"/_sys/temporal-sys-processor-parent-close-policy/2","wf-task-queue-type":"Activity","wf-namespace":"temporal-system","lifecycle":"Started","logging-call-at":"task_queue_manager.go:331"}
2024-02-08 18:25:28 {"level":"info","ts":"2024-02-08T23:25:28.267Z","msg":"Started Worker","service":"worker","Namespace":"temporal-system","TaskQueue":"temporal-sys-batcher-taskqueue","WorkerID":"1@4db293bb5430@","logging-call-at":"batcher.go:98"}
2024-02-08 18:25:28 {"level":"info","ts":"2024-02-08T23:25:28.267Z","msg":"none","service":"matching","component":"matching-engine","wf-task-queue-name":"4db293bb5430:fb5c4ad3-1509-48cb-9b23-f078e7dbd90d","wf-task-queue-type":"Workflow","wf-namespace":"temporal-system","lifecycle":"Started","logging-call-at":"task_queue_manager.go:331"}
2024-02-08 18:25:28 {"level":"info","ts":"2024-02-08T23:25:28.268Z","msg":"none","service":"matching","component":"matching-engine","wf-task-queue-name":"/_sys/temporal-sys-batcher-taskqueue/2","wf-task-queue-type":"Activity","wf-namespace":"temporal-system","lifecycle":"Started","logging-call-at":"task_queue_manager.go:331"}
2024-02-08 18:25:28 {"level":"info","ts":"2024-02-08T23:25:28.268Z","msg":"none","service":"matching","component":"matching-engine","wf-task-queue-name":"temporal-sys-batcher-taskqueue","wf-task-queue-type":"Workflow","wf-namespace":"temporal-system","lifecycle":"Started","logging-call-at":"task_queue_manager.go:331"}
2024-02-08 18:25:28 {"level":"info","ts":"2024-02-08T23:25:28.270Z","msg":"none","service":"matching","component":"matching-engine","wf-task-queue-name":"/_sys/temporal-sys-batcher-taskqueue/1","wf-task-queue-type":"Activity","wf-namespace":"temporal-system","lifecycle":"Started","logging-call-at":"task_queue_manager.go:331"}
2024-02-08 18:25:28 {"level":"info","ts":"2024-02-08T23:25:28.313Z","msg":"none","service":"matching","component":"matching-engine","wf-task-queue-name":"4db293bb5430:0234fd4a-6412-4ee2-84b9-31892dac56fa","wf-task-queue-type":"Workflow","wf-namespace":"temporal-system","lifecycle":"Started","logging-call-at":"task_queue_manager.go:331"}
2024-02-08 18:25:28 {"level":"info","ts":"2024-02-08T23:25:28.314Z","msg":"none","service":"matching","component":"matching-engine","wf-task-queue-name":"default-worker-tq","wf-task-queue-type":"Workflow","wf-namespace":"temporal-system","lifecycle":"Started","logging-call-at":"task_queue_manager.go:331"}
2024-02-08 18:25:28 {"level":"info","ts":"2024-02-08T23:25:28.330Z","msg":"none","service":"matching","component":"matching-engine","wf-task-queue-name":"temporal-sys-batcher-taskqueue","wf-task-queue-type":"Activity","wf-namespace":"temporal-system","lifecycle":"Started","logging-call-at":"task_queue_manager.go:331"}
2024-02-08 18:25:28 {"level":"info","ts":"2024-02-08T23:25:28.330Z","msg":"Started Worker","service":"worker","Namespace":"temporal-system","TaskQueue":"default-worker-tq","WorkerID":"1@4db293bb5430@","logging-call-at":"worker.go:101"}
2024-02-08 18:25:28 {"level":"info","ts":"2024-02-08T23:25:28.331Z","msg":"none","component":"worker-manager","lifecycle":"Started","logging-call-at":"worker.go:106"}
2024-02-08 18:25:28 {"level":"info","ts":"2024-02-08T23:25:28.331Z","msg":"none","component":"perns-worker-manager","lifecycle":"Starting","logging-call-at":"pernamespaceworker.go:166"}
2024-02-08 18:25:28 {"level":"info","ts":"2024-02-08T23:25:28.331Z","msg":"none","component":"perns-worker-manager","lifecycle":"Started","logging-call-at":"pernamespaceworker.go:177"}
2024-02-08 18:25:28 {"level":"info","ts":"2024-02-08T23:25:28.331Z","msg":"worker service started","service":"worker","component":"worker","address":"127.0.0.1:43701","logging-call-at":"service.go:418"}
2024-02-08 18:25:28 {"level":"info","ts":"2024-02-08T23:25:28.333Z","msg":"none","service":"matching","component":"matching-engine","wf-task-queue-name":"/_sys/default-worker-tq/3","wf-task-queue-type":"Activity","wf-namespace":"temporal-system","lifecycle":"Started","logging-call-at":"task_queue_manager.go:331"}
2024-02-08 18:25:28 {"level":"info","ts":"2024-02-08T23:25:28.334Z","msg":"none","service":"matching","component":"matching-engine","wf-task-queue-name":"default-worker-tq","wf-task-queue-type":"Activity","wf-namespace":"temporal-system","lifecycle":"Started","logging-call-at":"task_queue_manager.go:331"}
2024-02-08 18:25:28 {"level":"info","ts":"2024-02-08T23:25:28.365Z","msg":"none","service":"matching","component":"matching-engine","wf-task-queue-name":"4db293bb5430:3b2ea7dc-ff24-4389-b924-540f71790bf6","wf-task-queue-type":"Workflow","wf-namespace":"temporal-system","lifecycle":"Started","logging-call-at":"task_queue_manager.go:331"}
2024-02-08 18:25:28 {"level":"info","ts":"2024-02-08T23:25:28.366Z","msg":"none","service":"matching","component":"matching-engine","wf-task-queue-name":"temporal-sys-per-ns-tq","wf-task-queue-type":"Workflow","wf-namespace":"temporal-system","lifecycle":"Started","logging-call-at":"task_queue_manager.go:331"}
2024-02-08 18:25:28 {"level":"info","ts":"2024-02-08T23:25:28.388Z","msg":"none","service":"matching","component":"matching-engine","wf-task-queue-name":"4db293bb5430:8bb0a6be-9d0d-4714-b6b6-1bf9a96e77a6","wf-task-queue-type":"Workflow","wf-namespace":"default","lifecycle":"Started","logging-call-at":"task_queue_manager.go:331"}
2024-02-08 18:25:28 {"level":"info","ts":"2024-02-08T23:25:28.389Z","msg":"none","service":"matching","component":"matching-engine","wf-task-queue-name":"temporal-sys-per-ns-tq","wf-task-queue-type":"Workflow","wf-namespace":"default","lifecycle":"Started","logging-call-at":"task_queue_manager.go:331"}
2024-02-08 18:25:28 {"level":"info","ts":"2024-02-08T23:25:28.392Z","msg":"Started Worker","service":"worker","Namespace":"default","TaskQueue":"temporal-sys-per-ns-tq","WorkerID":"server-worker@1@4db293bb5430@default","logging-call-at":"pernamespaceworker.go:483"}
2024-02-08 18:25:28 {"level":"info","ts":"2024-02-08T23:25:28.392Z","msg":"Started Worker","service":"worker","Namespace":"temporal-system","TaskQueue":"temporal-sys-per-ns-tq","WorkerID":"server-worker@1@4db293bb5430@temporal-system","logging-call-at":"pernamespaceworker.go:483"}
2024-02-08 18:25:28 {"level":"info","ts":"2024-02-08T23:25:28.394Z","msg":"none","service":"matching","component":"matching-engine","wf-task-queue-name":"temporal-sys-per-ns-tq","wf-task-queue-type":"Activity","wf-namespace":"temporal-system","lifecycle":"Started","logging-call-at":"task_queue_manager.go:331"}
2024-02-08 18:25:28 {"level":"info","ts":"2024-02-08T23:25:28.394Z","msg":"none","service":"matching","component":"matching-engine","wf-task-queue-name":"temporal-sys-per-ns-tq","wf-task-queue-type":"Activity","wf-namespace":"default","lifecycle":"Started","logging-call-at":"task_queue_manager.go:331"}
2024-02-08 18:25:32 {"level":"info","ts":"2024-02-08T23:25:32.826Z","msg":"Update namespace succeeded","service":"frontend","wf-namespace":"default","wf-namespace-id":"6bcc917e-9f20-484a-ab67-ad8fa1bf9170","logging-call-at":"namespace_handler.go:655"}
2024-02-08 18:25:32 Namespace default update succeeded.
2024-02-08 18:25:32   NamespaceInfo.Name                    temporal-system                                   
2024-02-08 18:25:32   NamespaceInfo.Id                      01c35b57-e0f1-4a61-8209-ff26328bd2c4              
2024-02-08 18:25:32   NamespaceInfo.Description                                                               
2024-02-08 18:25:32   NamespaceInfo.OwnerEmail                                                                
2024-02-08 18:25:32   NamespaceInfo.State                   Registered                                        
2024-02-08 18:25:32   NamespaceInfo.Data                    map[]                                             
2024-02-08 18:25:32   Config.WorkflowExecutionRetentionTtl  24h0m0s                                           
2024-02-08 18:25:32   ReplicationConfig.ActiveClusterName   active                                            
2024-02-08 18:25:32   ReplicationConfig.Clusters            [&ClusterReplicationConfig{ClusterName:active,}]  
2024-02-08 18:25:32   Config.HistoryArchivalState           Disabled                                          
2024-02-08 18:25:32   Config.VisibilityArchivalState        Disabled                                          
2024-02-08 18:25:32   IsGlobalNamespace                     false                                             
2024-02-08 18:25:32   FailoverVersion                                                                      0  
2024-02-08 18:25:32   FailoverHistory                       []                                                
2024-02-08 18:25:32 
2024-02-08 18:25:32   NamespaceInfo.Name                    default                                           
2024-02-08 18:25:32   NamespaceInfo.Id                      6bcc917e-9f20-484a-ab67-ad8fa1bf9170              
2024-02-08 18:25:32   NamespaceInfo.Description                                                               
2024-02-08 18:25:32   NamespaceInfo.OwnerEmail                                                                
2024-02-08 18:25:32   NamespaceInfo.State                   Registered                                        
2024-02-08 18:25:32   NamespaceInfo.Data                    map[]                                             
2024-02-08 18:25:32   Config.WorkflowExecutionRetentionTtl  720h0m0s                                          
2024-02-08 18:25:32   ReplicationConfig.ActiveClusterName   active                                            
2024-02-08 18:25:32   ReplicationConfig.Clusters            [&ClusterReplicationConfig{ClusterName:active,}]  
2024-02-08 18:25:32   Config.HistoryArchivalState           Disabled                                          
2024-02-08 18:25:32   Config.VisibilityArchivalState        Disabled                                          
2024-02-08 18:25:32   IsGlobalNamespace                     false                                             
2024-02-08 18:25:32   FailoverVersion                                                                      0  
2024-02-08 18:25:32   FailoverHistory                       []                                                
2024-02-08 18:25:32 
2024-02-08 18:25:36 {"level":"info","ts":"2024-02-08T23:25:36.125Z","msg":"none","service":"matching","component":"matching-engine","wf-task-queue-name":"293878c61ac3:23dc2966-37c8-445f-840e-6e0fe75c18df","wf-task-queue-type":"Workflow","wf-namespace":"default","lifecycle":"Started","logging-call-at":"task_queue_manager.go:331"}
2024-02-08 18:25:36 {"level":"info","ts":"2024-02-08T23:25:36.125Z","msg":"none","service":"matching","component":"matching-engine","wf-task-queue-name":"archive","wf-task-queue-type":"Workflow","wf-namespace":"default","lifecycle":"Started","logging-call-at":"task_queue_manager.go:331"}
2024-02-08 18:25:36 {"level":"info","ts":"2024-02-08T23:25:36.127Z","msg":"none","service":"matching","component":"matching-engine","wf-task-queue-name":"/_sys/archive/3","wf-task-queue-type":"Workflow","wf-namespace":"default","lifecycle":"Started","logging-call-at":"task_queue_manager.go:331"}
2024-02-08 18:25:36 {"level":"info","ts":"2024-02-08T23:25:36.130Z","msg":"none","service":"matching","component":"matching-engine","wf-task-queue-name":"archive","wf-task-queue-type":"Activity","wf-namespace":"default","lifecycle":"Started","logging-call-at":"task_queue_manager.go:331"}
2024-02-08 18:25:36 {"level":"info","ts":"2024-02-08T23:25:36.131Z","msg":"none","service":"matching","component":"matching-engine","wf-task-queue-name":"/_sys/archive/3","wf-task-queue-type":"Activity","wf-namespace":"default","lifecycle":"Started","logging-call-at":"task_queue_manager.go:331"}
2024-02-08 18:25:36 {"level":"info","ts":"2024-02-08T23:25:36.154Z","msg":"none","service":"matching","component":"matching-engine","wf-task-queue-name":"293878c61ac3:e6fc8d02-185e-4707-88ea-6ef365064731","wf-task-queue-type":"Workflow","wf-namespace":"default","lifecycle":"Started","logging-call-at":"task_queue_manager.go:331"}
2024-02-08 18:25:36 {"level":"info","ts":"2024-02-08T23:25:36.156Z","msg":"none","service":"matching","component":"matching-engine","wf-task-queue-name":"chat-download","wf-task-queue-type":"Workflow","wf-namespace":"default","lifecycle":"Started","logging-call-at":"task_queue_manager.go:331"}
2024-02-08 18:25:36 {"level":"info","ts":"2024-02-08T23:25:36.162Z","msg":"none","service":"matching","component":"matching-engine","wf-task-queue-name":"/_sys/chat-download/2","wf-task-queue-type":"Activity","wf-namespace":"default","lifecycle":"Started","logging-call-at":"task_queue_manager.go:331"}
2024-02-08 18:25:36 {"level":"info","ts":"2024-02-08T23:25:36.163Z","msg":"none","service":"matching","component":"matching-engine","wf-task-queue-name":"chat-download","wf-task-queue-type":"Activity","wf-namespace":"default","lifecycle":"Started","logging-call-at":"task_queue_manager.go:331"}
2024-02-08 18:25:36 {"level":"info","ts":"2024-02-08T23:25:36.174Z","msg":"none","service":"matching","component":"matching-engine","wf-task-queue-name":"293878c61ac3:bb1e7e2a-1fd0-4955-b48b-5f68eb52bccb","wf-task-queue-type":"Workflow","wf-namespace":"default","lifecycle":"Started","logging-call-at":"task_queue_manager.go:331"}
2024-02-08 18:25:36 {"level":"info","ts":"2024-02-08T23:25:36.175Z","msg":"none","service":"matching","component":"matching-engine","wf-task-queue-name":"/_sys/chat-render/1","wf-task-queue-type":"Workflow","wf-namespace":"default","lifecycle":"Started","logging-call-at":"task_queue_manager.go:331"}
2024-02-08 18:25:36 {"level":"info","ts":"2024-02-08T23:25:36.183Z","msg":"none","service":"matching","component":"matching-engine","wf-task-queue-name":"/_sys/chat-render/3","wf-task-queue-type":"Activity","wf-namespace":"default","lifecycle":"Started","logging-call-at":"task_queue_manager.go:331"}
2024-02-08 18:25:36 {"level":"info","ts":"2024-02-08T23:25:36.189Z","msg":"none","service":"matching","component":"matching-engine","wf-task-queue-name":"293878c61ac3:e7035a44-6f4f-49ba-8228-c484ba2189fd","wf-task-queue-type":"Workflow","wf-namespace":"default","lifecycle":"Started","logging-call-at":"task_queue_manager.go:331"}
2024-02-08 18:25:36 {"level":"info","ts":"2024-02-08T23:25:36.191Z","msg":"none","service":"matching","component":"matching-engine","wf-task-queue-name":"/_sys/video-download/2","wf-task-queue-type":"Workflow","wf-namespace":"default","lifecycle":"Started","logging-call-at":"task_queue_manager.go:331"}
2024-02-08 18:25:36 {"level":"info","ts":"2024-02-08T23:25:36.191Z","msg":"none","service":"matching","component":"matching-engine","wf-task-queue-name":"chat-render","wf-task-queue-type":"Workflow","wf-namespace":"default","lifecycle":"Started","logging-call-at":"task_queue_manager.go:331"}
2024-02-08 18:25:36 {"level":"info","ts":"2024-02-08T23:25:36.198Z","msg":"none","service":"matching","component":"matching-engine","wf-task-queue-name":"video-download","wf-task-queue-type":"Workflow","wf-namespace":"default","lifecycle":"Started","logging-call-at":"task_queue_manager.go:331"}
2024-02-08 18:25:36 {"level":"info","ts":"2024-02-08T23:25:36.202Z","msg":"none","service":"matching","component":"matching-engine","wf-task-queue-name":"/_sys/video-download/1","wf-task-queue-type":"Activity","wf-namespace":"default","lifecycle":"Started","logging-call-at":"task_queue_manager.go:331"}
2024-02-08 18:25:36 {"level":"info","ts":"2024-02-08T23:25:36.203Z","msg":"none","service":"matching","component":"matching-engine","wf-task-queue-name":"video-download","wf-task-queue-type":"Activity","wf-namespace":"default","lifecycle":"Started","logging-call-at":"task_queue_manager.go:331"}
2024-02-08 18:25:36 {"level":"info","ts":"2024-02-08T23:25:36.206Z","msg":"none","service":"matching","component":"matching-engine","wf-task-queue-name":"293878c61ac3:539644ca-6651-4a31-8e2b-8e477aca3109","wf-task-queue-type":"Workflow","wf-namespace":"default","lifecycle":"Started","logging-call-at":"task_queue_manager.go:331"}
2024-02-08 18:25:36 {"level":"info","ts":"2024-02-08T23:25:36.208Z","msg":"none","service":"matching","component":"matching-engine","wf-task-queue-name":"/_sys/video-convert/3","wf-task-queue-type":"Workflow","wf-namespace":"default","lifecycle":"Started","logging-call-at":"task_queue_manager.go:331"}
2024-02-08 18:25:36 {"level":"info","ts":"2024-02-08T23:25:36.214Z","msg":"none","service":"matching","component":"matching-engine","wf-task-queue-name":"/_sys/video-convert/1","wf-task-queue-type":"Activity","wf-namespace":"default","lifecycle":"Started","logging-call-at":"task_queue_manager.go:331"}
2024-02-08 18:25:36 {"level":"info","ts":"2024-02-08T23:25:36.214Z","msg":"none","service":"matching","component":"matching-engine","wf-task-queue-name":"video-convert","wf-task-queue-type":"Workflow","wf-namespace":"default","lifecycle":"Started","logging-call-at":"task_queue_manager.go:331"}
2024-02-08 18:25:36 {"level":"info","ts":"2024-02-08T23:25:36.215Z","msg":"none","service":"matching","component":"matching-engine","wf-task-queue-name":"/_sys/video-convert/3","wf-task-queue-type":"Activity","wf-namespace":"default","lifecycle":"Started","logging-call-at":"task_queue_manager.go:331"}
2024-02-08 18:25:36 {"level":"info","ts":"2024-02-08T23:25:36.239Z","msg":"none","service":"matching","component":"matching-engine","wf-task-queue-name":"chat-render","wf-task-queue-type":"Activity","wf-namespace":"default","lifecycle":"Started","logging-call-at":"task_queue_manager.go:331"}
2024-02-08 18:25:36 {"level":"info","ts":"2024-02-08T23:25:36.281Z","msg":"none","service":"matching","component":"matching-engine","wf-task-queue-name":"video-convert","wf-task-queue-type":"Activity","wf-namespace":"default","lifecycle":"Started","logging-call-at":"task_queue_manager.go:331"}
2024-02-08 18:26:25 {"level":"info","ts":"2024-02-08T23:26:25.716Z","msg":"none","service":"matching","component":"matching-engine","wf-task-queue-name":"/_sys/archive/2","wf-task-queue-type":"Workflow","wf-namespace":"default","lifecycle":"Started","logging-call-at":"task_queue_manager.go:331"}
2024-02-08 18:26:25 {"level":"info","ts":"2024-02-08T23:26:25.952Z","msg":"none","service":"matching","component":"matching-engine","wf-task-queue-name":"/_sys/archive/2","wf-task-queue-type":"Activity","wf-namespace":"default","lifecycle":"Started","logging-call-at":"task_queue_manager.go:331"}
2024-02-08 18:26:26 {"level":"info","ts":"2024-02-08T23:26:26.238Z","msg":"none","service":"matching","component":"matching-engine","wf-task-queue-name":"/_sys/archive/1","wf-task-queue-type":"Activity","wf-namespace":"default","lifecycle":"Started","logging-call-at":"task_queue_manager.go:331"}
2024-02-08 18:26:27 {"level":"info","ts":"2024-02-08T23:26:27.205Z","msg":"none","service":"matching","component":"matching-engine","wf-task-queue-name":"/_sys/archive/1","wf-task-queue-type":"Workflow","wf-namespace":"default","lifecycle":"Started","logging-call-at":"task_queue_manager.go:331"}
2024-02-08 18:26:27 {"level":"info","ts":"2024-02-08T23:26:27.236Z","msg":"none","service":"matching","component":"matching-engine","wf-task-queue-name":"/_sys/temporal-sys-history-scanner-taskqueue-0/3","wf-task-queue-type":"Workflow","wf-namespace":"temporal-system","lifecycle":"Started","logging-call-at":"task_queue_manager.go:331"}
2024-02-08 18:26:27 {"level":"info","ts":"2024-02-08T23:26:27.360Z","msg":"none","service":"matching","component":"matching-engine","wf-task-queue-name":"/_sys/temporal-sys-processor-parent-close-policy/1","wf-task-queue-type":"Activity","wf-namespace":"temporal-system","lifecycle":"Started","logging-call-at":"task_queue_manager.go:331"}
2024-02-08 18:26:27 {"level":"info","ts":"2024-02-08T23:26:27.395Z","msg":"none","service":"matching","component":"matching-engine","wf-task-queue-name":"/_sys/default-worker-tq/2","wf-task-queue-type":"Activity","wf-namespace":"temporal-system","lifecycle":"Started","logging-call-at":"task_queue_manager.go:331"}
2024-02-08 18:26:28 {"level":"info","ts":"2024-02-08T23:26:28.354Z","msg":"none","service":"matching","component":"matching-engine","wf-task-queue-name":"/_sys/default-worker-tq/3","wf-task-queue-type":"Workflow","wf-namespace":"temporal-system","lifecycle":"Started","logging-call-at":"task_queue_manager.go:331"}
2024-02-08 18:26:28 {"level":"info","ts":"2024-02-08T23:26:28.359Z","msg":"none","service":"matching","component":"matching-engine","wf-task-queue-name":"/_sys/temporal-sys-processor-parent-close-policy/2","wf-task-queue-type":"Workflow","wf-namespace":"temporal-system","lifecycle":"Started","logging-call-at":"task_queue_manager.go:331"}
2024-02-08 18:26:35 {"level":"info","ts":"2024-02-08T23:26:35.191Z","msg":"none","service":"matching","component":"matching-engine","wf-task-queue-name":"/_sys/chat-download/1","wf-task-queue-type":"Activity","wf-namespace":"default","lifecycle":"Started","logging-call-at":"task_queue_manager.go:331"}
2024-02-08 18:26:35 {"level":"info","ts":"2024-02-08T23:26:35.243Z","msg":"none","service":"matching","component":"matching-engine","wf-task-queue-name":"/_sys/chat-render/2","wf-task-queue-type":"Activity","wf-namespace":"default","lifecycle":"Started","logging-call-at":"task_queue_manager.go:331"}
2024-02-08 18:26:35 {"level":"info","ts":"2024-02-08T23:26:35.273Z","msg":"none","service":"matching","component":"matching-engine","wf-task-queue-name":"/_sys/video-download/3","wf-task-queue-type":"Activity","wf-namespace":"default","lifecycle":"Started","logging-call-at":"task_queue_manager.go:331"}
2024-02-08 18:26:35 {"level":"info","ts":"2024-02-08T23:26:35.286Z","msg":"none","service":"matching","component":"matching-engine","wf-task-queue-name":"/_sys/video-convert/2","wf-task-queue-type":"Activity","wf-namespace":"default","lifecycle":"Started","logging-call-at":"task_queue_manager.go:331"}
2024-02-08 18:27:26 {"level":"info","ts":"2024-02-08T23:27:26.387Z","msg":"none","service":"matching","component":"matching-engine","wf-task-queue-name":"/_sys/temporal-sys-processor-parent-close-policy/3","wf-task-queue-type":"Activity","wf-namespace":"temporal-system","lifecycle":"Started","logging-call-at":"task_queue_manager.go:331"}
2024-02-08 18:27:28 {"level":"info","ts":"2024-02-08T23:27:28.335Z","msg":"none","service":"matching","component":"matching-engine","wf-task-queue-name":"/_sys/temporal-sys-batcher-taskqueue/2","wf-task-queue-type":"Workflow","wf-namespace":"temporal-system","lifecycle":"Started","logging-call-at":"task_queue_manager.go:331"}
2024-02-08 18:27:28 {"level":"info","ts":"2024-02-08T23:27:28.423Z","msg":"none","service":"matching","component":"matching-engine","wf-task-queue-name":"/_sys/default-worker-tq/1","wf-task-queue-type":"Activity","wf-namespace":"temporal-system","lifecycle":"Started","logging-call-at":"task_queue_manager.go:331"}
2024-02-08 18:27:34 {"level":"info","ts":"2024-02-08T23:27:34.203Z","msg":"none","service":"matching","component":"matching-engine","wf-task-queue-name":"/_sys/chat-download/3","wf-task-queue-type":"Activity","wf-namespace":"default","lifecycle":"Started","logging-call-at":"task_queue_manager.go:331"}
2024-02-08 18:27:34 {"level":"info","ts":"2024-02-08T23:27:34.259Z","msg":"none","service":"matching","component":"matching-engine","wf-task-queue-name":"/_sys/video-download/3","wf-task-queue-type":"Workflow","wf-namespace":"default","lifecycle":"Started","logging-call-at":"task_queue_manager.go:331"}
2024-02-08 18:27:34 {"level":"info","ts":"2024-02-08T23:27:34.289Z","msg":"none","service":"matching","component":"matching-engine","wf-task-queue-name":"/_sys/video-convert/2","wf-task-queue-type":"Workflow","wf-namespace":"default","lifecycle":"Started","logging-call-at":"task_queue_manager.go:331"}
2024-02-08 18:27:36 {"level":"info","ts":"2024-02-08T23:27:36.171Z","msg":"none","service":"matching","component":"matching-engine","wf-task-queue-name":"/_sys/chat-download/3","wf-task-queue-type":"Workflow","wf-namespace":"default","lifecycle":"Started","logging-call-at":"task_queue_manager.go:331"}
2024-02-08 18:28:25 {"level":"info","ts":"2024-02-08T23:28:25.336Z","msg":"none","service":"matching","component":"matching-engine","wf-task-queue-name":"/_sys/temporal-sys-batcher-taskqueue/3","wf-task-queue-type":"Activity","wf-namespace":"temporal-system","lifecycle":"Started","logging-call-at":"task_queue_manager.go:331"}
2024-02-08 18:28:25 {"level":"info","ts":"2024-02-08T23:28:25.370Z","msg":"none","service":"matching","component":"matching-engine","wf-task-queue-name":"/_sys/temporal-sys-processor-parent-close-policy/1","wf-task-queue-type":"Workflow","wf-namespace":"temporal-system","lifecycle":"Started","logging-call-at":"task_queue_manager.go:331"}
2024-02-08 18:28:33 {"level":"info","ts":"2024-02-08T23:28:33.265Z","msg":"none","service":"matching","component":"matching-engine","wf-task-queue-name":"/_sys/chat-render/1","wf-task-queue-type":"Activity","wf-namespace":"default","lifecycle":"Started","logging-call-at":"task_queue_manager.go:331"}
2024-02-08 18:28:33 {"level":"info","ts":"2024-02-08T23:28:33.290Z","msg":"none","service":"matching","component":"matching-engine","wf-task-queue-name":"/_sys/video-download/2","wf-task-queue-type":"Activity","wf-namespace":"default","lifecycle":"Started","logging-call-at":"task_queue_manager.go:331"}
2024-02-08 18:28:33 {"level":"info","ts":"2024-02-08T23:28:33.300Z","msg":"none","service":"matching","component":"matching-engine","wf-task-queue-name":"/_sys/video-convert/1","wf-task-queue-type":"Workflow","wf-namespace":"default","lifecycle":"Started","logging-call-at":"task_queue_manager.go:331"}
2024-02-08 18:29:25 {"level":"info","ts":"2024-02-08T23:29:25.435Z","msg":"none","service":"matching","component":"matching-engine","wf-task-queue-name":"/_sys/default-worker-tq/1","wf-task-queue-type":"Workflow","wf-namespace":"temporal-system","lifecycle":"Started","logging-call-at":"task_queue_manager.go:331"}
2024-02-08 18:29:27 {"level":"info","ts":"2024-02-08T23:29:27.364Z","msg":"none","service":"matching","component":"matching-engine","wf-task-queue-name":"/_sys/temporal-sys-batcher-taskqueue/1","wf-task-queue-type":"Workflow","wf-namespace":"temporal-system","lifecycle":"Started","logging-call-at":"task_queue_manager.go:331"}
2024-02-08 18:29:32 {"level":"info","ts":"2024-02-08T23:29:32.261Z","msg":"none","service":"matching","component":"matching-engine","wf-task-queue-name":"/_sys/chat-render/3","wf-task-queue-type":"Workflow","wf-namespace":"default","lifecycle":"Started","logging-call-at":"task_queue_manager.go:331"}
2024-02-08 18:29:32 {"level":"info","ts":"2024-02-08T23:29:32.278Z","msg":"none","service":"matching","component":"matching-engine","wf-task-queue-name":"/_sys/video-download/1","wf-task-queue-type":"Workflow","wf-namespace":"default","lifecycle":"Started","logging-call-at":"task_queue_manager.go:331"}
2024-02-08 18:29:34 {"level":"info","ts":"2024-02-08T23:29:34.204Z","msg":"none","service":"matching","component":"matching-engine","wf-task-queue-name":"/_sys/chat-download/1","wf-task-queue-type":"Workflow","wf-namespace":"default","lifecycle":"Started","logging-call-at":"task_queue_manager.go:331"}

@Zibbp
Copy link
Owner

Zibbp commented Feb 9, 2024

I don't see anything concerning in the temporal logs. Looking again at your ganymede-api logs, the lines appear to be out of order? The timestamps jump around. Can you re-create and post new logs? Do you see any errors in the logs of the video download in the queue tab?

@Aerglonus
Copy link
Author

Do you see any errors in the logs of the video download in the queue tab?

No, just a black screen no logs of task starting and failing at all.

image

As for the ganymede-api log, here it is, re-created (all containers and deleted all folder/files) :

2024-02-08 19:38:37 usermod: no changes
2024-02-08 19:38:37 
2024-02-08 19:38:37 -------------------------------------
2024-02-08 19:38:37 User uid:    911
2024-02-08 19:38:37 User gid:    911
2024-02-08 19:38:37 -------------------------------------
2024-02-08 19:38:37 
2024-02-08 19:38:40 Version    : 
2024-02-08 19:38:40 Git Hash   : 215e0be81b1ef3006943a367324eabfd5b173f5b
2024-02-08 19:38:40 Build Time : 2024-02-05T01:14:19Z
2024-02-08 19:38:41 2024/02/08 18:38:41 INFO  No logger configured for temporal client. Created default one.
2024-02-08 19:38:41 
2024-02-08 19:38:41    ____    __
2024-02-08 19:38:41   / __/___/ /  ___
2024-02-08 19:38:41  / _// __/ _ \/ _ \
2024-02-08 19:38:41 /___/\__/_//_/\___/ v4.11.3
2024-02-08 19:38:41 High performance, minimalist Go web framework
2024-02-08 19:38:41 https://echo.labstack.com
2024-02-08 19:38:41 ____________________________________O/_______
2024-02-08 19:38:41                                     O\
2024-02-08 19:38:41 ⇨ http server started on [::]:4000
2024-02-08 19:38:46 {"level":"info","Namespace":"default","TaskQueue":"archive","WorkerID":"adb8687fd0ad","time":"2024-02-08T18:38:46-06:00","message":"Started Worker"}
2024-02-08 19:38:46 {"level":"info","Namespace":"default","TaskQueue":"chat-download","WorkerID":"adb8687fd0ad","time":"2024-02-08T18:38:46-06:00","message":"Started Worker"}
2024-02-08 19:38:46 {"level":"info","Namespace":"default","TaskQueue":"chat-render","WorkerID":"adb8687fd0ad","time":"2024-02-08T18:38:46-06:00","message":"Started Worker"}
2024-02-08 19:38:46 {"level":"info","Namespace":"default","TaskQueue":"video-download","WorkerID":"adb8687fd0ad","time":"2024-02-08T18:38:46-06:00","message":"Started Worker"}
2024-02-08 19:38:46 {"level":"info","Namespace":"default","TaskQueue":"video-convert","WorkerID":"adb8687fd0ad","time":"2024-02-08T18:38:46-06:00","message":"Started Worker"}
2024-02-08 19:40:36 {"level":"debug","Attempt":1,"ChildWorkflowID":"119a504d-6940-4963-80f6-9fcccb510a28_5","Namespace":"default","RunID":"119a504d-6940-4963-80f6-9fcccb510a28","TaskQueue":"archive","WorkerID":"adb8687fd0ad","WorkflowID":"d7570952-c6e3-11ee-8330-0242ac1b0005","WorkflowType":"CreateDirectoryWorkflow","time":"2024-02-08T18:40:36-06:00","message":"ExecuteChildWorkflow"}
2024-02-08 19:40:36 {"level":"debug","ActivityID":"5","ActivityType":"CreateDirectory","Attempt":1,"Namespace":"default","RunID":"1a165507-747b-48cf-b599-4b31017227c4","TaskQueue":"archive","WorkerID":"adb8687fd0ad","WorkflowID":"119a504d-6940-4963-80f6-9fcccb510a28_5","WorkflowType":"CreateDirectoryWorkflow","time":"2024-02-08T18:40:36-06:00","message":"ExecuteActivity"}
2024-02-08 19:40:37 {"level":"debug","Attempt":1,"ChildWorkflowID":"119a504d-6940-4963-80f6-9fcccb510a28_14","Namespace":"default","RunID":"119a504d-6940-4963-80f6-9fcccb510a28","TaskQueue":"archive","WorkerID":"adb8687fd0ad","WorkflowID":"d7570952-c6e3-11ee-8330-0242ac1b0005","WorkflowType":"DownloadTwitchLiveThumbnailsWorkflow","time":"2024-02-08T18:40:37-06:00","message":"ExecuteChildWorkflow"}
2024-02-08 19:40:37 {"level":"debug","ActivityID":"5","ActivityType":"DownloadTwitchLiveThumbnails","Attempt":1,"Namespace":"default","RunID":"19c95fd0-bbe3-4475-b5b6-b4b1eb9b687a","TaskQueue":"archive","WorkerID":"adb8687fd0ad","WorkflowID":"119a504d-6940-4963-80f6-9fcccb510a28_14","WorkflowType":"DownloadTwitchLiveThumbnailsWorkflow","time":"2024-02-08T18:40:37-06:00","message":"ExecuteActivity"}
2024-02-08 19:38:40 {"level":"info","time":"2024-02-08T18:38:40-06:00","message":"config file found at /data/config.json, loading"}
2024-02-08 19:38:40 {"level":"info","time":"2024-02-08T18:38:40-06:00","message":"config file loaded: /data/config.json"}
2024-02-08 19:38:40 {"level":"debug","time":"2024-02-08T18:38:40-06:00","message":"config file loaded: /data/config.json"}
2024-02-08 19:38:41 {"level":"info","time":"2024-02-08T18:38:41-06:00","message":"Connected to temporal at 192.168.1.65:7233"}
2024-02-08 19:38:42 {"level":"info","time":"2024-02-08T18:38:42-06:00","message":"authenticated with twitch"}
2024-02-08 19:38:45 {"level":"info","time":"2024-02-08T18:38:45-06:00","message":"Starting worker with config: {MAX_CHAT_DOWNLOAD_EXECUTIONS:5 MAX_CHAT_RENDER_EXECUTIONS:3 MAX_VIDEO_DOWNLOAD_EXECUTIONS:5 MAX_VIDEO_CONVERT_EXECUTIONS:3 TEMPORAL_URL:192.168.1.65:7233}"}
2024-02-08 19:38:45 {"level":"info","time":"2024-02-08T18:38:45-06:00","message":"config file found at /data/config.json, loading"}
2024-02-08 19:38:45 {"level":"info","time":"2024-02-08T18:38:45-06:00","message":"config file loaded: /data/config.json"}
2024-02-08 19:38:45 {"level":"debug","time":"2024-02-08T18:38:45-06:00","message":"config file loaded: /data/config.json"}
2024-02-08 19:38:45 {"level":"debug","time":"2024-02-08T18:38:45-06:00","message":"authenticating with twitch"}
2024-02-08 19:38:46 {"level":"info","time":"2024-02-08T18:38:46-06:00","message":"authenticated with twitch"}
2024-02-08 19:38:46 {"level":"debug","time":"2024-02-08T18:38:46-06:00","message":"setting up database connection"}
2024-02-08 19:38:46 {"level":"info","time":"2024-02-08T18:38:46-06:00","message":"setting up check watched channel videos schedule"}
2024-02-08 19:38:46 {"level":"info","time":"2024-02-08T18:38:46-06:00","message":"running check watched channel videos schedule"}
2024-02-08 19:40:37 {"level":"debug","time":"2024-02-08T18:40:37-06:00","message":"creating folder: hatsalsa/2024-02-09-43588657195-live-d7570952-c6e3-11ee-8330-0242ac1b0005"}
2024-02-08 19:40:37 {"level":"debug","time":"2024-02-08T18:40:37-06:00","message":"getting live streams using the following query param: ?user_login=hatsalsa"}
2024-02-08 19:40:37 {"level":"debug","time":"2024-02-08T18:40:37-06:00","message":"downloading file: https://static-cdn.jtvnw.net/previews-ttv/live_user_hatsalsa-1920x1080.jpg"}
2024-02-08 19:40:37 {"level":"debug","time":"2024-02-08T18:40:37-06:00","message":"downloading file: https://static-cdn.jtvnw.net/previews-ttv/live_user_hatsalsa-640x360.jpg"}
2024-02-08 19:40:38 {"level":"debug","time":"2024-02-08T18:40:38-06:00","message":"checking if tasks are done for video 43588657195"}
2024-02-08 19:40:38 {"level":"debug","time":"2024-02-08T18:40:38-06:00","message":"getting live streams using the following query param: ?user_login=hatsalsa"}
2024-02-08 19:40:38 {"level":"debug","time":"2024-02-08T18:40:38-06:00","message":"checking if tasks are done for video 43588657195"}
2024-02-08 19:40:38 {"level":"debug","time":"2024-02-08T18:40:38-06:00","message":"streamlink live args: [--progress=force --force https://twitch.tv/hatsalsa best,best --twitch-low-latency --twitch-disable-hosting -o /tmp/43588657195_d7570952-c6e3-11ee-8330-0242ac1b0005-video.mp4]"}
2024-02-08 19:40:38 {"level":"debug","time":"2024-02-08T18:40:38-06:00","message":"running: streamlink --progress=force --force https://twitch.tv/hatsalsa best,best --twitch-low-latency --twitch-disable-hosting -o /tmp/43588657195_d7570952-c6e3-11ee-8330-0242ac1b0005-video.mp4"}
2024-02-08 19:40:38 {"level":"debug","time":"2024-02-08T18:40:38-06:00","message":"notifying chat download that video download is about to start"}
2024-02-08 19:40:38 {"level":"debug","time":"2024-02-08T18:40:38-06:00","message":"starting heartbeat download-livevideo-43588657195"}
2024-02-08 19:40:38 {"level":"info","time":"2024-02-08T18:40:38-06:00","message":"Connected to temporal at 192.168.1.65:7233"}
2024-02-08 19:40:38 {"level":"debug","time":"2024-02-08T18:40:38-06:00","message":"stopping heartbeat download-livevideo-43588657195"}
2024-02-08 19:40:38 {"level":"debug","Attempt":1,"ChildWorkflowID":"119a504d-6940-4963-80f6-9fcccb510a28_23","Namespace":"default","RunID":"119a504d-6940-4963-80f6-9fcccb510a28","TaskQueue":"archive","WorkerID":"adb8687fd0ad","WorkflowID":"d7570952-c6e3-11ee-8330-0242ac1b0005","WorkflowType":"SaveTwitchLiveVideoInfoWorkflow","time":"2024-02-08T18:40:38-06:00","message":"ExecuteChildWorkflow"}
2024-02-08 19:40:38 {"level":"debug","ActivityID":"5","ActivityType":"SaveTwitchLiveVideoInfo","Attempt":1,"Namespace":"default","RunID":"388dc9ac-e97c-427a-ba06-c95a856685a5","TaskQueue":"archive","WorkerID":"adb8687fd0ad","WorkflowID":"119a504d-6940-4963-80f6-9fcccb510a28_23","WorkflowType":"SaveTwitchLiveVideoInfoWorkflow","time":"2024-02-08T18:40:38-06:00","message":"ExecuteActivity"}
2024-02-08 19:40:38 {"level":"debug","Attempt":1,"ChildWorkflowID":"119a504d-6940-4963-80f6-9fcccb510a28_32","Namespace":"default","RunID":"119a504d-6940-4963-80f6-9fcccb510a28","TaskQueue":"archive","WorkerID":"adb8687fd0ad","WorkflowID":"d7570952-c6e3-11ee-8330-0242ac1b0005","WorkflowType":"ArchiveTwitchLiveVideoWorkflow","time":"2024-02-08T18:40:38-06:00","message":"ExecuteChildWorkflow"}
2024-02-08 19:40:38 {"level":"debug","Attempt":1,"ChildWorkflowID":"9fd8f5a1-5703-4fd5-8142-fc1137978cc9_5","Namespace":"default","RunID":"9fd8f5a1-5703-4fd5-8142-fc1137978cc9","TaskQueue":"archive","WorkerID":"adb8687fd0ad","WorkflowID":"119a504d-6940-4963-80f6-9fcccb510a28_32","WorkflowType":"DownloadTwitchLiveVideoWorkflow","time":"2024-02-08T18:40:38-06:00","message":"ExecuteChildWorkflow"}
2024-02-08 19:40:38 {"level":"debug","ActivityID":"5","ActivityType":"DownloadTwitchLiveVideo","Attempt":1,"Namespace":"default","RunID":"c9f79a79-811e-4a9e-9ce8-d1e770139dbf","TaskQueue":"archive","WorkerID":"adb8687fd0ad","WorkflowID":"9fd8f5a1-5703-4fd5-8142-fc1137978cc9_5","WorkflowType":"DownloadTwitchLiveVideoWorkflow","time":"2024-02-08T18:40:38-06:00","message":"ExecuteActivity"}
2024-02-08 19:40:38 2024/02/08 18:40:38 INFO  No logger configured for temporal client. Created default one.
2024-02-08 19:40:38 {"level":"error","ActivityType":"DownloadTwitchLiveVideo","Attempt":1,"Error":"error sending signal to workflow to start chat download: WorkflowId is not set on request.","Namespace":"default","RunID":"c9f79a79-811e-4a9e-9ce8-d1e770139dbf","TaskQueue":"archive","WorkerID":"adb8687fd0ad","WorkflowID":"9fd8f5a1-5703-4fd5-8142-fc1137978cc9_5","time":"2024-02-08T18:40:38-06:00","message":"Activity error."}

Workflow tasks:
image

DownloadTwitchLiveVideoWorkflow:

image

ArchiveTwitchLiveVideoWorkflow:

image

ArchiveLiveVideoWorkflow :
image

@Zibbp
Copy link
Owner

Zibbp commented Feb 9, 2024

I've fixed a few bugs related to the live archive, if the chat isn't being archived, which I believe is the issue here #364. These are available on the latest :main image if you want to pull and give it another try.

@Aerglonus
Copy link
Author

Aerglonus commented Feb 9, 2024 •
edited
Loading

It seems like #364 fixes this, download video log in queue tab no longer fails and live archive starts normally but when doing a test live archive ( 22seconds stream or 2 minutes stream) after ending stream the current queue item will finish correctly (convert and move) and immediately after another queue will start that eventually will fail (since stream no longer live). I don't know if this is normal behavior due to being a short stream.

Here is the log:

2024-02-08 23:18:19 usermod: no changes
2024-02-08 23:18:19 
2024-02-08 23:18:19 -------------------------------------
2024-02-08 23:18:19 User uid:    911
2024-02-08 23:18:19 User gid:    911
2024-02-08 23:18:19 -------------------------------------
2024-02-08 23:18:19 
2024-02-08 23:18:22 Version    : 
2024-02-08 23:18:22 Git Hash   : 5a6ada20e3a08a0f804589c8dab4ecd56348e124
2024-02-08 23:18:22 Build Time : 2024-02-09T03:40:02Z
2024-02-08 23:18:22 2024/02/08 22:18:22 INFO  No logger configured for temporal client. Created default one.
2024-02-08 23:18:22 
2024-02-08 23:18:22    ____    __
2024-02-08 23:18:22   / __/___/ /  ___
2024-02-08 23:18:22  / _// __/ _ \/ _ \
2024-02-08 23:18:22 /___/\__/_//_/\___/ v4.11.3
2024-02-08 23:18:22 High performance, minimalist Go web framework
2024-02-08 23:18:22 https://echo.labstack.com
2024-02-08 23:18:22 ____________________________________O/_______
2024-02-08 23:18:22                                     O\
2024-02-08 23:18:22 ⇨ http server started on [::]:4000
2024-02-08 23:18:22 {"level":"info","time":"2024-02-08T22:18:22-06:00","message":"config file found at /data/config.json, loading"}
2024-02-08 23:18:22 {"level":"info","time":"2024-02-08T22:18:22-06:00","message":"config file loaded: /data/config.json"}
2024-02-08 23:18:22 {"level":"debug","time":"2024-02-08T22:18:22-06:00","message":"config file loaded: /data/config.json"}
2024-02-08 23:18:22 {"level":"info","time":"2024-02-08T22:18:22-06:00","message":"Connected to temporal at 192.168.1.65:7233"}
2024-02-08 23:18:23 {"level":"info","time":"2024-02-08T22:18:23-06:00","message":"authenticated with twitch"}
2024-02-08 23:18:27 {"level":"info","time":"2024-02-08T22:18:27-06:00","message":"Starting worker with config: {MAX_CHAT_DOWNLOAD_EXECUTIONS:5 MAX_CHAT_RENDER_EXECUTIONS:3 MAX_VIDEO_DOWNLOAD_EXECUTIONS:5 MAX_VIDEO_CONVERT_EXECUTIONS:3 TEMPORAL_URL:192.168.1.65:7233}"}
2024-02-08 23:18:27 {"level":"info","time":"2024-02-08T22:18:27-06:00","message":"config file found at /data/config.json, loading"}
2024-02-08 23:18:27 {"level":"info","time":"2024-02-08T22:18:27-06:00","message":"config file loaded: /data/config.json"}
2024-02-08 23:18:27 {"level":"debug","time":"2024-02-08T22:18:27-06:00","message":"config file loaded: /data/config.json"}
2024-02-08 23:18:27 {"level":"debug","time":"2024-02-08T22:18:27-06:00","message":"authenticating with twitch"}
2024-02-08 23:18:27 {"level":"info","time":"2024-02-08T22:18:27-06:00","message":"setting up check watched channel videos schedule"}
2024-02-08 23:18:27 {"level":"info","time":"2024-02-08T22:18:27-06:00","message":"running check watched channel videos schedule"}
2024-02-08 23:18:28 {"level":"info","time":"2024-02-08T22:18:28-06:00","message":"authenticated with twitch"}
2024-02-08 23:18:28 {"level":"debug","time":"2024-02-08T22:18:28-06:00","message":"setting up database connection"}
2024-02-08 23:18:28 {"level":"info","Namespace":"default","TaskQueue":"archive","WorkerID":"5ac4fb3490a8","time":"2024-02-08T22:18:28-06:00","message":"Started Worker"}
2024-02-08 23:18:28 {"level":"info","Namespace":"default","TaskQueue":"chat-download","WorkerID":"5ac4fb3490a8","time":"2024-02-08T22:18:28-06:00","message":"Started Worker"}
2024-02-08 23:18:28 {"level":"info","Namespace":"default","TaskQueue":"chat-render","WorkerID":"5ac4fb3490a8","time":"2024-02-08T22:18:28-06:00","message":"Started Worker"}
2024-02-08 23:18:28 {"level":"info","Namespace":"default","TaskQueue":"video-download","WorkerID":"5ac4fb3490a8","time":"2024-02-08T22:18:28-06:00","message":"Started Worker"}
2024-02-08 23:18:28 {"level":"info","Namespace":"default","TaskQueue":"video-convert","WorkerID":"5ac4fb3490a8","time":"2024-02-08T22:18:28-06:00","message":"Started Worker"}
2024-02-08 23:19:08 {"level":"debug","Attempt":1,"ChildWorkflowID":"3b76e724-f5e9-4144-b8c0-4fb0c7efa389_5","Namespace":"default","RunID":"3b76e724-f5e9-4144-b8c0-4fb0c7efa389","TaskQueue":"archive","WorkerID":"5ac4fb3490a8","WorkflowID":"5e4551b5-c702-11ee-8671-0242ac1f0006","WorkflowType":"CreateDirectoryWorkflow","time":"2024-02-08T22:19:08-06:00","message":"ExecuteChildWorkflow"}
2024-02-08 23:19:08 {"level":"debug","ActivityID":"5","ActivityType":"CreateDirectory","Attempt":1,"Namespace":"default","RunID":"c1c01e9b-5429-4c84-9f5b-98da50cdbddf","TaskQueue":"archive","WorkerID":"5ac4fb3490a8","WorkflowID":"3b76e724-f5e9-4144-b8c0-4fb0c7efa389_5","WorkflowType":"CreateDirectoryWorkflow","time":"2024-02-08T22:19:08-06:00","message":"ExecuteActivity"}
2024-02-08 23:19:08 {"level":"debug","time":"2024-02-08T22:19:08-06:00","message":"creating folder: hatsalsa/2024-02-09-50362789149-live-5e4551b5-c702-11ee-8671-0242ac1f0006"}
2024-02-08 23:19:08 {"level":"debug","Attempt":1,"ChildWorkflowID":"3b76e724-f5e9-4144-b8c0-4fb0c7efa389_14","Namespace":"default","RunID":"3b76e724-f5e9-4144-b8c0-4fb0c7efa389","TaskQueue":"archive","WorkerID":"5ac4fb3490a8","WorkflowID":"5e4551b5-c702-11ee-8671-0242ac1f0006","WorkflowType":"DownloadTwitchLiveThumbnailsWorkflow","time":"2024-02-08T22:19:08-06:00","message":"ExecuteChildWorkflow"}
2024-02-08 23:19:08 {"level":"debug","ActivityID":"5","ActivityType":"DownloadTwitchLiveThumbnails","Attempt":1,"Namespace":"default","RunID":"c3127519-e292-4c53-a550-42429a12dafb","TaskQueue":"archive","WorkerID":"5ac4fb3490a8","WorkflowID":"3b76e724-f5e9-4144-b8c0-4fb0c7efa389_14","WorkflowType":"DownloadTwitchLiveThumbnailsWorkflow","time":"2024-02-08T22:19:08-06:00","message":"ExecuteActivity"}
2024-02-08 23:19:08 {"level":"debug","time":"2024-02-08T22:19:08-06:00","message":"getting live streams using the following query param: ?user_login=hatsalsa"}
2024-02-08 23:19:08 {"level":"debug","time":"2024-02-08T22:19:08-06:00","message":"downloading file: https://static-cdn.jtvnw.net/previews-ttv/live_user_hatsalsa-1920x1080.jpg"}
2024-02-08 23:19:09 {"level":"debug","time":"2024-02-08T22:19:09-06:00","message":"downloading file: https://static-cdn.jtvnw.net/previews-ttv/live_user_hatsalsa-640x360.jpg"}
2024-02-08 23:19:10 {"level":"debug","time":"2024-02-08T22:19:10-06:00","message":"checking if tasks are done for video 50362789149"}
2024-02-08 23:19:10 {"level":"debug","Attempt":1,"ChildWorkflowID":"3b76e724-f5e9-4144-b8c0-4fb0c7efa389_23","Namespace":"default","RunID":"3b76e724-f5e9-4144-b8c0-4fb0c7efa389","TaskQueue":"archive","WorkerID":"5ac4fb3490a8","WorkflowID":"5e4551b5-c702-11ee-8671-0242ac1f0006","WorkflowType":"SaveTwitchLiveVideoInfoWorkflow","time":"2024-02-08T22:19:10-06:00","message":"ExecuteChildWorkflow"}
2024-02-08 23:19:10 {"level":"debug","ActivityID":"5","ActivityType":"SaveTwitchLiveVideoInfo","Attempt":1,"Namespace":"default","RunID":"c0c16246-7840-4863-9e56-a07bb2b2d7a6","TaskQueue":"archive","WorkerID":"5ac4fb3490a8","WorkflowID":"3b76e724-f5e9-4144-b8c0-4fb0c7efa389_23","WorkflowType":"SaveTwitchLiveVideoInfoWorkflow","time":"2024-02-08T22:19:10-06:00","message":"ExecuteActivity"}
2024-02-08 23:19:10 {"level":"debug","time":"2024-02-08T22:19:10-06:00","message":"getting live streams using the following query param: ?user_login=hatsalsa"}
2024-02-08 23:19:10 {"level":"debug","time":"2024-02-08T22:19:10-06:00","message":"checking if tasks are done for video 50362789149"}
2024-02-08 23:19:10 {"level":"debug","Attempt":1,"ChildWorkflowID":"3b76e724-f5e9-4144-b8c0-4fb0c7efa389_32","Namespace":"default","RunID":"3b76e724-f5e9-4144-b8c0-4fb0c7efa389","TaskQueue":"archive","WorkerID":"5ac4fb3490a8","WorkflowID":"5e4551b5-c702-11ee-8671-0242ac1f0006","WorkflowType":"ArchiveTwitchLiveVideoWorkflow","time":"2024-02-08T22:19:10-06:00","message":"ExecuteChildWorkflow"}
2024-02-08 23:19:10 {"level":"debug","Attempt":1,"ChildWorkflowID":"515a85a9-4541-41a1-8e97-0e6d2d1278cd_5","Namespace":"default","RunID":"515a85a9-4541-41a1-8e97-0e6d2d1278cd","TaskQueue":"archive","WorkerID":"5ac4fb3490a8","WorkflowID":"3b76e724-f5e9-4144-b8c0-4fb0c7efa389_32","WorkflowType":"DownloadTwitchLiveVideoWorkflow","time":"2024-02-08T22:19:10-06:00","message":"ExecuteChildWorkflow"}
2024-02-08 23:19:10 {"level":"debug","ActivityID":"5","ActivityType":"DownloadTwitchLiveVideo","Attempt":1,"Namespace":"default","RunID":"c57407ed-cc55-4832-92f4-35d4a4f6df6a","TaskQueue":"archive","WorkerID":"5ac4fb3490a8","WorkflowID":"515a85a9-4541-41a1-8e97-0e6d2d1278cd_5","WorkflowType":"DownloadTwitchLiveVideoWorkflow","time":"2024-02-08T22:19:10-06:00","message":"ExecuteActivity"}
2024-02-08 23:19:10 {"level":"debug","time":"2024-02-08T22:19:10-06:00","message":"streamlink live args: [--progress=force --force https://twitch.tv/hatsalsa best,best --twitch-low-latency --twitch-disable-hosting -o /tmp/50362789149_5e4551b5-c702-11ee-8671-0242ac1f0006-video.mp4]"}
2024-02-08 23:19:10 {"level":"debug","time":"2024-02-08T22:19:10-06:00","message":"starting heartbeat download-livevideo-50362789149"}
2024-02-08 23:19:10 {"level":"debug","time":"2024-02-08T22:19:10-06:00","message":"running: streamlink --progress=force --force https://twitch.tv/hatsalsa best,best --twitch-low-latency --twitch-disable-hosting -o /tmp/50362789149_5e4551b5-c702-11ee-8671-0242ac1f0006-video.mp4"}
2024-02-08 23:21:07 {"level":"debug","time":"2024-02-08T22:21:07-06:00","message":"finished downloading live video for 50362789149"}
2024-02-08 23:21:07 {"level":"debug","time":"2024-02-08T22:21:07-06:00","message":"getting video duration"}
2024-02-08 23:21:07 {"level":"debug","time":"2024-02-08T22:21:07-06:00","message":"video duration: 113"}
2024-02-08 23:21:07 {"level":"debug","time":"2024-02-08T22:21:07-06:00","message":"getting twitch videos for user: 529061290 with type archive and cursor eyJiIjpudWxsLCJhIjp7Ik9mZnNldCI6MjV9fQ"}
2024-02-08 23:21:07 {"level":"info","time":"2024-02-08T22:21:07-06:00","message":"found vod id 2057484385 for livestream 50362789149, updating database"}
2024-02-08 23:21:07 {"level":"debug","time":"2024-02-08T22:21:07-06:00","message":"stopping heartbeat download-livevideo-50362789149"}
2024-02-08 23:21:07 {"level":"debug","time":"2024-02-08T22:21:07-06:00","message":"checking if tasks are done for video 50362789149"}
2024-02-08 23:21:07 {"level":"debug","Attempt":1,"ChildWorkflowID":"515a85a9-4541-41a1-8e97-0e6d2d1278cd_14","Namespace":"default","RunID":"515a85a9-4541-41a1-8e97-0e6d2d1278cd","TaskQueue":"archive","WorkerID":"5ac4fb3490a8","WorkflowID":"3b76e724-f5e9-4144-b8c0-4fb0c7efa389_32","WorkflowType":"PostprocessVideoWorkflow","time":"2024-02-08T22:21:07-06:00","message":"ExecuteChildWorkflow"}
2024-02-08 23:21:07 {"level":"debug","ActivityID":"5","ActivityType":"PostprocessVideo","Attempt":1,"Namespace":"default","RunID":"e5fa56f0-f54c-430a-b133-8e630d338658","TaskQueue":"archive","WorkerID":"5ac4fb3490a8","WorkflowID":"515a85a9-4541-41a1-8e97-0e6d2d1278cd_14","WorkflowType":"PostprocessVideoWorkflow","time":"2024-02-08T22:21:07-06:00","message":"ExecuteActivity"}
2024-02-08 23:21:07 {"level":"debug","time":"2024-02-08T22:21:07-06:00","message":"video convert args: [-y -hide_banner -i /tmp/50362789149_5e4551b5-c702-11ee-8671-0242ac1f0006-video.mp4 -c:v copy -c:a copy /tmp/50362789149_5e4551b5-c702-11ee-8671-0242ac1f0006-video-convert.mp4]"}
2024-02-08 23:21:07 {"level":"debug","time":"2024-02-08T22:21:07-06:00","message":"starting heartbeat postprocess-video-50362789149"}
2024-02-08 23:21:08 {"level":"debug","Attempt":1,"ChildWorkflowID":"fe1ec22d-c8fb-4d85-a4dc-541247e063a9_5","Namespace":"default","RunID":"fe1ec22d-c8fb-4d85-a4dc-541247e063a9","TaskQueue":"archive","WorkerID":"5ac4fb3490a8","WorkflowID":"a5caf8ae-c702-11ee-8671-0242ac1f0006","WorkflowType":"CreateDirectoryWorkflow","time":"2024-02-08T22:21:08-06:00","message":"ExecuteChildWorkflow"}
2024-02-08 23:21:08 {"level":"debug","ActivityID":"5","ActivityType":"CreateDirectory","Attempt":1,"Namespace":"default","RunID":"394aa568-f57a-4deb-b73c-f099054dbd6e","TaskQueue":"archive","WorkerID":"5ac4fb3490a8","WorkflowID":"fe1ec22d-c8fb-4d85-a4dc-541247e063a9_5","WorkflowType":"CreateDirectoryWorkflow","time":"2024-02-08T22:21:08-06:00","message":"ExecuteActivity"}
2024-02-08 23:21:08 {"level":"debug","time":"2024-02-08T22:21:08-06:00","message":"creating folder: hatsalsa/2024-02-09-50362789149-live-a5caf8ae-c702-11ee-8671-0242ac1f0006"}
2024-02-08 23:21:08 {"level":"debug","time":"2024-02-08T22:21:08-06:00","message":"finished vod video convert for 50362789149"}
2024-02-08 23:21:08 {"level":"debug","time":"2024-02-08T22:21:08-06:00","message":"stopping heartbeat postprocess-video-50362789149"}
2024-02-08 23:21:08 {"level":"debug","Attempt":1,"ChildWorkflowID":"fe1ec22d-c8fb-4d85-a4dc-541247e063a9_14","Namespace":"default","RunID":"fe1ec22d-c8fb-4d85-a4dc-541247e063a9","TaskQueue":"archive","WorkerID":"5ac4fb3490a8","WorkflowID":"a5caf8ae-c702-11ee-8671-0242ac1f0006","WorkflowType":"DownloadTwitchLiveThumbnailsWorkflow","time":"2024-02-08T22:21:08-06:00","message":"ExecuteChildWorkflow"}
2024-02-08 23:21:08 {"level":"debug","time":"2024-02-08T22:21:08-06:00","message":"checking if tasks are done for video 50362789149"}
2024-02-08 23:21:08 {"level":"debug","ActivityID":"5","ActivityType":"DownloadTwitchLiveThumbnails","Attempt":1,"Namespace":"default","RunID":"6b74d557-c016-4138-a6d7-374b68a5d557","TaskQueue":"archive","WorkerID":"5ac4fb3490a8","WorkflowID":"fe1ec22d-c8fb-4d85-a4dc-541247e063a9_14","WorkflowType":"DownloadTwitchLiveThumbnailsWorkflow","time":"2024-02-08T22:21:08-06:00","message":"ExecuteActivity"}
2024-02-08 23:21:08 {"level":"debug","Attempt":1,"ChildWorkflowID":"515a85a9-4541-41a1-8e97-0e6d2d1278cd_23","Namespace":"default","RunID":"515a85a9-4541-41a1-8e97-0e6d2d1278cd","TaskQueue":"archive","WorkerID":"5ac4fb3490a8","WorkflowID":"3b76e724-f5e9-4144-b8c0-4fb0c7efa389_32","WorkflowType":"MoveVideoWorkflow","time":"2024-02-08T22:21:08-06:00","message":"ExecuteChildWorkflow"}
2024-02-08 23:21:08 {"level":"debug","time":"2024-02-08T22:21:08-06:00","message":"getting live streams using the following query param: ?user_login=hatsalsa"}
2024-02-08 23:21:08 {"level":"debug","ActivityID":"5","ActivityType":"MoveVideo","Attempt":1,"Namespace":"default","RunID":"faaa54d8-cdc6-4891-aa41-8dc00465d5c8","TaskQueue":"archive","WorkerID":"5ac4fb3490a8","WorkflowID":"515a85a9-4541-41a1-8e97-0e6d2d1278cd_23","WorkflowType":"MoveVideoWorkflow","time":"2024-02-08T22:21:08-06:00","message":"ExecuteActivity"}
2024-02-08 23:21:08 {"level":"debug","time":"2024-02-08T22:21:08-06:00","message":"downloading file: https://static-cdn.jtvnw.net/previews-ttv/live_user_hatsalsa-1920x1080.jpg"}
2024-02-08 23:21:08 {"level":"debug","time":"2024-02-08T22:21:08-06:00","message":"moving file: /tmp/50362789149_5e4551b5-c702-11ee-8671-0242ac1f0006-video-convert.mp4 to /vods/hatsalsa/2024-02-09-50362789149-live-5e4551b5-c702-11ee-8671-0242ac1f0006/50362789149-video.mp4"}
2024-02-08 23:21:08 {"level":"debug","time":"2024-02-08T22:21:08-06:00","message":"starting heartbeat move-video-50362789149"}
2024-02-08 23:21:08 {"level":"debug","time":"2024-02-08T22:21:08-06:00","message":"downloading file: https://static-cdn.jtvnw.net/previews-ttv/live_user_hatsalsa-640x360.jpg"}
2024-02-08 23:21:09 {"level":"debug","time":"2024-02-08T22:21:09-06:00","message":"checking if tasks are done for video 50362789149"}
2024-02-08 23:21:09 {"level":"debug","Attempt":1,"ChildWorkflowID":"fe1ec22d-c8fb-4d85-a4dc-541247e063a9_23","Namespace":"default","RunID":"fe1ec22d-c8fb-4d85-a4dc-541247e063a9","TaskQueue":"archive","WorkerID":"5ac4fb3490a8","WorkflowID":"a5caf8ae-c702-11ee-8671-0242ac1f0006","WorkflowType":"SaveTwitchLiveVideoInfoWorkflow","time":"2024-02-08T22:21:09-06:00","message":"ExecuteChildWorkflow"}
2024-02-08 23:21:09 {"level":"debug","ActivityID":"5","ActivityType":"SaveTwitchLiveVideoInfo","Attempt":1,"Namespace":"default","RunID":"2444e24c-697e-4c32-9c80-d79e515cd30e","TaskQueue":"archive","WorkerID":"5ac4fb3490a8","WorkflowID":"fe1ec22d-c8fb-4d85-a4dc-541247e063a9_23","WorkflowType":"SaveTwitchLiveVideoInfoWorkflow","time":"2024-02-08T22:21:09-06:00","message":"ExecuteActivity"}
2024-02-08 23:21:09 {"level":"debug","time":"2024-02-08T22:21:09-06:00","message":"getting live streams using the following query param: ?user_login=hatsalsa"}
2024-02-08 23:21:09 {"level":"debug","time":"2024-02-08T22:21:09-06:00","message":"checking if tasks are done for video 50362789149"}
2024-02-08 23:21:09 {"level":"debug","Attempt":1,"ChildWorkflowID":"fe1ec22d-c8fb-4d85-a4dc-541247e063a9_32","Namespace":"default","RunID":"fe1ec22d-c8fb-4d85-a4dc-541247e063a9","TaskQueue":"archive","WorkerID":"5ac4fb3490a8","WorkflowID":"a5caf8ae-c702-11ee-8671-0242ac1f0006","WorkflowType":"ArchiveTwitchLiveVideoWorkflow","time":"2024-02-08T22:21:09-06:00","message":"ExecuteChildWorkflow"}
2024-02-08 23:21:09 {"level":"debug","Attempt":1,"ChildWorkflowID":"b899ce5c-cb2e-4fc3-8979-e602016120c7_5","Namespace":"default","RunID":"b899ce5c-cb2e-4fc3-8979-e602016120c7","TaskQueue":"archive","WorkerID":"5ac4fb3490a8","WorkflowID":"fe1ec22d-c8fb-4d85-a4dc-541247e063a9_32","WorkflowType":"DownloadTwitchLiveVideoWorkflow","time":"2024-02-08T22:21:09-06:00","message":"ExecuteChildWorkflow"}
2024-02-08 23:21:09 {"level":"debug","time":"2024-02-08T22:21:09-06:00","message":"deleting file: /tmp/50362789149_5e4551b5-c702-11ee-8671-0242ac1f0006-video.mp4"}
2024-02-08 23:21:09 {"level":"debug","time":"2024-02-08T22:21:09-06:00","message":"stopping heartbeat move-video-50362789149"}
2024-02-08 23:21:09 {"level":"debug","ActivityID":"5","ActivityType":"DownloadTwitchLiveVideo","Attempt":1,"Namespace":"default","RunID":"b6d7a38c-4499-44da-993b-a654f979a4c3","TaskQueue":"archive","WorkerID":"5ac4fb3490a8","WorkflowID":"b899ce5c-cb2e-4fc3-8979-e602016120c7_5","WorkflowType":"DownloadTwitchLiveVideoWorkflow","time":"2024-02-08T22:21:09-06:00","message":"ExecuteActivity"}
2024-02-08 23:21:09 {"level":"debug","time":"2024-02-08T22:21:09-06:00","message":"checking if tasks are done for video 50362789149"}
2024-02-08 23:21:09 {"level":"debug","time":"2024-02-08T22:21:09-06:00","message":"all tasks for video 50362789149 are done"}
2024-02-08 23:21:09 {"level":"debug","time":"2024-02-08T22:21:09-06:00","message":"streamlink live args: [--progress=force --force https://twitch.tv/hatsalsa best,best --twitch-low-latency --twitch-disable-hosting -o /tmp/50362789149_a5caf8ae-c702-11ee-8671-0242ac1f0006-video.mp4]"}
2024-02-08 23:21:09 {"level":"debug","time":"2024-02-08T22:21:09-06:00","message":"running: streamlink --progress=force --force https://twitch.tv/hatsalsa best,best --twitch-low-latency --twitch-disable-hosting -o /tmp/50362789149_a5caf8ae-c702-11ee-8671-0242ac1f0006-video.mp4"}
2024-02-08 23:21:09 {"level":"debug","time":"2024-02-08T22:21:09-06:00","message":"starting heartbeat download-livevideo-50362789149"}
2024-02-08 23:21:10 {"level":"debug","time":"2024-02-08T22:21:10-06:00","message":"finished downloading live video for 50362789149 - exit status 1"}
2024-02-08 23:21:10 {"level":"debug","time":"2024-02-08T22:21:10-06:00","message":"streamlink live stdout: [cli][info] Found matching plugin twitch for URL https://twitch.tv/hatsalsa\nerror: No playable streams found on this URL: https://twitch.tv/hatsalsa\n"}
2024-02-08 23:21:10 {"level":"debug","time":"2024-02-08T22:21:10-06:00","message":"getting video duration"}
2024-02-08 23:21:10 {"level":"error","error":"exit status 1","time":"2024-02-08T22:21:10-06:00","message":"error getting video duration"}
2024-02-08 23:21:10 {"level":"debug","time":"2024-02-08T22:21:10-06:00","message":"stopping heartbeat download-livevideo-50362789149"}
2024-02-08 23:21:10 streamlink error: exit status 1{"level":"error","ActivityType":"DownloadTwitchLiveVideo","Attempt":1,"Error":"exit status 1","Namespace":"default","RunID":"b6d7a38c-4499-44da-993b-a654f979a4c3","TaskQueue":"archive","WorkerID":"5ac4fb3490a8","WorkflowID":"b899ce5c-cb2e-4fc3-8979-e602016120c7_5","time":"2024-02-08T22:21:10-06:00","message":"Activity error."}
2024-02-08 23:25:50 {"level":"error","error":"exit status 1","time":"2024-02-08T22:25:50-06:00","message":"error getting pid for queue item: exit status 1"}

@Zibbp
Copy link
Owner

Zibbp commented Feb 12, 2024

The Twitch API is slow to update when the stream ends. The first archive ended as the video feed stopped. Shortly after the live channel check fires again and Twitch still says the stream is online. Eventually the video task will fail on the 2nd archived as the stream is truly offline but Twitch hasn't updated yet. A shorter live check interval helps mitigate this.

I can try to make the video download task be more aggressive and clean up the archive if the process ends and there is no video file.

@Aerglonus
Copy link
Author

I can try to make the video download task be more aggressive and clean up the archive if the process ends and there is no video file.

This is the best approach, currently i have it at 10 seconds interval and going shorter than this might probably get rate limited by Twitch (If this is not the case with just setting a shorter interval is fine).

@Zibbp
Copy link
Owner

Zibbp commented Feb 13, 2024

Sorry, I mistyped my original message. An increased/longer live check interval will help mitigate this. I know for some, increasing the interval isn't great as it opens the possibility of not getting the first N seconds of a live stream.

@Zibbp
Copy link
Owner

Zibbp commented Feb 19, 2024

Bug fixes from this issue are now released in v2.1.0.

@Aerglonus Aerglonus mentioned this issue Feb 28, 2024
Closed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@Aerglonus @Zibbp