Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

job 上传大文件失败 #1784

Closed
yhd3 opened this issue Mar 1, 2023 · 2 comments
Closed

job 上传大文件失败 #1784

yhd3 opened this issue Mar 1, 2023 · 2 comments
Assignees
Labels
done 已上线到正式环境并验收通过 kind/bug 程序故障Bug,漏洞 stage/prod Production environment in tencent has been deploy

Comments

@yhd3
Copy link

yhd3 commented Mar 1, 2023

Version / Branch / tag
3.2.2/3.5.1

出了什么问题?(What Happened?)
当本地上传大文件时(目前测过最低的1.8G也会发生),前端显示进度条拉完。
但是network里的连接扔处于挂起状态。过了非常长的时间后(甚至十几、几十分钟也有),连接返回失败。
此时页面显示上传失败。

如何复现?(How to reproduce?)

  1. 到 job 平台选择分发文件
  2. 上传源文件即可触发

预期结果(What you expect?)
如问题描述,然后拿 trace id 到 manage 找日志,会刷:

  1. token is expire
  2. invalid request, jwt is invalid or expired
@yhd3 yhd3 added the kind/bug 程序故障Bug,漏洞 label Mar 1, 2023
@wangyu096 wangyu096 assigned liuliaozhong and unassigned nekzhang Mar 17, 2023
@wangyu096
Copy link
Collaborator

  1. 修改 jwt token 的失效时间,从10min -> 2h,尽可能满足大部分场景
  2. 根本解决方案,需要改造文件上传服务,上传文件到第三方文件系统(比如bkrepo)。这个issue暂不处理

@wangyu096
Copy link
Collaborator

wangyu096 commented Mar 28, 2023

关联issue:
#1887

现象

当文件比较大的时候,前端上传组件显示上传完成(进度条消失), 这时候点击“执行”,页面提示“本地源文件未上传完成”。

image

原因

实际上虽然从文件数据已经全量上传了,但是由于数据需要经过web -> job-gateway -> job-manage 才能实际上传成功,上传接口并没有返回成功的响应

liuliaozhong added a commit to liuliaozhong/bk-job that referenced this issue Mar 28, 2023
liuliaozhong added a commit to liuliaozhong/bk-job that referenced this issue Mar 28, 2023
wangyu096 added a commit that referenced this issue Mar 28, 2023
bugfix: job上传大文件失败 #1784
liuliaozhong added a commit to liuliaozhong/bk-job that referenced this issue Mar 28, 2023
wangyu096 added a commit that referenced this issue Mar 28, 2023
bugfix: job上传大文件失败 #1784
@bkjob-bot bkjob-bot added the stage/prod Production environment in tencent has been deploy label Apr 13, 2023
@bkjob-bot bkjob-bot added the done 已上线到正式环境并验收通过 label May 22, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
done 已上线到正式环境并验收通过 kind/bug 程序故障Bug,漏洞 stage/prod Production environment in tencent has been deploy
Projects
None yet
Development

No branches or pull requests

5 participants