You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
I had searched in the issues and found no similar issues.
What happened
When running flink jar task with a resource which is stored in hdfs,taier can not download jar from hdfs successfully.And it makes flink jobs run fail.
What you expected to happen
I have seen the source code and debug,found that the reason for this problem is related to StreamSqlFormatService#generateAddJarSql(String,String) and FileSystemManager#downloadFile(...)
StreamSqlFormatService will replace hdfs://localhost:9820 to hdfs:/localhost:9820,
When I return resource url directly, here comes the second question: FileSystemManager will remove prefix(hdfs://), which make url to localhost:9820.Of course,HdfsFileManage download fail
How to reproduce
follow below steps can produce this problem:
upload a flink application jar and choose hdfs storage
Search before asking
What happened
When running flink jar task with a resource which is stored in hdfs,taier can not download jar from hdfs successfully.And it makes flink jobs run fail.
What you expected to happen
I have seen the source code and debug,found that the reason for this problem is related to
StreamSqlFormatService#generateAddJarSql(String,String)
andFileSystemManager#downloadFile(...)
StreamSqlFormatService
will replace hdfs://localhost:9820 to hdfs:/localhost:9820,When I return resource url directly, here comes the second question:
FileSystemManager
will remove prefix(hdfs://), which make url tolocalhost:9820
.Of course,HdfsFileManage
download failHow to reproduce
follow below steps can produce this problem:
Anything else
No response
Version
master
Are you willing to submit PR?
Code of Conduct
The text was updated successfully, but these errors were encountered: