Cannot download jni files: https://publish.djl.ai/pytorch/1.13.1/jnilib/0.21.0/linux-aarch64/cpu-precxx11/libdjl_torch.so #2666

Black200000 · 2023-06-20T15:02:47Z

Black200000
Jun 20, 2023

DJLOfflineProblem

离线运行的Arm架构麒麟操作系统服务器：

CPU: Phytium,D2000/8 E8C
OS: Linux greatwall-pc 5.4.18-85-generic #74-KYLINOS SMP aarch64 GNU/Linux

项目地址：https://github.com/Black200000/DJLOfflineProblem.git

运行jar包的报错信息如下，求解答：

java -jar DJLOfflineProblem-arm64.jar

Cannot download jni files: https://publish.djl.ai/pytorch/1.13.1/jnilib/0.21.0/linux-aarch64/cpu-precxx11/libdjl_torch.so

Loading: 100% |████████████████████████████████████████|
Exception in thread "main" ai.djl.engine.EngineException: Cannot download jni files: https://publish.djl.ai/pytorch/1.13.1/jnilib/0.21.0/linux-aarch64/cpu-precxx11/libdjl_torch.so
at ai.djl.pytorch.jni.LibUtils.downloadJniLib(LibUtils.java:507)
at ai.djl.pytorch.jni.LibUtils.findJniLibrary(LibUtils.java:248)
at ai.djl.pytorch.jni.LibUtils.loadLibrary(LibUtils.java:80)
at ai.djl.pytorch.engine.PtEngine.newInstance(PtEngine.java:53)
at ai.djl.pytorch.engine.PtEngineProvider.getEngine(PtEngineProvider.java:40)
at ai.djl.engine.Engine.getEngine(Engine.java:187)
at ai.djl.Model.newInstance(Model.java:99)
at ai.djl.repository.zoo.BaseModelLoader.createModel(BaseModelLoader.java:191)
at ai.djl.repository.zoo.BaseModelLoader.loadModel(BaseModelLoader.java:154)
at ai.djl.repository.zoo.Criteria.loadModel(Criteria.java:172)
at org.example.Final.main(Final.java:46)

Caused by: java.net.UnknownHostException: publish.djl.ai
at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:196)
at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:394)
at java.net.Socket.connect(Socket.java:606)
at sun.security.ssl.SSLSocketImpl.connect(SSLSocketImpl.java:303)
at sun.security.ssl.BaseSSLSocketImpl.connect(BaseSSLSocketImpl.java:173)
at sun.net.NetworkClient.doConnect(NetworkClient.java:180)
at sun.net.www.http.HttpClient.openServer(HttpClient.java:499)
at sun.net.www.http.HttpClient.openServer(HttpClient.java:594)
at sun.net.www.protocol.https.HttpsClient.(HttpsClient.java:263)
at sun.net.www.protocol.https.HttpsClient.New(HttpsClient.java:366)
at sun.net.www.protocol.https.AbstractDelegateHttpsURLConnection.getNewHttpClient(AbstractDelegateHttpsURLConnection.java:207)
at sun.net.www.protocol.http.HttpURLConnection.plainConnect0(HttpURLConnection.java:1167)
at sun.net.www.protocol.http.HttpURLConnection.plainConnect(HttpURLConnection.java:1061)
at sun.net.www.protocol.https.AbstractDelegateHttpsURLConnection.connect(AbstractDelegateHttpsURLConnection.java:193)
at sun.net.www.protocol.http.HttpURLConnection.getInputStream0(HttpURLConnection.java:1584)
at sun.net.www.protocol.http.HttpURLConnection.getInputStream(HttpURLConnection.java:1512)
at sun.net.www.protocol.https.HttpsURLConnectionImpl.getInputStream(HttpsURLConnectionImpl.java:268)
at java.net.URL.openStream(URL.java:1092)
at ai.djl.util.Utils.openUrl(Utils.java:461)
at ai.djl.util.Utils.openUrl(Utils.java:445)
at ai.djl.pytorch.jni.LibUtils.downloadJniLib(LibUtils.java:501)
... 10 more

另外求解答https://github.com/deepjavalibrary/djl-demo/tree/master/development/fatjar 离线运行jar包的核心要点，

mvn package
mvn exec:java -Doffline=true

我执行了这两条命令还是无法离线运行jar包

我有注意到 copy ~/.djl.ai folder to your offline computer 的解决方案，请问~/.djl.ai如何下载？放在服务器哪个目录下呢？

frankfliu · 2023-06-20T18:43:43Z

frankfliu
Jun 20, 2023

@Black200000

I just tried your git repo, I remove maven-assembly-plugin and replaced it with maven-shade-plugin:

<?xml version="1.0" encoding="UTF-8"?>

<project xmlns="http://maven.apache.org/POM/4.0.0" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance"
         xsi:schemaLocation="http://maven.apache.org/POM/4.0.0 http://maven.apache.org/xsd/maven-4.0.0.xsd">
    <modelVersion>4.0.0</modelVersion>

    <groupId>org.example</groupId>
    <artifactId>DJLOfflineProblem</artifactId>
    <version>arm64</version>
    <name>DJLOfflineProblem</name>

    <properties>
        <project.build.sourceEncoding>UTF-8</project.build.sourceEncoding>
        <maven.compiler.source>1.7</maven.compiler.source>
        <maven.compiler.target>1.7</maven.compiler.target>
    </properties>

    <dependencies>
        <!--arm64-->
        <dependency>
            <groupId>ai.djl.pytorch</groupId>
            <artifactId>pytorch-native-cpu-precxx11</artifactId>
            <classifier>linux-aarch64</classifier>
            <scope>runtime</scope>
            <version>1.13.1</version>
        </dependency>
        <dependency>
            <groupId>ai.djl.pytorch</groupId>
            <artifactId>pytorch-jni</artifactId>
            <version>1.13.1-0.22.1</version>
            <scope>runtime</scope>
        </dependency>
        <dependency>
            <groupId>ai.djl</groupId>
            <artifactId>api</artifactId>
            <version>0.21.0</version>
        </dependency>
        <dependency>
            <groupId>ai.djl.pytorch</groupId>
            <artifactId>pytorch-engine</artifactId>
            <version>0.21.0</version>
            <scope>runtime</scope>
        </dependency>
        <!--pytorch结束-->
        <dependency>
            <groupId>com.alibaba</groupId>
            <artifactId>fastjson</artifactId>
            <version>1.2.83</version>
        </dependency>
        <dependency>
            <groupId>org.projectlombok</groupId>
            <artifactId>lombok</artifactId>
            <version>1.18.24</version>
            <scope>provided</scope>
        </dependency>
        <dependency>
            <groupId>org.slf4j</groupId>
            <artifactId>slf4j-nop</artifactId>
            <version>1.7.2</version>
            <type>jar</type>
        </dependency>
    </dependencies>

    <build>
        <plugins>
            <plugin>
                <groupId>org.apache.maven.plugins</groupId>
                <artifactId>maven-jar-plugin</artifactId>
                <version>3.2.2</version>
                <configuration>
                    <archive>
                        <manifest>
                            <addClasspath>true</addClasspath>
                            <mainClass>org.example.Final</mainClass> <!-- 此处为主入口-->
                        </manifest>
                    </archive>
                </configuration>
            </plugin>
            <plugin>
                <groupId>org.springframework.boot</groupId>
                <artifactId>spring-boot-maven-plugin</artifactId>
                <version>2.6.12</version>
                <executions>
                    <execution>
                        <goals>
                            <goal>repackage</goal>
                        </goals>
                    </execution>
                </executions>
            </plugin>
            <plugin>
                <artifactId>maven-compiler-plugin</artifactId>
                <version>3.6.1</version>
                <configuration>
                    <source>1.8</source>
                    <target>1.8</target>
                </configuration>
            </plugin>
            <plugin>
                <groupId>org.apache.maven.plugins</groupId>
                <artifactId>maven-shade-plugin</artifactId>
                <configuration>
                    <transformers>
                        <transformer
                                implementation="org.apache.maven.plugins.shade.resource.ServicesResourceTransformer"/>
                    </transformers>
                </configuration>
                <executions>
                    <execution>
                        <phase>package</phase>
                        <goals>
                            <goal>shade</goal>
                        </goals>
                    </execution>
                </executions>
            </plugin>
        </plugins>
    </build>
</project>

This pom.xml works for me:

mvn package
java -jar target/DJLOfflineProblem-arm64.jar -Doffline=true

ndList: NDList size: 2
0 : (1, 62) float32
1 : (1, 40, 32) float32

ndArray: ND: (1, 62) cpu() float32
[[-0.0165,  0.5067, -1.5517,  0.2482, -2.4336, -1.0246,  3.1444,  2.9454,  4.0354, -3.8012,  0.6111,  1.5111,  1.5103, -0.1432, -0.0769,  0.2366, -0.4276, -0.1074,  0.7391,  0.2894, ... 42 more],
]

1 reply

Black200000 Jun 21, 2023
Author

Thanks for your help, I have followed your pom.xml. But I have a question,

how to package all dependencies into a jar package and deploy the jar package successfully to an offline machine which without ai.djl cache file? I have writed in this discussion.

frankfliu · 2023-06-20T18:46:02Z

frankfliu
Jun 20, 2023

@Black200000

For the fatjar demo, did you change the classifier for your platform? In the demo it was pointing to osx-aarch64, you should change it to linux-aarch64 and change to -precxx11 package

What's the error message did you see when you try it?

0 replies

frankfliu · 2023-06-20T18:48:52Z

frankfliu
Jun 20, 2023

The ~/.djl.ai will be created during runtime on your machine (has network). After you successfully run your application, necessary native files will be cached in this folder. Then you can copy this folder to your target offline machine. See: https://docs.djl.ai/master/docs/development/cache_management.html

You can change cache directory to any folder.

1 reply

Black200000 Jun 21, 2023
Author

Thanks very much. I have tried this way on windows and linux, both work well.

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Cannot download jni files: https://publish.djl.ai/pytorch/1.13.1/jnilib/0.21.0/linux-aarch64/cpu-precxx11/libdjl_torch.so #2666

{{title}}

{{editor}}'s edit

{{editor}}'s edit

Replies: 3 comments 2 replies

{{title}}

{{title}}

{{editor}}'s edit

{{editor}}'s edit

{{title}}

{{title}}

{{editor}}'s edit

{{editor}}'s edit

{{title}}

Select a reply

Cannot download jni files: https://publish.djl.ai/pytorch/1.13.1/jnilib/0.21.0/linux-aarch64/cpu-precxx11/libdjl_torch.so #2666

Black200000 Jun 20, 2023

DJLOfflineProblem

java -jar DJLOfflineProblem-arm64.jar

另外求解答https://github.com/deepjavalibrary/djl-demo/tree/master/development/fatjar 离线运行jar包的核心要点，

我有注意到 copy ~/.djl.ai folder to your offline computer 的解决方案，请问~/.djl.ai如何下载？放在服务器哪个目录下呢？

Replies: 3 comments · 2 replies

frankfliu Jun 20, 2023

Black200000 Jun 21, 2023 Author

how to package all dependencies into a jar package and deploy the jar package successfully to an offline machine which without ai.djl cache file? I have writed in this discussion.

frankfliu Jun 20, 2023

frankfliu Jun 20, 2023

Black200000 Jun 21, 2023 Author

Black200000
Jun 20, 2023

Replies: 3 comments 2 replies

frankfliu
Jun 20, 2023

Black200000 Jun 21, 2023
Author

frankfliu
Jun 20, 2023

frankfliu
Jun 20, 2023

Black200000 Jun 21, 2023
Author