The unit test result did not reach the expected object store #3272

zhijian-pro · 2023-02-28T10:26:07Z

I tested all of the supported object stores( include file tikv redis pg and mysql etc), and the following is a list of exception results to watch out for.

UFile: This is a us3 overwrite upload bug
Azure: not supported by the server
B2 object/b2: fix b2 get empty file info #3274
BOS object/obs&tos : fix range get #3270
HDFS: HDFS server does not support : and other characters.
OOS object/s3: set delimiter when it is not empty string #3273
MySQL object/sql:change MySQL column type to store special characters #3299 object/sql: fix SQL parameter types #3303
Disk object/file: support get object with the offset out of range #3301

TestUFile

=== RUN   TestUFile
    object_storage_test.go:87: PUT testEncodeFile failed: parse "https://zhijian-test4.cn-wlcb.ufileos.com/unit-test/测试编码文件{\"name\":\"zhijian\"}\x1f": net/url: invalid control character in URL
    object_storage_test.go:232: list api error: not supported delimiter
3 
    object_storage_test.go:330: CompleteMultipart failed: CompleteMultipart: status: 400, message: {"RetCode":-148669, "ErrMsg":"validate initidx and partlist [zhijian-test4:c5a134b6-9899-4692-8e6f-4fa8ad6a361d] failed, err: invalid middle block size"}
--- FAIL: TestUFile (14.17s)

TestAzure

=== RUN   TestAzure
    object_storage_test.go:87: PUT testEncodeFile failed: ===== INTERNAL ERROR =====
        ===== INTERNAL ERROR =====
        PUT https://zhijiantest1.blob.core.windows.net/testbucket1/unit-test/测试编码文件{"name":"zhijian"}�
        --------------------------------------------------------------------------------
        RESPONSE 400: 400 Bad Request
        ERROR CODE UNAVAILABLE
        --------------------------------------------------------------------------------
        <!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 4.01//EN""http://www.w3.org/TR/html4/strict.dtd">
        <HTML><HEAD><TITLE>Bad Request</TITLE>
        <META HTTP-EQUIV="Content-Type" Content="text/html; charset=us-ascii"></HEAD>
        <BODY><h2>Bad Request - Invalid URL</h2>
        <hr><p>HTTP Error 400. The request URL is invalid.</p>
        </BODY></HTML>
        
        --------------------------------------------------------------------------------
    object_storage_test.go:232: list api error: not supported delimiter
    object_storage_test.go:340: wasb://testbucket1/unit-test/ does not support multipart upload: not supported
--- PASS: TestAzure (75.78s)
PASS

TestB2

=== RUN   TestB2
    object_storage_test.go:87: PUT testEncodeFile failed: bad_request: File names must not contain unicode characters with codes less than 32
    object_storage_test.go:340: b2://zhijian-dev/unit-test/ does not support multipart upload: not supported
    object_storage_test.go:357: delete slash/ failed range_not_satisfiable: byte range bytes=0-1 for a file of length 0
    object_storage_test.go:346: delete empty file failed: range_not_satisfiable: byte range bytes=0-1 for a file of length 0
--- PASS: TestB2 (124.78s)

TestBOS

=== RUN   TestBOS
    object_storage_test.go:92: List testEncodeFile Failed: expect key 测试编码文件{"name":"zhijian"}�, but got 测试编码文件{"name":"zhijian"}_
1 
--- PASS: TestBOS (19.76s)

TestHDFS

=== RUN   TestHDFS
    object_storage_test.go:87: PUT testEncodeFile failed: create /unit-test/.测试编码文件{"name":"zhijian"}�.tmp.5495815735913262218: create call failed with ERROR_APPLICATION (org.apache.hadoop.fs.InvalidPathException)
    object_storage_test.go:234: list api error: not supported
    object_storage_test.go:342: hdfs://localhost:8020/unit-test/ does not support multipart upload: not supported
--- PASS: TestHDFS (1.00s)

TestOOS

=== RUN   TestOOS
    object_storage_test.go:73: Can't create bucket oos://zhijian-dev2/: please create bucket zhijian-dev2 manually
--- FAIL: TestOOS (0.29s)

TestMySQL

=== RUN   TestMySQL
    object_storage_test.go:87: PUT testEncodeFile failed: Error 1267: Illegal mix of collations (latin1_swedish_ci,IMPLICIT) and (utf8mb4_general_ci,COERCIBLE) for operation '='
    object_storage_test.go:234: list api error: not supported delimiter
    object_storage_test.go:342: mysql://(localhost:3306)/test2/unit-test/ does not support multipart upload: not supported
--- PASS: TestMySQL (0.71s)

=== RUN TestDisk
object_storage_test.go:139: out-of-range get: '', but got 0, error: EOF
object_storage_test.go:234: list api error: not supported
object_storage_test.go:342: file:///tmp/abc/unit-test/ does not support multipart upload: not supported
--- PASS: TestDisk (0.03s)

The text was updated successfully, but these errors were encountered:

zhijian-pro · 2023-03-09T06:19:23Z

All object stores have been processed

This was referenced Feb 28, 2023

object/s3: set delimiter when it is not empty string #3273

Merged

object/b2: fix b2 get empty file info #3274

Merged

zhijian-pro self-assigned this Mar 5, 2023

This was referenced Mar 7, 2023

fix MultipartUpload test #3298

Closed

object/sql:change MySQL column type to store special characters #3299

Merged

zhijian-pro closed this as completed Mar 9, 2023

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

The unit test result did not reach the expected object store #3272

The unit test result did not reach the expected object store #3272

zhijian-pro commented Feb 28, 2023 •

edited

Loading

zhijian-pro commented Mar 9, 2023

The unit test result did not reach the expected object store #3272

The unit test result did not reach the expected object store #3272

Comments

zhijian-pro commented Feb 28, 2023 • edited Loading

I tested all of the supported object stores( include file tikv redis pg and mysql etc), and the following is a list of exception results to watch out for.

TestUFile

TestAzure

TestB2

TestBOS

TestHDFS

TestOOS

TestMySQL

zhijian-pro commented Mar 9, 2023

zhijian-pro commented Feb 28, 2023 •

edited

Loading