Tracking issues of OpenDAL capability migration

[Xuanwo]

Please leave comments on the task you want to take, have fun!

---

#2057 introduces a new concept of capability. With which we can represents a service capability:

• Whether current Operator supports read or not.
• Whether current Operator supports read with if match or not.
• What’s current Operator max supports batch operations count.

However, most of our code are not migrated to capability yet.

Migrate service capability

We used to use read to cover read/stat and use write to cover write/delete/create_dir. In capability, we split them all, so we need to check and add them. Also, some newly added args are not covered.

So, we need to:

• Add missing operations for services, like stat, delete and create_dir.
• Add missing args for services, like stat_with_if_match

The final version should be like azblob:

https://github.com/apache/incubator-opendal/blob/80ab41940d1e8835ef611b9906c21d8734b63cf9/core/src/services/azblob/backend.rs#L454-L472

We need to check for all services:

• azdfs
• dashmap
• fs
• ftp
• gcs
• ghac
• hdfs
• http
• ipfs
• ipmfs
• memcached
• memory
• moka
• obs
• oss
• redis
• rocksdb
• s3
• sled
• wasabi
• webdav
• webhdfs

Add new tests

After new capability like read_if_match added, we can write behavior tests on them.

For example, we can design a test of read_if_match like:

• Return directly if read_if_match is false
• Create new file
• Stat to get it's etag
• Read file with correct etag should be ok
• Read file with wrong etag should return PreconditionFailed error

Tasks:

• Implement Operator::capability (this task should be finished first)
• Add test for stat with if-match: core: Add behavior test for read_with_if_match & stat_with_if_match #2088
• Add test for stat with if-none-match: feat(core): add test for stat_with_if_none_match #2122
• Add test for read with if-match: core: Add behavior test for read_with_if_match & stat_with_if_match #2088
• Add test for read with if-none-match #2091 test(core): test for read_with_if_none_match #2141
• Add test for read with override_cache_control test(core): test for read_with_override_cache_control #2155
• Add test for read with override_content_disposition feat(core): test for read_with_override_content_composition #2067
• Add test for write with content_type test(core): test for write_with_content_type #2140
• Add test for write with cache_control test(core): test for write_with_cache_control #2131

[Xuanwo]

Hi, @STRRL, this issue will address the behavior tests for if-match, maybe you wanna to take a look?

[suyanhanx]

Seems that we could implement Capability and add tests for them one by one.