OPSaid – 对象存储

Docs: 关键术语

Wed, 14 Jun 2023 10:53:20 +0800

简要概述

主要对对象存储一些基本概念做个介绍。

关键术语

术语	中文名	示例
endpoint	访问域名	s3.amazonaws.com、ds.test.opsaid.net
region	存储地域	cn-guangzhou
request_style	请求风格	Virtual hosted‐style 或 path‐style（不建议）
object_key	对象名称	hello/test.txt
bucket	存储桶	uptime
signature version	签名版本	支持 v4、v2

签名版本

标准 S3 有两种签名方式，分布为版本2、版本4。

计算 v2

Authorization = "AWS" + " " + AWSAccessKeyId + ":" + Signature;

Signature = Base64( HMAC-SHA1( UTF-8-Encoding-Of(YourSecretAccessKey), UTF-8-Encoding-Of( StringToSign ) ) );

StringToSign = HTTP-Verb + "\n" +
 Content-MD5 + "\n" +
 Content-Type + "\n" +
 Date + "\n" +
 CanonicalizedAmzHeaders +
 CanonicalizedResource;

CanonicalizedResource = [ "/" + Bucket ] +
 <HTTP-Request-URI, from the protocol name up to the query string> +
 [ subresource, if present. For example "?acl", "?location", or "?logging"];

CanonicalizedAmzHeaders = <described below>

其中 CanonicalizedAmzHeaders 遵守如下计算方式：

步骤
将每个 HTTP 标头名称转换为小写。例如，“X-Amz-Date”改为“x-amz-date”
根据标头名称按字典顺序排列标头集
将相同名称的标头字段合并为一个“header-name:comma-separated-value-list”对，并按照 RFC 2616 中第 4.2 节中的规定，两个值之间不留空格。例如，可以将元数据标头“x-amz-meta-username: fred”和“x-amz-meta-username: barney”合并为单个标头“x-amz-meta-username: fred,barney”
通过将折叠空格（包括新建行）替换为单个空格，“展开”跨多个行的长标头（按照 RFC 2616 中第 4.2 节允许的方式）
删除标头中冒号周围的空格。例如，标头“x-amz-meta-username: fred,barney”改为“x-amz-meta-username:fred,barney”
最后，请向生成的列表中的每个标准化标头附加换行字符 (U+000A)。通过将此列表中所有的标头规范化为单个字符串，构建 CanonicalizedResource 元素

计算 v4

HTTP Authorization 请求头示例如下（增加换行是为了方便阅读，实际为空字符串）：

Authorization: AWS4-HMAC-SHA256
Credential=AKIAIOSFODNN7EXAMPLE/20130524/us-east-1/s3/aws4_request,
SignedHeaders=host;range;x-amz-date,
Signature=fe5f80f77d5fa3beca038a248ff027d0445342fe2855ddc963176630326f1024

字段名称	描述
AWS4-HMAC-SHA256	使用版本 v4 签名，固定值
Credential	用户 AccessKeyId和范围信息，格式：{your-access-key-id}/{date:YYYYMMDD}/{region}/s3/aws4_request
SignedHeaders	已签名请求头的列表，只需包含请求头名字，用分号分隔，必须全部小写，并按字符顺序对其进行排序
Signature	计算出的256位签名信息，以64个小写十六进制字符串形式表示

TODO;

数据结构

Object

// An object consists of data and its descriptive metadata.
type Object struct {
 _ struct{} `type:"structure"`

 // The algorithm that was used to create a checksum of the object.
 ChecksumAlgorithm []*string `type:"list" flattened:"true" enum:"ChecksumAlgorithm"`

 // The entity tag is a hash of the object. The ETag reflects changes only to
 // the contents of an object, not its metadata. The ETag may or may not be an
 // MD5 digest of the object data. Whether or not it is depends on how the object
 // was created and how it is encrypted as described below:
 //
 // * Objects created by the PUT Object, POST Object, or Copy operation, or
 // through the AWS Management Console, and are encrypted by SSE-S3 or plaintext,
 // have ETags that are an MD5 digest of their object data.
 //
 // * Objects created by the PUT Object, POST Object, or Copy operation, or
 // through the AWS Management Console, and are encrypted by SSE-C or SSE-KMS,
 // have ETags that are not an MD5 digest of their object data.
 //
 // * If an object is created by either the Multipart Upload or Part Copy
 // operation, the ETag is not an MD5 digest, regardless of the method of
 // encryption.
 ETag *string `type:"string"`

 // The name that you assign to an object. You use the object key to retrieve
 // the object.
 Key *string `min:"1" type:"string"`

 // The date the Object was Last Modified
 LastModified *time.Time `type:"timestamp"`

 // The owner of the object
 Owner *Owner `type:"structure"`

 // Size in bytes of the object
 Size *int64 `type:"integer"`

 // The class of storage used to store the object.
 StorageClass *string `type:"string" enum:"ObjectStorageClass"`
}

常用接口

以下 HTTP 接口均以虚拟主机风格展示。

Bucket 相关

AWS S3 接口	HTTP 接口	说明
CreateBucket	PUT {bucket}.{endpoint}/	创建存储桶
HeadBucket	HEAD {bucket}.{endpoint}/	验证存储桶是否存在或是否有权限
DeleteBucket	DELETE {bucket}.{endpoint}/	删除存储桶
ListBuckets	GET {endpoint}/	列出有权限的存储桶
GetBucketLocation	GET /?location	查询当前 bucket 所在区域

Object 相关

AWS S3 接口	HTTP 接口	说明
CopyObject	PUT {bucket}.{endpoint}/{object_key}	拷贝对象
DeleteObject	DELETE {bucket}.{endpoint}/{object_key}	删除对象
DeleteObjects	POST {bucket}.{endpoint}/?delete	批量删除
GetObject	GET {bucket}.{endpoint}/{object_key}	获取对象
HeadObject	GET {bucket}.{endpoint}/{object_key}	查询对象
ListObjects	GET {bucket}.{endpoint}/?delimiter=	列出对象
ListObjectsV2	GET {bucket}.{endpoint}/?list-type=2	列出对象
PutObject	PUT {bucket}.{endpoint}/{object_key}	创建对象

分片相关

AWS S3 接口	HTTP 接口	说明
CreateMultipartUpload	POST {bucket}.{endpoint}/{object_key}?uploads	xx
UploadPart	PUT {bucket}.{endpoint}/{object_key}	xx
CompleteMultipartUpload	POST {bucket}.{endpoint}/{object_key}?uploadId=	xx
AbortMultipartUpload	DELETE {bucket}.{endpoint}/{object_key}?uploadId=	xx
UploadPartCopy	PUT {bucket}.{endpoint}/{object_key}?partNumber=&uploadId=	xx
ListMultipartUploads	GET {bucket}.{endpoint}/?uploads	xx
ListParts	GET {bucket}.{endpoint}/{object_key}?max-parts=&part-number-marker=&uploadId=	xx

Docs: 云提供商

Fri, 16 Jun 2023 16:25:52 +0800

简要概述

当前支持 S3 标准接口的服务。

存储提供商

大陆公有云

主要兼容 S3 接口的对象存储服务：

名称	免费空间（GB）	存储空间（元/GB/月）	免费出流量	下载流量（元/GB/月）
阿里云 OSS	5	0.12	5	0.50
青云 QingStor	10	0.147	1	0.45
移动云 ECOS	-	0.12	-	0.4
华为云 OBS	-	0.099	-	0.50
网易数帆 NOS	50	0.123	20	0.45
腾讯云 COS	50	0.099	10	0.50
七牛云 Kodo	10	0.098	10	0.26

海外公有云

名称	免费空间（GB）	存储空间（元/GB/月）	免费出流量	下载流量（元/GB/月）
Amazon S3	10	0.154	TODO;	0.026
Backblaze B2	10	0.035	TODO;	0.07
Cloudflare R2	10	0.105	-	-
ArvanCloud AOS	5	0.16	20	0.094
DigitalOcean Spaces	-	0.14	-	0.07

自建私有云

主要兼容 S3 接口的对象存储服务：

名称	免费空间（GB）	存储空间（元/GB/月）	免费出流量	下载流量（元/GB/月）
Ceph	-	-	-	-

Docs: 接口：CreateBucket

Mon, 19 Jun 2023 11:00:32 +0800

简要概述

创建存储桶，官方文档。

接口解析

请求语法

PUT / HTTP/1.1

Host: {bucket}.{endpoint}

x-amz-acl: ACL
x-amz-grant-full-control: GrantFullControl
x-amz-grant-read: GrantRead
x-amz-grant-read-acp: GrantReadACP
x-amz-grant-write: GrantWrite
x-amz-grant-write-acp: GrantWriteACP
x-amz-bucket-object-lock-enabled: ObjectLockEnabledForBucket
x-amz-object-ownership: ObjectOwnership

<?xml version="1.0" encoding="UTF-8"?>
<CreateBucketConfiguration xmlns="http://s3.amazonaws.com/doc/2006-03-01/">
 <LocationConstraint>string</LocationConstraint>
</CreateBucketConfiguration>

URL 参数

TODO;

请求结构

TODO;

响应语法

HTTP/1.1 200

Location: Location

请求示例

通过 rclone 进行测试

测试指令

请求响应

Docs: 接口：GetBucketLocation

Mon, 19 Jun 2023 11:00:32 +0800

简要概述

查询桶所在区域，官方文档。

接口解析

请求语法

GET /?location HTTP/1.1

Host: {bucket}.{endpoint}

URL 参数

TODO;

请求结构

TODO;

响应语法

HTTP/1.1 200

<?xml version="1.0" encoding="UTF-8"?>
<LocationConstraint>
 <LocationConstraint>string</LocationConstraint>
</LocationConstraint>

请求示例

通过 rclone 进行测试

测试指令

请求响应

Docs: 接口：HeadBucket

Mon, 19 Jun 2023 11:00:32 +0800

简要概述

查看存储桶，官方文档。

接口解析

请求语法

HEAD / HTTP/1.1

Host: {bucket}.{endpoint}

x-amz-expected-bucket-owner: ExpectedBucketOwner

URL 参数

TODO;

请求结构

无。

响应语法

HTTP/1.1 200

请求示例

通过 rclone 进行测试

测试指令

请求响应

Docs: 接口：DeleteBucket

Mon, 19 Jun 2023 11:00:32 +0800

简要概述

删除存储桶，官方文档。

接口解析

请求语法

DELETE / HTTP/1.1

Host: {bucket}.{endpoint}

x-amz-expected-bucket-owner: ExpectedBucketOwner

URL 参数

TODO;

请求结构

无。

响应语法

HTTP/1.1 204

请求示例

通过 rclone 进行测试

测试指令

请求响应

Docs: 接口：ListBuckets

Mon, 19 Jun 2023 11:00:32 +0800

简要概述

列出该用户可访问的存储桶，官方文档。

接口解析

请求语法

GET / HTTP/1.1
Host: {endpoint}

URL 参数

无。

请求结构

无。

响应语法

HTTP/1.1 200

<?xml version="1.0" encoding="UTF-8"?>
<ListAllMyBucketsResult>
 <Buckets>
 <Bucket>
 <CreationDate>timestamp</CreationDate>
 <Name>string</Name>
 </Bucket>
 </Buckets>
 <Owner>
 <DisplayName>string</DisplayName>
 <ID>string</ID>
 </Owner>
</ListAllMyBucketsResult>

请求示例

通过 rclone 进行测试

测试指令

./rclone \
 --dump bodies \
 --s3-force-path-style=false \
 lsd \
 minio:

请求响应

2023/06/21 14:46:45 DEBUG : >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
2023/06/21 14:46:45 DEBUG : HTTP REQUEST (req 0x14000134300)
2023/06/21 14:46:45 DEBUG : GET / HTTP/1.1
Host: minio.dev.173ops.com
User-Agent: rclone/v1.62.2
Authorization: XXXX
X-Amz-Content-Sha256: e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855
X-Amz-Date: 20230621T064645Z
Accept-Encoding: gzip

2023/06/21 14:46:45 DEBUG : >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
2023/06/21 14:46:45 DEBUG : <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
2023/06/21 14:46:45 DEBUG : HTTP RESPONSE (req 0x14000134300)
2023/06/21 14:46:45 DEBUG : HTTP/1.1 200 OK
Content-Length: 462
Accept-Ranges: bytes
Connection: keep-alive
Content-Security-Policy: block-all-mixed-content
Content-Type: application/xml
Date: Wed, 21 Jun 2023 06:46:45 GMT
Server: nginx/1.16.1
Strict-Transport-Security: max-age=31536000; includeSubDomains
Vary: Origin
Vary: Accept-Encoding
X-Amz-Id-2: dd9025bab4ad464b049177c95eb6ebf374d3b3fd1af9251148b658df7ac2e3e8
X-Amz-Request-Id: 176A99B34DCCDFA0
X-Content-Type-Options: nosniff
X-Xss-Protection: 1; mode=block

<?xml version="1.0" encoding="UTF-8"?>
<ListAllMyBucketsResult
 xmlns="http://s3.amazonaws.com/doc/2006-03-01/">
 <Owner>
 <ID>02d6176db174dc93cb1b899f7c6078f08654445fe8cf1b6ce98d8855f66bdbf4</ID>
 <DisplayName>minio</DisplayName>
 </Owner>
 <Buckets>
 <Bucket>
 <Name>is-a-big-tenant</Name>
 <CreationDate>2023-06-14T10:10:39.152Z</CreationDate>
 </Bucket>
 <Bucket>
 <Name>uptime</Name>
 <CreationDate>2023-06-20T10:25:49.245Z</CreationDate>
 </Bucket>
 </Buckets>
</ListAllMyBucketsResult>

2023/06/21 14:46:45 DEBUG : <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

Docs: 接口：CopyObject

Mon, 19 Jun 2023 11:00:32 +0800

简要概述

拷贝文件官方文档

接口解析

请求语法

PUT /{object_key} HTTP/1.1

Host: {bucket}.{endpoint}

x-amz-acl: ACL
Cache-Control: CacheControl
x-amz-checksum-algorithm: ChecksumAlgorithm
Content-Disposition: ContentDisposition
Content-Encoding: ContentEncoding
Content-Language: ContentLanguage
Content-Type: ContentType
x-amz-copy-source: CopySource
x-amz-copy-source-if-match: CopySourceIfMatch
x-amz-copy-source-if-modified-since: CopySourceIfModifiedSince
x-amz-copy-source-if-none-match: CopySourceIfNoneMatch
x-amz-copy-source-if-unmodified-since: CopySourceIfUnmodifiedSince
Expires: Expires
x-amz-grant-full-control: GrantFullControl
x-amz-grant-read: GrantRead
x-amz-grant-read-acp: GrantReadACP
x-amz-grant-write-acp: GrantWriteACP
x-amz-metadata-directive: MetadataDirective
x-amz-tagging-directive: TaggingDirective
x-amz-server-side-encryption: ServerSideEncryption
x-amz-storage-class: StorageClass
x-amz-website-redirect-location: WebsiteRedirectLocation
x-amz-server-side-encryption-customer-algorithm: SSECustomerAlgorithm
x-amz-server-side-encryption-customer-key: SSECustomerKey
x-amz-server-side-encryption-customer-key-MD5: SSECustomerKeyMD5
x-amz-server-side-encryption-aws-kms-key-id: SSEKMSKeyId
x-amz-server-side-encryption-context: SSEKMSEncryptionContext
x-amz-server-side-encryption-bucket-key-enabled: BucketKeyEnabled
x-amz-copy-source-server-side-encryption-customer-algorithm: CopySourceSSECustomerAlgorithm
x-amz-copy-source-server-side-encryption-customer-key: CopySourceSSECustomerKey
x-amz-copy-source-server-side-encryption-customer-key-MD5: CopySourceSSECustomerKeyMD5
x-amz-request-payer: RequestPayer
x-amz-tagging: Tagging
x-amz-object-lock-mode: ObjectLockMode
x-amz-object-lock-retain-until-date: ObjectLockRetainUntilDate
x-amz-object-lock-legal-hold: ObjectLockLegalHoldStatus
x-amz-expected-bucket-owner: ExpectedBucketOwner
x-amz-source-expected-bucket-owner: ExpectedSourceBucketOwner

URL 参数

名称	类型	是否必须	示例	说明

请求结构

无。

响应语法

HTTP/1.1 200

x-amz-expiration: Expiration
x-amz-copy-source-version-id: CopySourceVersionId
x-amz-version-id: VersionId
x-amz-server-side-encryption: ServerSideEncryption
x-amz-server-side-encryption-customer-algorithm: SSECustomerAlgorithm
x-amz-server-side-encryption-customer-key-MD5: SSECustomerKeyMD5
x-amz-server-side-encryption-aws-kms-key-id: SSEKMSKeyId
x-amz-server-side-encryption-context: SSEKMSEncryptionContext
x-amz-server-side-encryption-bucket-key-enabled: BucketKeyEnabled
x-amz-request-charged: RequestCharged
<?xml version="1.0" encoding="UTF-8"?>
<CopyObjectResult>
 <ETag>string</ETag>
 <LastModified>timestamp</LastModified>
 <ChecksumCRC32>string</ChecksumCRC32>
 <ChecksumCRC32C>string</ChecksumCRC32C>
 <ChecksumSHA1>string</ChecksumSHA1>
 <ChecksumSHA256>string</ChecksumSHA256>
</CopyObjectResult>

响应参数

名称	类型	示例	说明

请求示例

通过 rclone 进行测试

测试指令

./rclone \
 --dump bodies \
 --s3-force-path-style=false \
 moveto \
 minio:uptime/hello/a.txt minio:uptime/copy/from/hello-a.txt

请求响应

2023/06/21 13:53:53 DEBUG : >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
2023/06/21 13:53:53 DEBUG : HTTP REQUEST (req 0x14000828400)
2023/06/21 13:53:53 DEBUG : PUT /copy/from/hello-a.txt HTTP/1.1
Host: uptime.minio.dev.173ops.com
User-Agent: rclone/v1.62.2
Content-Length: 0
Authorization: XXXX
X-Amz-Acl: default
X-Amz-Content-Sha256: e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855
X-Amz-Copy-Source: uptime/hello/a.txt
X-Amz-Date: 20230621T055353Z
X-Amz-Metadata-Directive: COPY
Accept-Encoding: gzip

2023/06/21 13:53:53 DEBUG : >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
2023/06/21 13:53:53 DEBUG : <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
2023/06/21 13:53:53 DEBUG : HTTP RESPONSE (req 0x14000828400)
2023/06/21 13:53:53 DEBUG : HTTP/1.1 200 OK
Content-Length: 232
Accept-Ranges: bytes
Connection: keep-alive
Content-Security-Policy: block-all-mixed-content
Content-Type: application/xml
Date: Wed, 21 Jun 2023 05:53:53 GMT
Etag: "6f5902ac237024bdd0c176cb93063dc4"
Server: nginx/1.16.1
Strict-Transport-Security: max-age=31536000; includeSubDomains
Vary: Origin
Vary: Accept-Encoding
X-Amz-Id-2: dd9025bab4ad464b049177c95eb6ebf374d3b3fd1af9251148b658df7ac2e3e8
X-Amz-Request-Id: 176A96D09F8DB7C8
X-Content-Type-Options: nosniff
X-Xss-Protection: 1; mode=block

<?xml version="1.0" encoding="UTF-8"?>
<CopyObjectResult
 xmlns="http://s3.amazonaws.com/doc/2006-03-01/">
 <LastModified>2023-06-21T05:53:53.178Z</LastModified>
 <ETag>&#34;6f5902ac237024bdd0c176cb93063dc4&#34;</ETag>
</CopyObjectResult>

2023/06/21 13:53:53 DEBUG : <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

Docs: 接口：DeleteObject

Mon, 19 Jun 2023 11:00:32 +0800

简要概述

删除文件官方文档

接口解析

请求语法

DELETE /{object_key}?versionId= HTTP/1.1

Host: {bucket}.{endpoint}

x-amz-mfa: MFA
x-amz-request-payer: RequestPayer
x-amz-bypass-governance-retention: BypassGovernanceRetention
x-amz-expected-bucket-owner: ExpectedBucketOwner

URL 参数

名称	类型	是否必须	示例	说明

请求结构

无。

响应语法

HTTP/1.1 204

x-amz-delete-marker: DeleteMarker
x-amz-version-id: VersionId
x-amz-request-charged: RequestCharged

响应参数

名称	类型	示例	说明

请求示例

通过 rclone 进行测试

测试指令

./rclone \
 --dump bodies \
 --s3-force-path-style=false \
 deletefile \
 minio:uptime/copy/from/hello-a.txt

请求响应

2023/06/21 14:00:33 DEBUG : >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
2023/06/21 14:00:33 DEBUG : HTTP REQUEST (req 0x1400073a300)
2023/06/21 14:00:33 DEBUG : DELETE /copy/from/hello-a.txt HTTP/1.1
Host: uptime.minio.dev.173ops.com
User-Agent: rclone/v1.62.2
Authorization: XXXX
X-Amz-Content-Sha256: e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855
X-Amz-Date: 20230621T060033Z
Accept-Encoding: gzip

2023/06/21 14:00:33 DEBUG : >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
2023/06/21 14:00:33 DEBUG : <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
2023/06/21 14:00:33 DEBUG : HTTP RESPONSE (req 0x1400073a300)
2023/06/21 14:00:33 DEBUG : HTTP/1.1 204 No Content
Accept-Ranges: bytes
Connection: keep-alive
Content-Security-Policy: block-all-mixed-content
Date: Wed, 21 Jun 2023 06:00:33 GMT
Server: nginx/1.16.1
Strict-Transport-Security: max-age=31536000; includeSubDomains
Vary: Origin
Vary: Accept-Encoding
X-Amz-Id-2: dd9025bab4ad464b049177c95eb6ebf374d3b3fd1af9251148b658df7ac2e3e8
X-Amz-Request-Id: 176A972DD823EE60
X-Content-Type-Options: nosniff
X-Xss-Protection: 1; mode=block

2023/06/21 14:00:33 DEBUG : <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

Docs: 接口：DeleteObjects

Mon, 19 Jun 2023 11:00:32 +0800

简要概述

批量删除文件，官方文档。

接口解析

请求语法

POST /?delete HTTP/1.1

Host: {bucket}.{endpoint}

x-amz-mfa: MFA
x-amz-request-payer: RequestPayer
x-amz-bypass-governance-retention: BypassGovernanceRetention
x-amz-expected-bucket-owner: ExpectedBucketOwner
x-amz-sdk-checksum-algorithm: ChecksumAlgorithm
<?xml version="1.0" encoding="UTF-8"?>
<Delete xmlns="http://s3.amazonaws.com/doc/2006-03-01/">
 <Object>
 <Key>string</Key>
 <VersionId>string</VersionId>
 </Object>
 ...
 <Quiet>boolean</Quiet>
</Delete>

URL 参数

TODO;

请求结构

TODO;

响应语法

HTTP/1.1 200

x-amz-request-charged: RequestCharged

<?xml version="1.0" encoding="UTF-8"?>
<DeleteResult>
 <Deleted>
 <DeleteMarker>boolean</DeleteMarker>
 <DeleteMarkerVersionId>string</DeleteMarkerVersionId>
 <Key>string</Key>
 <VersionId>string</VersionId>
 </Deleted>
 ...
 <Error>
 <Code>string</Code>
 <Key>string</Key>
 <Message>string</Message>
 <VersionId>string</VersionId>
 </Error>
 ...
</DeleteResult>

请求示例

通过 rclone 进行测试

测试指令

请求响应

Docs: 接口：GetObject

Mon, 19 Jun 2023 11:00:32 +0800

简要概述

获取文件官方文档

接口解析

请求语法

GET /{object_key}?partNumber=&response-cache-control=&response-content-disposition=&response-content-encoding=&response-content-language=&response-content-type=&response-expires=&versionId= HTTP/1.1

Host: {bucket}.{endpoint}

If-Match: IfMatch
If-Modified-Since: IfModifiedSince
If-None-Match: IfNoneMatch
If-Unmodified-Since: IfUnmodifiedSince
Range: Range
x-amz-server-side-encryption-customer-algorithm: SSECustomerAlgorithm
x-amz-server-side-encryption-customer-key: SSECustomerKey
x-amz-server-side-encryption-customer-key-MD5: SSECustomerKeyMD5
x-amz-request-payer: RequestPayer
x-amz-expected-bucket-owner: ExpectedBucketOwner
x-amz-checksum-mode: ChecksumMode

URL 参数

名称	类型	是否必须	示例	说明

请求结构

无。

响应语法

HTTP/1.1 200

x-amz-delete-marker: DeleteMarker
accept-ranges: AcceptRanges
x-amz-expiration: Expiration
x-amz-restore: Restore
Last-Modified: LastModified
Content-Length: ContentLength
ETag: ETag
x-amz-checksum-crc32: ChecksumCRC32
x-amz-checksum-crc32c: ChecksumCRC32C
x-amz-checksum-sha1: ChecksumSHA1
x-amz-checksum-sha256: ChecksumSHA256
x-amz-missing-meta: MissingMeta
x-amz-version-id: VersionId
Cache-Control: CacheControl
Content-Disposition: ContentDisposition
Content-Encoding: ContentEncoding
Content-Language: ContentLanguage
Content-Range: ContentRange
Content-Type: ContentType
Expires: Expires
x-amz-website-redirect-location: WebsiteRedirectLocation
x-amz-server-side-encryption: ServerSideEncryption
x-amz-server-side-encryption-customer-algorithm: SSECustomerAlgorithm
x-amz-server-side-encryption-customer-key-MD5: SSECustomerKeyMD5
x-amz-server-side-encryption-aws-kms-key-id: SSEKMSKeyId
x-amz-server-side-encryption-bucket-key-enabled: BucketKeyEnabled
x-amz-storage-class: StorageClass
x-amz-request-charged: RequestCharged
x-amz-replication-status: ReplicationStatus
x-amz-mp-parts-count: PartsCount
x-amz-tagging-count: TagCount
x-amz-object-lock-mode: ObjectLockMode
x-amz-object-lock-retain-until-date: ObjectLockRetainUntilDate
x-amz-object-lock-legal-hold: ObjectLockLegalHoldStatus

Body

响应参数

名称	类型	示例	说明

请求示例

通过 rclone 进行测试

测试指令

./rclone \
 --dump bodies \
 --s3-force-path-style=false \
 cat \
 minio:uptime/test1/hello.txt

请求响应

2023/06/21 14:30:07 DEBUG : >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
2023/06/21 14:30:07 DEBUG : HTTP REQUEST (req 0x140009f2f00)
2023/06/21 14:30:07 DEBUG : GET /test1/hello.txt HTTP/1.1
Host: uptime.minio.dev.173ops.com
User-Agent: rclone/v1.62.2
Accept-Encoding: gzip
Authorization: XXXX
X-Amz-Content-Sha256: e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855
X-Amz-Date: 20230621T063007Z

2023/06/21 14:30:07 DEBUG : >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
2023/06/21 14:30:07 DEBUG : <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
2023/06/21 14:30:07 DEBUG : HTTP RESPONSE (req 0x140009f2f00)
2023/06/21 14:30:07 DEBUG : HTTP/1.1 200 OK
Content-Length: 7
Accept-Ranges: bytes
Connection: keep-alive
Content-Security-Policy: block-all-mixed-content
Content-Type: text/plain; charset=utf-8
Date: Wed, 21 Jun 2023 06:30:07 GMT
Etag: "5e9820c5fde06ad204bc506739059ea5"
Last-Modified: Wed, 21 Jun 2023 05:36:53 GMT
Server: nginx/1.16.1
Strict-Transport-Security: max-age=31536000; includeSubDomains
Vary: Origin
Vary: Accept-Encoding
X-Amz-Id-2: dd9025bab4ad464b049177c95eb6ebf374d3b3fd1af9251148b658df7ac2e3e8
X-Amz-Meta-Mtime: 1687253796
X-Amz-Request-Id: 176A98CACCF65700
X-Content-Type-Options: nosniff
X-Xss-Protection: 1; mode=block

ni hao
2023/06/21 14:30:07 DEBUG : <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

Docs: 接口：HeadObject

Mon, 19 Jun 2023 11:00:32 +0800

简要概述

查看文件官方文档

接口解析

请求语法

HEAD /{object_key}?partNumber=&versionId= HTTP/1.1

Host: {bucket}.{endpoint}

If-Match: IfMatch
If-Modified-Since: IfModifiedSince
If-None-Match: IfNoneMatch
If-Unmodified-Since: IfUnmodifiedSince
Range: Range
x-amz-server-side-encryption-customer-algorithm: SSECustomerAlgorithm
x-amz-server-side-encryption-customer-key: SSECustomerKey
x-amz-server-side-encryption-customer-key-MD5: SSECustomerKeyMD5
x-amz-request-payer: RequestPayer
x-amz-expected-bucket-owner: ExpectedBucketOwner
x-amz-checksum-mode: ChecksumMode

URL 参数

名称	类型	是否必须	示例	说明

请求结构

无。

响应语法

HTTP/1.1 200

x-amz-delete-marker: DeleteMarker
accept-ranges: AcceptRanges
x-amz-expiration: Expiration
x-amz-restore: Restore
x-amz-archive-status: ArchiveStatus
Last-Modified: LastModified
Content-Length: ContentLength
x-amz-checksum-crc32: ChecksumCRC32
x-amz-checksum-crc32c: ChecksumCRC32C
x-amz-checksum-sha1: ChecksumSHA1
x-amz-checksum-sha256: ChecksumSHA256
ETag: ETag
x-amz-missing-meta: MissingMeta
x-amz-version-id: VersionId
Cache-Control: CacheControl
Content-Disposition: ContentDisposition
Content-Encoding: ContentEncoding
Content-Language: ContentLanguage
Content-Type: ContentType
Expires: Expires
x-amz-website-redirect-location: WebsiteRedirectLocation
x-amz-server-side-encryption: ServerSideEncryption
x-amz-server-side-encryption-customer-algorithm: SSECustomerAlgorithm
x-amz-server-side-encryption-customer-key-MD5: SSECustomerKeyMD5
x-amz-server-side-encryption-aws-kms-key-id: SSEKMSKeyId
x-amz-server-side-encryption-bucket-key-enabled: BucketKeyEnabled
x-amz-storage-class: StorageClass
x-amz-request-charged: RequestCharged
x-amz-replication-status: ReplicationStatus
x-amz-mp-parts-count: PartsCount
x-amz-object-lock-mode: ObjectLockMode
x-amz-object-lock-retain-until-date: ObjectLockRetainUntilDate
x-amz-object-lock-legal-hold: ObjectLockLegalHoldStatus

响应参数

名称	类型	示例	说明

请求示例

通过 rclone 进行测试

测试指令

./rclone \
 --dump bodies \
 --s3-force-path-style=false \
 lsl \
 minio:uptime/test1/hello.txt

请求响应

2023/06/21 14:39:24 DEBUG : >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
2023/06/21 14:39:24 DEBUG : HTTP REQUEST (req 0x1400022d400)
2023/06/21 14:39:24 DEBUG : HEAD /test1/hello.txt HTTP/1.1
Host: uptime.minio.dev.173ops.com
User-Agent: rclone/v1.62.2
Authorization: XXXX
X-Amz-Content-Sha256: e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855
X-Amz-Date: 20230621T063924Z

2023/06/21 14:39:24 DEBUG : >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
2023/06/21 14:39:24 DEBUG : <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
2023/06/21 14:39:24 DEBUG : HTTP RESPONSE (req 0x1400022d400)
2023/06/21 14:39:24 DEBUG : HTTP/1.1 200 OK
Content-Length: 7
Accept-Ranges: bytes
Connection: keep-alive
Content-Security-Policy: block-all-mixed-content
Content-Type: text/plain; charset=utf-8
Date: Wed, 21 Jun 2023 06:39:24 GMT
Etag: "5e9820c5fde06ad204bc506739059ea5"
Last-Modified: Wed, 21 Jun 2023 05:36:53 GMT
Server: nginx/1.16.1
Strict-Transport-Security: max-age=31536000; includeSubDomains
Vary: Origin
Vary: Accept-Encoding
X-Amz-Id-2: dd9025bab4ad464b049177c95eb6ebf374d3b3fd1af9251148b658df7ac2e3e8
X-Amz-Meta-Mtime: 1687253796
X-Amz-Request-Id: 176A994C989C0108
X-Content-Type-Options: nosniff
X-Xss-Protection: 1; mode=block

2023/06/21 14:39:24 DEBUG : <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

Docs: 接口：ListObjects

Mon, 19 Jun 2023 11:00:32 +0800

简要概述

列出该用户已存储的文件列表，默认最大返回 1000 个文件官方文档

接口解析

请求语法

GET /?delimiter=&encoding-type=&marker=&max-keys=&prefix= HTTP/1.1

Host: {bucket}.{endpoint}
x-amz-request-payer: RequestPayer
x-amz-expected-bucket-owner: ExpectedBucketOwner

URL 参数

名称	类型	是否必须	示例	说明
delimiter	string	否	/	分隔符是用于对键进行分组的字符
encoding-type	string	否	url	请求对响应中的密钥进行编码，并指定要使用的编码方法，仅支持: url
marker	string	否	demo1	标记希望 S3 开始列出的位置
max-keys	int	否	1000	最大返回文件数量，默认为 1000
prefix	string	否	demo1	仅过滤文件以此为前缀的列表

请求结构

无。

响应语法

HTTP/1.1 200

x-amz-request-charged: RequestCharged

<?xml version="1.0" encoding="UTF-8"?>
<ListBucketResult>
 <IsTruncated>boolean</IsTruncated>
 <Marker>string</Marker>
 <NextMarker>string</NextMarker>
 <Contents>
 <ChecksumAlgorithm>string</ChecksumAlgorithm>
 ...
 <ETag>string</ETag>
 <Key>string</Key>
 <LastModified>timestamp</LastModified>
 <Owner>
 <DisplayName>string</DisplayName>
 <ID>string</ID>
 </Owner>
 <Size>integer</Size>
 <StorageClass>string</StorageClass>
 </Contents>
 ...
 <Name>string</Name>
 <Prefix>string</Prefix>
 <Delimiter>string</Delimiter>
 <MaxKeys>integer</MaxKeys>
 <CommonPrefixes>
 <Prefix>string</Prefix>
 </CommonPrefixes>
 ...
 <EncodingType>string</EncodingType>
</ListBucketResult>

响应参数

名称	类型	示例	说明
Name	string	uptime	桶名称
Prefix	string	demo1/hello/test	查询文件前缀
Marker	string	demo1/hello/test111	指示存储桶列表中的开始位置
NextMarker	string	demo1/hello/test999	响应被截断时，使用该字段作为后续标记
MaxKeys	int	1000	响应体返回的最多文件数
Delimiter	string	/	分隔符是用于对键进行分组的字符
IsTruncated	bool	false	响应是否被截断，也就是超过 MaxKeys 数量
Contents	[]Object	-	文件对象列表
CommonPrefixes	[]CommonPrefixes	-	文件对象公共前缀
EncodingType	string	url	对响应中的对象键进行编码的编码类型

请求示例

通过 rclone 进行测试

测试指令

./rclone \
 --dump bodies \
 --s3-force-path-style=false \
 lsl \
 minio:uptime/test/data

在使用 rclone 时，需注意配置 list_version = 1 使用版本 ListObject 进行文件列表。

请求响应

2023/06/21 14:50:30 DEBUG : >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
2023/06/21 14:50:30 DEBUG : HTTP REQUEST (req 0x14000921d00)
2023/06/21 14:50:30 DEBUG : GET /?delimiter=&encoding-type=url&max-keys=1000&prefix=test%2Fdata%2F HTTP/1.1
Host: uptime.minio.dev.173ops.com
User-Agent: rclone/v1.62.2
Authorization: XXXX
X-Amz-Content-Sha256: e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855
X-Amz-Date: 20230621T065030Z
Accept-Encoding: gzip

2023/06/21 14:50:30 DEBUG : >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
2023/06/21 14:50:30 DEBUG : <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
2023/06/21 14:50:30 DEBUG : HTTP RESPONSE (req 0x14000921d00)
2023/06/21 14:50:30 DEBUG : HTTP/1.1 200 OK
Content-Length: 966
Accept-Ranges: bytes
Connection: keep-alive
Content-Security-Policy: block-all-mixed-content
Content-Type: application/xml
Date: Wed, 21 Jun 2023 06:50:30 GMT
Server: nginx/1.16.1
Strict-Transport-Security: max-age=31536000; includeSubDomains
Vary: Origin
Vary: Accept-Encoding
X-Amz-Id-2: dd9025bab4ad464b049177c95eb6ebf374d3b3fd1af9251148b658df7ac2e3e8
X-Amz-Request-Id: 176A99E7AD2B0970
X-Content-Type-Options: nosniff
X-Xss-Protection: 1; mode=block

<?xml version="1.0" encoding="UTF-8"?>
<ListBucketResult
 xmlns="http://s3.amazonaws.com/doc/2006-03-01/">
 <Name>uptime</Name>
 <Prefix>test/data/</Prefix>
 <Marker></Marker>
 <MaxKeys>1000</MaxKeys>
 <IsTruncated>false</IsTruncated>
 <Contents>
 <Key>test/data/component/21/226781.html</Key>
 <LastModified>2023-06-21T05:36:53.650Z</LastModified>
 <ETag>&#34;c658d7f8c4ce1302f0a4903f10a5b5dc&#34;</ETag>
 <Size>40</Size>
 <Owner>
 <ID>02d6176db174dc93cb1b899f7c6078f08654445fe8cf1b6ce98d8855f66bdbf4</ID>
 <DisplayName>minio</DisplayName>
 </Owner>
 <StorageClass>STANDARD</StorageClass>
 </Contents>
 <Contents>
 <Key>test/data/component/29/226781.html</Key>
 <LastModified>2023-06-21T05:36:53.656Z</LastModified>
 <ETag>&#34;6ea091a913376dea9f889a611eb74bd0&#34;</ETag>
 <Size>40</Size>
 <Owner>
 <ID>02d6176db174dc93cb1b899f7c6078f08654445fe8cf1b6ce98d8855f66bdbf4</ID>
 <DisplayName>minio</DisplayName>
 </Owner>
 <StorageClass>STANDARD</StorageClass>
 </Contents>
 <EncodingType>url</EncodingType>
</ListBucketResult>

2023/06/21 14:50:30 DEBUG : <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

Docs: 接口：ListObjectsV2

Mon, 19 Jun 2023 11:00:32 +0800

简要概述

列出该用户已存储的文件列表，默认最大返回 1000 个文件官方文档

接口解析

请求语法

GET /?list-type=2&continuation-token=&delimiter=&encoding-type=&fetch-owner=&max-keys=&prefix=&start-after= HTTP/1.1

Host: {bucket}.{endpoint}
x-amz-request-payer: RequestPayer
x-amz-expected-bucket-owner: ExpectedBucketOwner

URL 参数

名称	类型	是否必须	示例	说明
continuation-token	string	否	-	指示 S3 列表正在使用令牌在此存储桶上继续
delimiter	string	否	/	分隔符是用于对键进行分组的字符
encoding-type	string	否	url	请求对响应中的密钥进行编码，并指定要使用的编码方法，仅支持: url
fetch-owner	string	否	默认情况下，Owner 字段不存在
max-keys	int	否	1000	最大返回文件数量，默认为 1000
prefix	string	否	demo1	仅过滤文件以此为前缀的列表
start-after	string	否	demo1	标记希望 S3 开始列出的位置

请求结构

无。

响应语法

HTTP/1.1 200

x-amz-request-charged: RequestCharged

<?xml version="1.0" encoding="UTF-8"?>
<ListBucketResult>
 <IsTruncated>boolean</IsTruncated>
 <Contents>
 <ChecksumAlgorithm>string</ChecksumAlgorithm>
 ...
 <ETag>string</ETag>
 <Key>string</Key>
 <LastModified>timestamp</LastModified>
 <Owner>
 <DisplayName>string</DisplayName>
 <ID>string</ID>
 </Owner>
 <Size>integer</Size>
 <StorageClass>string</StorageClass>
 </Contents>
 ...
 <Name>string</Name>
 <Prefix>string</Prefix>
 <Delimiter>string</Delimiter>
 <MaxKeys>integer</MaxKeys>
 <CommonPrefixes>
 <Prefix>string</Prefix>
 </CommonPrefixes>
 ...
 <EncodingType>string</EncodingType>
 <KeyCount>integer</KeyCount>
 <ContinuationToken>string</ContinuationToken>
 <NextContinuationToken>string</NextContinuationToken>
 <StartAfter>string</StartAfter>
</ListBucketResult>

响应参数

名称	类型	示例	说明
Name	string	uptime	桶名称
Prefix	string	demo1/hello/test	查询文件前缀
StartAfter	string	demo1/hello/test111	指示存储桶列表中的开始位置
ContinuationToken	string	TODO;	TODO;
NextContinuationToken	string	TODO;	TODO;
KeyCount	int	3	响应体返回的文件数
MaxKeys	int	1000	响应体返回的最多文件数
Delimiter	string	/	分隔符是用于对键进行分组的字符
IsTruncated	bool	false	响应是否被截断，也就是超过 MaxKeys 数量
Contents	[]Object	-	文件对象列表
CommonPrefixes	[]CommonPrefixes	-	文件对象公共前缀
EncodingType	string	url	对响应中的对象键进行编码的编码类型

请求示例

通过 rclone 进行测试

测试指令

./rclone \
 --dump bodies \
 --s3-force-path-style=false \
 lsl \
 minio:uptime/test/data

在使用 rclone 时，需注意配置 list_version = 2 使用版本 ListObjectV2 进行文件列表。

请求响应

2023/06/21 14:53:46 DEBUG : >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
2023/06/21 14:53:46 DEBUG : HTTP REQUEST (req 0x14000b2a500)
2023/06/21 14:53:46 DEBUG : GET /?delimiter=&encoding-type=url&list-type=2&max-keys=1000&prefix=test%2Fdata%2F HTTP/1.1
Host: uptime.minio.dev.173ops.com
User-Agent: rclone/v1.62.2
Authorization: XXXX
X-Amz-Content-Sha256: e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855
X-Amz-Date: 20230621T065346Z
Accept-Encoding: gzip

2023/06/21 14:53:46 DEBUG : >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
2023/06/21 14:53:46 DEBUG : <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
2023/06/21 14:53:46 DEBUG : HTTP RESPONSE (req 0x14000b2a500)
2023/06/21 14:53:46 DEBUG : HTTP/1.1 200 OK
Content-Length: 731
Accept-Ranges: bytes
Connection: keep-alive
Content-Security-Policy: block-all-mixed-content
Content-Type: application/xml
Date: Wed, 21 Jun 2023 06:53:46 GMT
Server: nginx/1.16.1
Strict-Transport-Security: max-age=31536000; includeSubDomains
Vary: Origin
Vary: Accept-Encoding
X-Amz-Id-2: dd9025bab4ad464b049177c95eb6ebf374d3b3fd1af9251148b658df7ac2e3e8
X-Amz-Request-Id: 176A9A154228D110
X-Content-Type-Options: nosniff
X-Xss-Protection: 1; mode=block

<?xml version="1.0" encoding="UTF-8"?>
<ListBucketResult
 xmlns="http://s3.amazonaws.com/doc/2006-03-01/">
 <Name>uptime</Name>
 <Prefix>test/data/</Prefix>
 <KeyCount>2</KeyCount>
 <MaxKeys>1000</MaxKeys>
 <IsTruncated>false</IsTruncated>
 <Contents>
 <Key>test/data/component/21/226781.html</Key>
 <LastModified>2023-06-21T05:36:53.650Z</LastModified>
 <ETag>&#34;c658d7f8c4ce1302f0a4903f10a5b5dc&#34;</ETag>
 <Size>40</Size>
 <StorageClass>STANDARD</StorageClass>
 </Contents>
 <Contents>
 <Key>test/data/component/29/226781.html</Key>
 <LastModified>2023-06-21T05:36:53.656Z</LastModified>
 <ETag>&#34;6ea091a913376dea9f889a611eb74bd0&#34;</ETag>
 <Size>40</Size>
 <StorageClass>STANDARD</StorageClass>
 </Contents>
 <EncodingType>url</EncodingType>
</ListBucketResult>

2023/06/21 14:53:46 DEBUG : <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

Docs: 接口：PUTObject

Mon, 19 Jun 2023 11:00:32 +0800

简要概述

上传文件官方文档

接口解析

请求语法

PUT /{object_key} HTTP/1.1

Host: {bucket}.{endpoint}

x-amz-acl: ACL
Cache-Control: CacheControl
Content-Disposition: ContentDisposition
Content-Encoding: ContentEncoding
Content-Language: ContentLanguage
Content-Length: ContentLength
Content-MD5: ContentMD5
Content-Type: ContentType
x-amz-sdk-checksum-algorithm: ChecksumAlgorithm
x-amz-checksum-crc32: ChecksumCRC32
x-amz-checksum-crc32c: ChecksumCRC32C
x-amz-checksum-sha1: ChecksumSHA1
x-amz-checksum-sha256: ChecksumSHA256
Expires: Expires
x-amz-grant-full-control: GrantFullControl
x-amz-grant-read: GrantRead
x-amz-grant-read-acp: GrantReadACP
x-amz-grant-write-acp: GrantWriteACP
x-amz-server-side-encryption: ServerSideEncryption
x-amz-storage-class: StorageClass
x-amz-website-redirect-location: WebsiteRedirectLocation
x-amz-server-side-encryption-customer-algorithm: SSECustomerAlgorithm
x-amz-server-side-encryption-customer-key: SSECustomerKey
x-amz-server-side-encryption-customer-key-MD5: SSECustomerKeyMD5
x-amz-server-side-encryption-aws-kms-key-id: SSEKMSKeyId
x-amz-server-side-encryption-context: SSEKMSEncryptionContext
x-amz-server-side-encryption-bucket-key-enabled: BucketKeyEnabled
x-amz-request-payer: RequestPayer
x-amz-tagging: Tagging
x-amz-object-lock-mode: ObjectLockMode
x-amz-object-lock-retain-until-date: ObjectLockRetainUntilDate
x-amz-object-lock-legal-hold: ObjectLockLegalHoldStatus
x-amz-expected-bucket-owner: ExpectedBucketOwner

Body

URL 参数

名称	类型	是否必须	示例	说明

请求结构

文件二进制内容

响应语法

HTTP/1.1 200

x-amz-expiration: Expiration
ETag: ETag
x-amz-checksum-crc32: ChecksumCRC32
x-amz-checksum-crc32c: ChecksumCRC32C
x-amz-checksum-sha1: ChecksumSHA1
x-amz-checksum-sha256: ChecksumSHA256
x-amz-server-side-encryption: ServerSideEncryption
x-amz-version-id: VersionId
x-amz-server-side-encryption-customer-algorithm: SSECustomerAlgorithm
x-amz-server-side-encryption-customer-key-MD5: SSECustomerKeyMD5
x-amz-server-side-encryption-aws-kms-key-id: SSEKMSKeyId
x-amz-server-side-encryption-context: SSEKMSEncryptionContext
x-amz-server-side-encryption-bucket-key-enabled: BucketKeyEnabled
x-amz-request-charged: RequestCharged

响应参数

名称	类型	示例	说明

请求示例

通过 rclone 进行测试

测试指令

echo "hello world" | ./rclone \
 --dump bodies \
 --s3-force-path-style=false \
 rcat \
 minio:uptime/from/local/hello.txt

请求响应

2023/06/21 15:09:12 DEBUG : >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
2023/06/21 15:09:12 DEBUG : HTTP REQUEST (req 0x140001ca200)
2023/06/21 15:09:12 DEBUG : PUT /from/local/hello.txt HTTP/1.1
Host: uptime.minio.dev.173ops.com
User-Agent: rclone/v1.62.2
Content-Length: 12
Authorization: XXXX
Content-Md5: b1kCrCNwJL3QwXbLkwY9xA==
Content-Type: text/plain; charset=utf-8
X-Amz-Acl: default
X-Amz-Content-Sha256: UNSIGNED-PAYLOAD
X-Amz-Date: 20230621T070912Z
X-Amz-Meta-Mtime: 1687331352.229462
Accept-Encoding: gzip

hello world
2023/06/21 15:09:12 DEBUG : >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
2023/06/21 15:09:12 DEBUG : <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
2023/06/21 15:09:12 DEBUG : HTTP RESPONSE (req 0x140001ca200)
2023/06/21 15:09:12 DEBUG : HTTP/1.1 200 OK
Content-Length: 0
Accept-Ranges: bytes
Connection: keep-alive
Content-Security-Policy: block-all-mixed-content
Date: Wed, 21 Jun 2023 07:09:12 GMT
Etag: "6f5902ac237024bdd0c176cb93063dc4"
Server: nginx/1.16.1
Strict-Transport-Security: max-age=31536000; includeSubDomains
Vary: Origin
Vary: Accept-Encoding
X-Amz-Id-2: dd9025bab4ad464b049177c95eb6ebf374d3b3fd1af9251148b658df7ac2e3e8
X-Amz-Request-Id: 176A9AECCE4AA1C8
X-Content-Type-Options: nosniff
X-Xss-Protection: 1; mode=block

2023/06/21 15:09:12 DEBUG : <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

Docs: 工具：Rclone

Mon, 12 Jun 2023 22:59:27 +0800

简要概述

用于对象存储的同步

使用参数

TODO;

使用场景

创建文件

echo "hello world" | ./rclone --dump bodies --s3-force-path-style=false rcat syncds:uptime/from/local/hello.txt

往存储桶 “uptime” 中创建对象文件名 “from/local/hello.txt”，内容为 “hello world”。