github/minio
4
0
Fork 0
mirror of https://github.com/minio/minio.git synced 2024-04-21 12:41:46 +00:00
Code Issues Releases Wiki Activity
4,282 Commits 6 Branches 471 Tags
8085ba4494de3ca5dbd5303053fecc13f3febf05
Commit Graph
849 Commits
Author SHA1 Message Date
Krishnan ParthasarathiandHarshavardhana 8085ba4494 Filter out internal object prefix during listing (#4435) 
We use ZZZZ-Minio/ prefix internally in our GCS gateway which should be
filtered out in the response to ListObjects.
 2017-06-16 15:02:07 -07:00
poornasandHarshavardhana 9bd0eb1a9e Set default ETag value if vendor returns empty md5 string (#4409) 
The ETag is constructed from md5 atttribute of object attributes
returned by the vendor's Composer. The md5 attribute comes back
as nil for large uploads. Instead the CRC32C should be used.

Refer to https://cloud.google.com/storage/docs/hashes-etags

Fixes #4397
 2017-06-16 15:02:07 -07:00
Anis ElleuchandHarshavardhana e4e0abfc05 fix: Check project id before starting gateway (#4412) 2017-06-16 15:02:07 -07:00
poornasandHarshavardhana 12b2fc894b Remove profile option for gcs from gateway help message (#4421) 2017-06-16 15:01:34 -07:00
Krishna SrinivasandHarshavardhana 2aa76e7407 Change md5Sum to etag (#4399) 2017-06-16 14:58:49 -07:00
Remco VerhoefandHarshavardhana 0dab038858 Cleanup and update the PR with the master branch. 2017-06-16 14:55:32 -07:00
Remco VerhoefandHarshavardhana a76556ec1b Map only default region us-east-1 to gcs us region 2017-06-16 14:54:37 -07:00
Harshavardhana 91c7bb65c5 gateway/gcs: send proper error responses for Get/SetBucket policies. (#4338) 
Fixes #4323
 2017-06-16 14:54:37 -07:00
Anis ElleuchandHarshavardhana 5d602034ea gateway: Use default params when no args provided (#4315) 
For S3 & Azure, use default parameters when no arguments (endpoint) are
provided. This also avoids a crash.
 2017-06-16 14:54:37 -07:00
Nitish TiwariandHarshavardhana b829ec4a6b Fixes https://github.com/minio/minio/issues/4320 (#4332) 
- Add description for error ErrBucketAlreadyExists
 2017-06-16 14:54:37 -07:00
Remco VerhoefandHarshavardhana 9c50a9f567 Fix ListObjectParts to list properly all parts - closes #4322 2017-06-16 14:54:37 -07:00
Remco VerhoefandHarshavardhana 52122c0309 Fix uploadIDMarker handling. 2017-06-16 14:54:37 -07:00
Remco VerhoefandHarshavardhana 3b9d313c87 Fix issue with AbortMultipartUpload, closes #4322 2017-06-16 14:54:37 -07:00
Remco VerhoefandHarshavardhana bfff251e2a Fix issue with UNSIGNED payloads. 
Additionally also fixes escaping slashes in
temporary multipart names
 2017-06-16 14:54:37 -07:00
Remco VerhoefandHarshavardhana 52b500cce9 Verify multipart etag during complete, closes #4288 2017-06-16 14:54:37 -07:00
Remco VerhoefandHarshavardhana c63cdca11f Support iterating through ListObjectParts using NextPartNumberMarker, closes #4284 2017-06-16 14:54:37 -07:00
Remco VerhoefandHarshavardhana 4430085981 Add region to gcs gateway example 2017-06-16 14:54:37 -07:00
Remco VerhoefandHarshavardhana 5c78415b31 Verify md5 content hash, closes #4285 2017-06-16 14:54:37 -07:00
Remco VerhoefandHarshavardhana bd67117756 Use maxKeys for iterator 2017-06-16 14:54:37 -07:00
Remco VerhoefandHarshavardhana f3e5e9fb29 Support marker, closes #4286 2017-06-16 14:54:37 -07:00
Remco VerhoefandHarshavardhana 2de1921fe8 Use MINIO_REGION environment variable for region configuration, closes #4287 2017-06-16 14:54:37 -07:00
Remco VerhoefandHarshavardhana dd7e47f264 Add access and secret key to example, needed to access Minio Gateway 2017-06-16 14:54:37 -07:00
Remco VerhoefandHarshavardhana fe9d826bef Implement bucket policies 2017-06-16 14:53:36 -07:00
Remco VerhoefandHarshavardhana 6dbc5aba09 Return correct error when PutObject fails 2017-06-16 14:53:36 -07:00
Remco VerhoefandHarshavardhana de5374f74c Map S3 regions to Google (multi)regions 2017-06-16 14:53:36 -07:00
Remco VerhoefandHarshavardhana bf55591c64 Make every backend responsible for parsing its own arguments, fixes #4293 2017-06-16 14:53:36 -07:00
Remco VerhoefandHarshavardhana 2d814e340f Return BucketAlreadyExists when bucket exists with another user 2017-06-16 14:53:36 -07:00
Remco VerhoefandHarshavardhana 0a8cf1a6b0 Allow bucket creation in different regions, closes #4287 and #4241 
* I needed to remove the region check from PutBucketHandler
 2017-06-16 14:53:36 -07:00
Remco VerhoefandHarshavardhana 07949f68d8 Translate gcs errors to S3 compatible errors, fixes #4278 2017-06-16 14:53:36 -07:00
Remco VerhoefandHarshavardhana 909a89647b Use default endpoint when not supplied 2017-06-16 14:53:36 -07:00
Remco VerhoefandHarshavardhana 6508da5fde Add usage for GCS gateway, closes #4280 2017-06-16 14:53:36 -07:00
Remco VerhoefandHarshavardhana 3379f005a5 Initial implementation of Google Cloud Storage 2017-06-16 14:47:02 -07:00
Remco VerhoefandHarshavardhana 4be609eb82 Added AllAccessDisabled error 2017-06-16 14:47:02 -07:00
Remco VerhoefandHarshavardhana dd5b975001 Add comment, gateway should validate object name 2017-06-16 14:47:02 -07:00
Remco VerhoefandHarshavardhana 9ac3538141 Move anonymous error to object translation from Azure specific to gateway 2017-06-16 14:47:02 -07:00
RemcoandHarshavardhana ace4f9fd15 Implement gateway support Google Cloud Storage 2017-06-16 14:47:02 -07:00
splinter98andHarshavardhana 8293f546af Add support for MQTT server as a notification target (#4474) 
This implementation is similar to AMQP notifications:

* Notifications are published on a single topic as a JSON feed
* Topic is configurable, as is the QoS. Uses the paho.mqtt.golang
  library for the mqtt connection, and supports connections over tcp
  and websockets, with optional secure tls support.
* Additionally the minio server configuration has been bumped up
  so mqtt configuration can be added.
* Configuration migration code is added with tests.

MQTT is an ISO standard M2M/IoT messaging protocol and was
originally designed for applications for limited bandwidth
networks. Today it's use is growing in the IoT space.
 2017-06-14 17:27:49 -07:00
Anis ElleuchandHarshavardhana af8071c86a xl: Fix rare freeze after many disk/network errors (#4438) 
xl.storageDisks is sometimes passed to some low-level XL functions. Some disks in
xl.storageDisks are set to nil when they encounter some errors. This means all
elements in xl.storageDisks will be nil after some time which lead to an unusable XL.
 2017-06-14 17:14:27 -07:00
Daniel LindandHarshavardhana dce76d9307 Fix xl.diskWithAllParts to proper checksum algorithm (#4509) 2017-06-14 17:13:02 -07:00
HarshavardhanaandGitHub 353f2d3a6e fs: Hold format.json readLock ref to avoid GC. (#4532) 
Looks like if we follow pattern such as

```
_ = rlk
```

Go can potentially kick in GC and close the fd when
the reference is lost, only speculation is that
the cause here is `SetFinalizer` which is set on
`os.close()` internally in `os` stdlib.

This is unexpected and unsual endeavour for Go, but
we have to make sure the reference is never lost
and always dies with the server.

Fixes #4530
 2017-06-13 08:29:07 -07:00
HarshavardhanaandGitHub 075b8903d7 fs: Add safe locking semantics for format.json (#4523) 
This patch also reverts previous changes which were
merged for migration to the newer disk format. We will
be bringing these changes in subsequent releases. But
we wish to add protection in this release such that
future release migrations are protected.

Revert "fs: Migration should handle bucketConfigs as regular objects. (#4482)"
This reverts commit 976870a391.

Revert "fs: Migrate object metadata to objects directory. (#4195)"
This reverts commit 76f4f20609.
 2017-06-12 17:40:28 -07:00
HarshavardhanaandDee Koder b8463a738c Add support for DCOS host detection, improve Docker detection. (#4525) 
isDocker was currently reading from `/proc/cgroup` file. But
this file alone is rather not conclusive evidence. Docker
internally has `.dockerenv` as a special file which we should
use instead.

Fixes #4456
 2017-06-13 00:33:21 +00:00
Frank WesselsandDee Koder 6f4862659f Investigate issue #4461 (#4521) 
* Code to investigate issue #4461 (rare test failure in TestListenAndServeTLS)

* Use UTCNow() instead of time.Now().UTC()
 2017-06-13 00:20:29 +00:00
HarshavardhanaandGitHub 48dbd49980 Add support for kubernetes host detection (#4514) 
Additionally improve what we print for `docker pull`
such that its precisely the relevant release tag.

Fixes #4456
 2017-06-09 02:42:12 -07:00
Bala FAandHarshavardhana 3dfe254a11 gateway: make each backend as subcommands. (#4506) 
Fixes #4450
 2017-06-08 23:28:45 -07:00
Krishna SrinivasandHarshavardhana ec2920e981 Allow "minio server ." to start minio in fs mode (#4513) 2017-06-08 18:58:51 -07:00
Krishnan ParthasarathiandHarshavardhana 8a6b0cc0cd TestInitListeners: Use port 0 pick available port (#4508) 2017-06-08 12:08:21 -07:00
Krishna SrinivasandHarshavardhana 2c56788f8d Validate gateway arguments (#4376) 
Fixes #4355
 2017-06-08 11:20:56 -07:00
Frank WesselsandHarshavardhana 145328ac9f tests: Run select statement in separate goroutine (#4499) 
Instead of after the wg.Wait() so as to make sure that the 'earliest'
of the two select case that becomes active is selected..
 2017-06-08 07:39:50 -07:00
poornasandHarshavardhana 45a568dd85 Give more specific error message on browser for nested policies (#4488) 2017-06-07 19:31:23 -07:00