Krishnan Parthasarathi and Harshavardhana
7d50361ca9
Move housekeeping before object layer initialization ( #3001 )
...
In a distributed setup that the server should not perform any operation
on the storage layer after it is exported via RPC. e.g, cleaning up of
temporary directories under .minio.sys/tmp may interfere with ongoing
PUT objects being served by the distributed setup.
2016-10-19 19:59:48 -07:00
Frank and Harshavardhana
19c51f3f3c
Added ForceUnlock to namespace-lock ( #2990 )
2016-10-19 09:27:36 -07:00
Aditya Manthramurthy and Harshavardhana
c3bbadacbf
Improve Peer RPC error handling ( Fixes #2992 ) ( #2995 )
...
* Check for RPC connection shutdown and try again just once.
* Refactor SendRPC to use sync.WaitGroup
2016-10-18 21:26:58 -07:00
Anis Elleuch and Harshavardhana
2208992e6a
More informative message when erasure fails to read a part of an object ( #2989 )
2016-10-18 13:09:26 -07:00
Anis Elleuch and Harshavardhana
bbba8e432a
Add ssl support to s3/web peers connections ( #2988 )
2016-10-18 11:46:33 -07:00
Harshavardhana and GitHub
39331b6b4e
xl: GetCheckSumInfo() shouldn't fail if hash not available. ( #2984 )
...
In a multipart upload scenario disks going down and coming backup
can lead to certain parts missing on the disk/server which was
going down. This is a valid case since these blocks can be
missing and should be healed through heal operation. But we are
not supposed to fail prematurely since we have enough data on
the other disks as well within read-quorum.
This fix relaxes previous assumption, fixes a major corruption
issue reproduced by @vadmeste.
Fixes #2976
2016-10-18 11:13:25 -07:00
Mike Ralphson and Harshavardhana
6e748cb1cf
Report when invalid bucket names are skipped in FS backend. ( #2947 )
2016-10-18 01:42:46 -07:00
Anis Elleuch and Harshavardhana
2005d656e6
Properly load creds from env and save them when server cmd is executed ( #2970 )
2016-10-17 23:14:41 -07:00
Aditya Manthramurthy and Harshavardhana
0f26ec8095
Propagate creds change to cluster ( Fixes #2855 ) ( #2929 )
2016-10-17 20:18:08 -07:00
Harshavardhana and GitHub
8d2347bc7b
storage: DeleteFile should return errFileNotFound for ENOENT. ( #2978 )
2016-10-17 16:38:46 -07:00
Aditya Manthramurthy and Harshavardhana
0ff359ca0e
Fix early init. problem for notifications ( Fixes #2972 ) ( #2977 )
2016-10-17 16:38:29 -07:00
Harshavardhana and GitHub
f8e13fb00e
server: Startup sequence should be more idempotent. ( #2974 )
...
Fixes #2971 - honors ignore-disks option properly.
Fixes #2969 - change the net.Dial to have a timeout of 3secs.
2016-10-17 14:31:33 -07:00
Harshavardhana and GitHub
686a610fc3
api: Nanosecond precision for API responses is valid with S3. ( #2957 )
...
Wqe need to be compatible as well fixes #2955
2016-10-17 08:44:55 -07:00
Mike Ralphson and Harshavardhana
7fc1685b7a
Allow Travis builds from GitHub forks ( #2958 )
...
Set the go_import_path explicitly. See
https://docs.travis-ci.com/user/languages/go#Go-Import-Path
2016-10-17 08:42:20 -07:00
Krishnan Parthasarathi and Harshavardhana
b89609dc2e
XL: Filter out md5Sum from user defined headers ( #2962 )
2016-10-17 08:41:33 -07:00
Anis Elleuch and Harshavardhana
fa50312220
Avoid returning disk corrupted by servers in the middle of init all disks formats ( #2964 )
2016-10-17 08:39:55 -07:00
Harshavardhana and GitHub
fee3f99a6e
xl: heal bucket should validate if bucket exists first. ( #2953 )
...
Fixes #2944
2016-10-17 02:10:23 -07:00
Frank and Harshavardhana
ea406754a6
New dsync and added ForceUnlock to lock rpc server ( #2956 )
...
* Update dsync and added ForceUnlock function
* Added test cases for ForceUnlock
2016-10-17 01:53:29 -07:00
Aditya Manthramurthy and Harshavardhana
d02cb963d5
Fix listen-bucket ( Fixes #2942 ) ( #2949 )
...
Don't close socket while re-initializing notify-listeners, as the rpc
client object is shared between notify-listeners and peer clients.
Also, improves SendRPC() readability by using GetPeerClient().
2016-10-16 20:52:10 -07:00
Anis Elleuch and Harshavardhana
334cdb5d64
XL total/free space calculation is done inside xl module ( #2945 )
2016-10-16 14:24:15 -07:00
Harshavardhana and GitHub
a681af6953
Update minio browser with new changes. ( #2940 )
...
- Bucket policy set/unset support.
- Shareable URL support.
- Delete object support.
2016-10-15 08:51:53 -07:00
Anis Elleuch and Harshavardhana
5c3639c1b7
Redirect /minio to /minio/ when requests come from browsers ( #2937 )
2016-10-15 06:21:51 -07:00
Krishna Srinivas and Harshavardhana
903574db90
copy-object: Do not use ETag of source as MD5 as it will not be MD5 if source was uploaded as multipart. ( #2938 )
...
fixes #2934
2016-10-15 06:20:55 -07:00
Anis Elleuch and Harshavardhana
f463d3ce42
Fix a crash when service shutdown is signaled and object API is not ready yet ( #2939 )
2016-10-15 06:20:16 -07:00
Aditya Manthramurthy and Harshavardhana
17eeec6895
Bucket policy propagation ( Fixes #2930 ) ( #2932 )
...
Fixes a serialisation bug - encoding/gob does not directly support
serializing `map[string]interface{}`, so we serialise to JSON and send a
byte array in the RPC call, and deserialize and update on the receiver.
2016-10-14 22:49:51 -07:00
Karthic Rao and Harshavardhana
070d3610ff
tests: V2 Signature tests for object-handlers. ( #2931 )
2016-10-14 20:52:46 -07:00
Harshavardhana and GitHub
f22862aa28
heal: Refactor heal command. ( #2901 )
...
- return errors for heal operation through rpc replies.
- implement rotating wheel for healing status.
Fixes #2491
2016-10-14 19:57:40 -07:00
koolhead17 and Harshavardhana
18be3bc95a
docs: added space in README.md so that its compatible with doctor. ( #2927 )
2016-10-14 13:20:33 -07:00
Harshavardhana
2f520ed92f
Remove errors package, add comments and simplify. ( #2925 )
2016-10-14 12:31:00 -07:00
Mateusz Gajewski and Harshavardhana
c03ce0f74a
Display SSL expiry warnings ( #2925 )
2016-10-14 12:30:36 -07:00
Krishna Srinivas and Harshavardhana
0320a77dc0
HealBucket: create the bucket if it is missing in one of the disks. ( #2924 )
2016-10-14 11:12:17 -07:00
koolhead17 and Harshavardhana
3349153058
docs: added space in source download steps so it appears as desired in ( #2923 )
...
doctor.
2016-10-14 08:49:12 -07:00
Harshavardhana
5e86352464
doc: Fix docker.md instructions and words.
2016-10-13 21:34:03 -07:00
Harshavardhana
18d125ef1c
doc: Redo install instructions ( #2922 )
2016-10-13 19:44:27 -07:00
Aditya Manthramurthy and Harshavardhana
31be826f51
Fix missing error check for jsonrpc.Server.RegisterService() ( #2921 )
2016-10-13 17:34:10 -07:00
Harshavardhana and GitHub
eb372d53df
Fix docker release titles
2016-10-13 16:24:18 -07:00
Harshavardhana and GitHub
1788c58d5c
Add docker edge instructions
2016-10-13 16:19:14 -07:00
Karthic Rao and Harshavardhana
17e49a9ed2
signature-v2 fix. ( #2918 )
...
- Return errors similar to V4 Sign processsing.
- Return ErrMissing fields when Auth Header fields are missing.
- Return InvalidAccessID when accessID doesn't match.
* tests: Adding V2 signature tests for bucket handler API's.
2016-10-13 09:25:56 -07:00
Aditya Manthramurthy and Harshavardhana
0aabc1d8d9
Use Peer RPC to propagate bucket policy changes ( #2891 )
2016-10-13 09:19:04 -07:00
Harshavardhana and GitHub
55f6828750
Do not print update message unless there is an update. ( #2919 )
2016-10-13 09:17:08 -07:00
Aditya Manthramurthy and Harshavardhana
6303f26330
Protect map from concurrent access ( Fixes #2915 ) ( #2916 )
...
Protects the Peers RPC clients map from concurrent access to fix a data race condition.
2016-10-13 01:33:50 -07:00
Krishnan Parthasarathi and Harshavardhana
b59bac670a
Handle err returned by rpc.Server.RegisterName ( #2910 )
2016-10-12 23:13:24 -07:00
Anis Elleuch and Harshavardhana
84acc820c7
Fix free drive space calculation in XL mode ( #2917 )
2016-10-12 20:22:15 -07:00
Harshavardhana
92858c7db2
Fix docker documentation.
2016-10-12 18:31:23 -07:00
Harshavardhana and GitHub
fdaa129a5b
Fix dockerfile container image. ( #2892 )
2016-10-12 18:09:08 -07:00
Anis Elleuch and Harshavardhana
df59967f59
Avoid checking date header of web requests by properly applying generic handlers ( #2914 )
2016-10-12 12:58:36 -07:00
Mateusz Gajewski and Harshavardhana
73982c8cb6
Listen bucket notification for multiple prefixes/suffixes ( #2911 )
...
* Listen bucket notification for multiple prefixes/suffixes
* After review fixes
2016-10-12 11:02:15 -07:00
Aditya Manthramurthy and Harshavardhana
6199aa0707
Peer RPCs for bucket notifications ( #2877 )
...
* Implements a Peer RPC router that sends info to all Minio servers in the cluster.
* Bucket notifications are propagated to all nodes via this RPC router.
* Bucket listener configuration is persisted to separate object layer
file (`listener.json`) and peer RPCs are used to communicate changes
throughout the cluster.
* When events are generated, RPC calls to send them to other servers
where bucket listeners may be connected is implemented.
* Some bucket notification tests are now disabled as they cannot work in
the new design.
* Minor fix in `funcFromPC` to use `path.Join`
2016-10-12 01:03:50 -07:00
Krishnan Parthasarathi and Harshavardhana
a5921b5743
Use same timestamp for all chunks in chunked signature ( #2908 )
2016-10-11 23:46:51 -07:00
Karthic Rao and Harshavardhana
f0538dbb5c
fix broken link for Go Installation in CONTRIBUTING.md ( #2907 )
2016-10-11 22:19:35 -07:00