github/minio
4
0
Fork 0
mirror of https://github.com/minio/minio.git synced 2024-04-21 12:41:46 +00:00
Code Issues Releases Wiki Activity
11,587 Commits 6 Branches 471 Tags
85bcb5874aa7b1497874a603ee3085c19bafcff6
Commit Graph
5851 Commits
Author SHA1 Message Date
HarshavardhanaandGitHub 92788e4cf4 fix: re-arrange console-sys to log properly in k8s/docker (#19129) 
fixes #19125
 2024-02-26 01:33:48 -08:00
HarshavardhanaandGitHub 8a698fef71 fix: crash in ResourceMetrics RPC handling concurrent writers (#19123) 
Continuation of #19103 that had fixed the crash in peer metrics for cluster endpoint.
 2024-02-25 00:51:38 -08:00
HarshavardhanaandGitHub c2b54d92f6 allow all disk full errors to be handled (#19117) 2024-02-24 09:11:14 -08:00
HarshavardhanaandGitHub f965434022 fix: re-use endpoint strings to avoid allocation during audit (#19116) 2024-02-23 16:19:13 -08:00
HarshavardhanaandGitHub a3ac62596c move timedValue -> cachevalue package (#19114) 2024-02-23 13:28:14 -08:00
HarshavardhanaandGitHub 2faba02d6b fix: allow diskInfo at storageRPC to be cached (#19112) 
Bonus: convert timedValue into a typed implementation
 2024-02-23 09:21:38 -08:00
Krishnan ParthasarathiandGitHub ee158e1610 ilm: Update action count only on success (#19093) 
It also fixes a long-standing bug in expiring transitioned objects.
The expiration action was deleting the current version in the case'
of tiered objects instead of adding a delete marker.
 2024-02-22 15:00:32 -08:00
Anis EleuchandGitHub fa68efb1e7 s3: CopyObject to disallow invalid dest object names (#19110) 
By not doing so, objects can risk being in a wrong erasure set if the
destination object name contains e.g. '//'
 2024-02-22 10:05:17 -08:00
Anis EleuchandGitHub 8c53a4405a Add audit for folder excess (#19109) 
Also replace ilm:expiry with scanner to avoid user confusion
 2024-02-22 08:18:13 -08:00
HarshavardhanaandGitHub c32f699105 turn-off md5sum for SSE-KMS/SSE-C as optimization for multipart (#19106) 
only enable md5sum if explicitly asked by the client, otherwise
its not necessary to compute md5sum when SSE-KMS/SSE-C is enabled.

this is continuation of #17958
 2024-02-22 04:24:11 -08:00
HarshavardhanaandGitHub 53aa8f5650 use typos instead of codespell (#19088) 2024-02-21 22:26:06 -08:00
Klaus PostandGitHub 92180bc793 Add array recycling safety (#19103) 
Nil entries when recycling arrays.
 2024-02-21 12:27:35 -08:00
PoornaandGitHub 526b829a09 site replication: Disallow removal of site-replicator account (#19092) 2024-02-21 02:09:33 -08:00
Anis EleuchandGitHub 9ea5d08ecd site-repl: Fix endpoint in the error with unexpected deployment-id (#19086) 2024-02-20 15:02:35 -08:00
HarshavardhanaandGitHub 35deb1a8e2 do not block on send channels under high load (#19090) 
all send channels must compete with `ctx` if not
they will perpetually stay alive.
 2024-02-20 15:00:35 -08:00
HarshavardhanaandGitHub c7f7c47388 allow renames() for inlined writes without data-dir (#18801) 
data-dir not being present is okay, however we can still
rely on the `rename()` atomic call instead of relying on
write xl.meta write which may truncate the io.EOF.
 2024-02-20 07:05:57 -08:00
Klaus PostandGitHub e06168596f Convert more peer <--> peer REST calls (#19004) 
* Convert more peer <--> peer REST calls
* Clean up in general.
* Add JSON wrapper.
* Add slice wrapper.
* Add option to make handler return nil error if no connection is given, `IgnoreNilConn`.

Converts the following:

```
+	HandlerGetMetrics
+	HandlerGetResourceMetrics
+	HandlerGetMemInfo
+	HandlerGetProcInfo
+	HandlerGetOSInfo
+	HandlerGetPartitions
+	HandlerGetNetInfo
+	HandlerGetCPUs
+	HandlerServerInfo
+	HandlerGetSysConfig
+	HandlerGetSysServices
+	HandlerGetSysErrors
+	HandlerGetAllBucketStats
+	HandlerGetBucketStats
+	HandlerGetSRMetrics
+	HandlerGetPeerMetrics
+	HandlerGetMetacacheListing
+	HandlerUpdateMetacacheListing
+	HandlerGetPeerBucketMetrics
+	HandlerStorageInfo
+	HandlerGetLocks
+	HandlerBackgroundHealStatus
+	HandlerGetLastDayTierStats
+	HandlerSignalService
+	HandlerGetBandwidth
```
 2024-02-19 14:54:46 -08:00
HarshavardhanaandGitHub 4c8197a119 reject expired STS credentials early without decoding sessionToken (#19072) 2024-02-19 07:34:10 -08:00
HarshavardhanaandGitHub b6e98aed01 fix: found races in accessing globalLocalDrives (#19069) 
make a copy before accessing globalLocalDrives

Bonus: update console v0.46.0

Signed-off-by: Harshavardhana <harsha@minio.io>
 2024-02-16 17:15:57 -08:00
Anis EleuchandGitHub 00dcba9ddd Fix typo in jwt skewed date/time error (#19066) 2024-02-16 10:48:30 -08:00
HarshavardhanaandGitHub 607cafadbc converge clusterRead health into cluster health (#19063) 2024-02-15 16:48:36 -08:00
Anis EleuchandGitHub 68dde2359f log: Add logger.Event to send to console and other logger targets (#19060) 
Add a new function logger.Event() to send the log to Console and
http/kafka log webhooks. This will include some internal events such as
disk healing and rebalance/decommissioning
 2024-02-15 15:13:30 -08:00
PoornaandGitHub f9dbf41e27 sr: add validation to disallow updating bandwidth limit on self (#19062) 2024-02-15 13:03:40 -08:00
Krishnan ParthasarathiandGitHub 7405760f44 Refresh tier config periodically (#19049) 
- Increase the parity for tier-config.bin object
- Refresh globalTierConfigMgr cached value once every 15 mins
 2024-02-15 11:52:44 -08:00
HarshavardhanaandGitHub 7e4a6b4bcd remove rename2 entirely, avoids the risk of moving data (#19058) 2024-02-14 17:09:38 -08:00
HarshavardhanaandGitHub f961ec4aaf fix: revert allow offline disks on fresh start (#19052) 
the PR in #16541 was incorrect and hand wrong assumptions
about the overall setup, revert this since this expectation
to have offline servers is wrong and we can end up with a
bigger chicken and egg problem.

This reverts commit 5996c8c4d5.

Bonus:

- preserve disk in globalLocalDrives properly upon connectDisks()
- do not return 'nil' from newXLStorage(), getting it ready for
  the next set of changes for 'format.json' loading.
 2024-02-14 10:37:34 -08:00
HarshavardhanaandGitHub 134db72bb7 fix: reject service account access key same as root credentials (#19055) 2024-02-14 10:37:12 -08:00
HarshavardhanaandGitHub effe21f3eb send correct objectname in audit events for DeleteAll ILM (#19053) 2024-02-14 08:07:58 -08:00
Praveen raj ManiandGitHub 1118b285d3 fix: race in deleting objects during batch expiry (#19054) 2024-02-14 08:07:44 -08:00
Aditya ManthramurthyandGitHub a14e192376 fix: remove unnecessary panic in iam-store (#19050) 2024-02-13 19:29:36 -08:00
Minio Trusted f8e15e7d09 Update yaml files to latest version RELEASE.2024-02-13T15-35-11Z 2024-02-13 16:01:38 +00:00
Shireesh AnjalandGitHub 7b9f9e0628 fix incorrect disk io stats in k8s environment (#19016) 
The previous logic of calculating per second values for disk io stats
divides the stats by the host uptime. This doesn't work in k8s
environment as the uptime is of the pod, but the stats (from
/proc/diskstats) are from the host.

Fix this by storing the initial values of uptime and the stats at the
timme of server startup, and using the difference between current and
initial values when calculating the per second values.
 2024-02-13 07:35:11 -08:00
Praveen raj ManiandGitHub ac8e9ce04f Send a bucket notification event on DeleteObject() for non-existing object (#19037) 
Send a bucket notification event on DeleteObject for non-existing objects
 2024-02-13 07:34:17 -08:00
Praveen raj ManiandGitHub cfd8645843 fix: update batch replication stats for snowball uploads (#19045) 2024-02-13 07:33:27 -08:00
HarshavardhanaandGitHub 0c068b15c7 add missing handler for reloading site replication config on peers (#19042) 2024-02-13 06:55:54 -08:00
Anis EleuchandGitHub 30a466aa71 sts: Add test for DurationSeconds condition (#19044) 2024-02-13 06:55:37 -08:00
Taran PelkeyandGitHub 4d94609c44 FIx unexpected behavior when creating service account (#19036) 2024-02-13 02:31:43 -08:00
PoornaandGitHub 0cc9fb73e1 metrics: fix typo in namespace for proxy tagging metric (#19039) 
Relevant PR introducing this metric: #18957
 2024-02-12 13:02:27 -08:00
HarshavardhanaandGitHub eac4e4b279 honor replaced disk properly by updating globalLocalDrives (#19038) 
globalLocalDrives seem to be not updated during the
HealFormat() leads to a requirement where the server
needs to be restarted for the healing to continue.
 2024-02-12 13:00:20 -08:00
HarshavardhanaandGitHub 6d381f7c0a relax pre-emptive GetBucketInfo() for multi-object delete (#19035) 2024-02-12 08:46:46 -08:00
Anis EleuchandGitHub 4fa06aefc6 Convert service account add/update expiration to cond values (#19024) 
In order to force some users allowed to create or update a service
account to provide an expiration satifying the user policy conditions.
 2024-02-12 08:36:16 -08:00
HarshavardhanaandGitHub 0e177a44e0 preserve conflicting objects when parent object is being deleted (#19034) 
a/prefix
a/prefix/1.txt

where `a/prefix` is an object which does not have `/` at the end,
we do not have to aggressively recursively delete all the sub-folders
as well. Instead convert the call into self contained to deleting
'xl.meta' and then subsequently attempting to Remove the parent.
 2024-02-12 08:30:40 -08:00
HarshavardhanaandGitHub afd19de5a9 fix: allow configuring excess versions alerting (#19028) 
Bonus: enable audit alerts for object versions
beyond the configured value, default is '100'
versions per object beyond which scanner will
alert for each such objects.
 2024-02-11 23:41:53 -08:00
HarshavardhanaandGitHub e3fbac9e24 do not have to use the same distributionAlgo as first pool (#19031) 
when we expand via pools, there is no reason to stick
with the same distributionAlgo as the rest. Since the
algo only makes sense with-in a pool not across pools.

This allows for newer pools to use newer codepaths to
avoid legacy file lookups when they have a pre-existing
deployment from 2019, they can expand their new pool
to be of a newer distribution format, allowing the
pool to be more performant.
 2024-02-11 23:21:56 -08:00
PoornaandGitHub a9cf32811c Fix panic in tagging request proxying (#19032) 2024-02-11 18:18:43 -08:00
HarshavardhanaandGitHub 53997ecc79 avoid excessive logging for objects that do not exist (#19030) 
in replicated setups, that have proxying enabled for
replicated buckets.
 2024-02-11 14:21:08 -08:00
HarshavardhanaandGitHub 997ba3a574 introduce reader deadlines for net.Conn (#19023) 
Bonus: set "retry-after" header for AWS SDKs if possible to honor them.
 2024-02-09 13:25:16 -08:00
HarshavardhanaandGitHub 62761a23e6 remove unnecessary metrics in 'mc admin info' output (#19020) 
Reduce the amount of data transfer on large deployments
 2024-02-08 19:28:46 -08:00
HarshavardhanaandGitHub 404d8b3084 fix: dangling objects honor parityBlocks instead of dataBlocks (#19019) 
Bonus: do not recreate buckets if NoRecreate is asked.
 2024-02-08 15:22:16 -08:00
Klaus PostandGitHub 6005ad3d48 Fix shared top locks client (#19018) 
`client` is shared across goroutines.

Seen with `mc support top locks` on minio built with `-race`.
 2024-02-08 12:28:05 -08:00