如何刪除vSAN中unassociated object
最近遇到一個 vSAN空間異常的狀況，如下圖。在 vSAN-VDI Cluster中已經沒有任何虛擬機，瀏覽 Datastore也沒有看到任何虛擬機的檔案，但是可用空間卻被莫名的吃掉了 (總空間 7.56TB，可用空間卻只有 4.72TB，被吃掉了快 3TB)。
追查原因後發現，此 vSAN Cluster中有很多 unassociated object在 datastore是看不到的，需要用指令的方式來刪除。首先，透過 RVC(Ruby vSphere Console)，執行 vSAN.obj_status_report指令，搭配Cluster-Name和參數-t
以下為執行指令 vSAN.obj_status_report [Cluster-Name] -t 的結果
/localhost/[Datacenter-Name]/computers> vsan.obj_status_report vSAN-VDI -t
2017-01-11 14:07:30 +0800: Querying all VMs on VSAN ...
2017-01-11 14:07:30 +0800: Querying all objects in the system from esxi16.vd. ...
2017-01-11 14:07:30 +0800: Querying all disks in the system from esxi16.vd. ...
2017-01-11 14:07:30 +0800: Querying all components in the system from esxi16.vd. ...
2017-01-11 14:07:31 +0800: Querying all object versions in the system ...
2017-01-11 14:07:32 +0800: Got all the info, computing table ...
Histogram of component health for non-orphaned objects
+-------------------------------------+------------------------------+
| Num Healthy Comps / Total Num Comps | Num objects with such status |
+-------------------------------------+------------------------------+
| 3/3 (OK) | 209 |
+-------------------------------------+------------------------------+
Total non-orphans: 209
Histogram of component health for possibly orphaned objects
+-------------------------------------+------------------------------+
| Num Healthy Comps / Total Num Comps | Num objects with such status |
+-------------------------------------+------------------------------+
+-------------------------------------+------------------------------+
Total orphans: 0
Total v1 objects: 0
Total v2 objects: 0
Total v2.5 objects: 0
Total v3 objects: 209
+-----------------------------------------+---------+---------------------------+
| VM/Object | objects | num healthy / total comps |
+-----------------------------------------+---------+---------------------------+
| Unassociated objects | | |
| 48755c58-a0be-0e00-cd2f-1402ec74c930 | | 3/3 |
| be745c58-0224-4c00-54b5-8cdcd4b2598c | | 3/3 |
| 9bf12258-7bb6-f502-0842-8cdcd4b2598c | | 3/3 |
| f1e32258-df0b-1803-70ca-8cdcd4b2598c | | 3/3 |
| 7f755c58-bf40-2103-4dc6-8cdcd4b2598c | | 3/3 |
| 1e855c58-ac87-7b04-7d61-1402ec74c930 | | 3/3 |
| 80755c58-e506-b705-042b-8cdcd4b2598c | | 3/3 |
| e08d2258-a6e6-0906-bb0c-1402ec74c3ec | | 3/3 |
| bbff2158-16f6-6906-60dc-1402ec74c3ec | | 3/3 |
| 7bff2158-dfcf-9d06-68bc-1402ec74c930 | | 3/3 |
| aa002258-44e2-e506-5978-8cdcd4b2598c | | 3/3 |
| 018e2258-963b-5107-df3f-1402ec74c3ec | | 3/3 |
| e3e32258-3f4c-4908-7bab-1402ec74c3ec | | 3/3 |
| 3c755c58-abf5-2b09-0288-8cdcd4b253a0 | | 3/3 |
| 5d755c58-4565-5409-2112-1402ec74c3ec | | 3/3 |
| 8a002258-f759-7809-a7d2-1402ec74c930 | | 3/3 |
| b88d2258-a096-830a-838e-8cdcd4b2598c | | 3/3 |
| ead96558-63e4-3f0b-4466-8cdcd4b2598c | | 3/3 |
| 16662558-7193-530d-137e-8cdcd4b2598c | | 3/3 |
| 9aff2158-d66b-ca10-92d4-1402ec74c3ec | | 3/3 |
| 02e42258-09d8-cc13-6497-1402ec74c930 | | 3/3 |
| ca002258-6d7d-b114-4c28-1402ec74c930 | | 3/3 |
| 9cf12258-e464-0a17-c84f-8cdcd4b253a0 | | 3/3 |
| ece32258-e9af-8717-5170-1402ec74c930 | | 3/3 |
| 73002258-b546-a017-1e35-1402ec74c930 | | 3/3 |
| 5f0e2458-6eec-2818-ef57-1402ec74c3ec | | 3/3 |
| 84f42158-5281-6218-cf52-1402ec74c3ec | | 3/3 |
| bf745c58-d2ef-dc19-35e9-1402ec74c930 | | 3/3 |
| fb7e2558-8b23-5e1a-a1c8-8cdcd4b2598c | | 3/3 |
| 48755c58-e0de-f41a-e17f-1402ec74c930 | | 3/3 |
| b9745c58-034b-961b-3630-8cdcd4b253a0 | | 3/3 |
| b88d2258-bade-701e-a55d-8cdcd4b2598c | | 3/3 |
| 95002258-b4dd-0d20-8891-1402ec74c3ec | | 3/3 |
| 71c86358-f987-c220-8c9c-8cdcd4b2598c | | 3/3 |
| be745c58-71b9-1621-7cc6-8cdcd4b2598c | | 3/3 |
| ff8d2258-66e4-9821-7c71-8cdcd4b2598c | | 3/3 |
| d1f12258-375e-5e22-7a5d-8cdcd4b2598c | | 3/3 |
| 9b755c58-4674-9026-7ab5-8cdcd4b2598c | | 3/3 |
| df8d2258-7e08-6a27-bec5-8cdcd4b2598c | | 3/3 |
| 6b032658-a1e3-9727-46b0-1402ec74c3ec | | 3/3 |
| 24032658-b22a-a227-9837-8cdcd4b253a0 | | 3/3 |
| a6755c58-6fb1-5028-e6a4-8cdcd4b2598c | | 3/3 |
| a7f42158-e860-0e2a-5719-1402ec74c3ec | | 3/3 |
| 67002258-5f1a-5d2b-3035-1402ec74c930 | | 3/3 |
| 22855c58-bafa-b32b-1c93-1402ec74c3ec | | 3/3 |
| 7f755c58-7917-d62b-d4bb-1402ec74c930 | | 3/3 |
| 97e32258-6369-902c-2190-8cdcd4b253a0 | | 3/3 |
| 7bff2158-51be-942c-dfc2-1402ec74c3ec | | 3/3 |
| 8ed36358-b61c-6f2d-f480-1402ec74c930 | | 3/3 |
| 0f002258-7649-762d-d9ef-8cdcd4b2598c | | 3/3 |
| 73002258-8827-f12d-c5cf-1402ec74c3ec | | 3/3 |
| 5e8e2358-0c0e-bd2e-2644-1402ec74c930 | | 3/3 |
| de8d2258-8e8e-632f-6377-1402ec74c930 | | 3/3 |
| ba745c58-dc38-fb30-9d3b-1402ec74c930 | | 3/3 |
| b7ff2158-8cd2-1a31-5bb5-1402ec74c930 | | 3/3 |
| dfff2158-4bc4-6e31-74be-1402ec74c930 | | 3/3 |
| fe855c58-7e1a-5532-7880-8cdcd4b2598c | | 3/3 |
| 9ff12258-2262-e932-7c31-8cdcd4b253a0 | | 3/3 |
| d2f12258-ae25-6833-db18-8cdcd4b253a0 | | 3/3 |
| 9aff2158-9e9e-ae33-ceec-8cdcd4b2598c | | 3/3 |
| 958d2258-1d52-a034-d2dd-1402ec74c930 | | 3/3 |
| 8a755c58-869a-a536-ab0d-1402ec74c930 | | 3/3 |
| 7d662558-6337-d837-57cf-8cdcd4b253a0 | | 3/3 |
| 6ceb2158-ed00-2b38-e8c6-1402ec74c3ec | | 3/3 |
| 9b755c58-526e-1e3a-be2f-8cdcd4b2598c | | 3/3 |
| 72032658-bf45-1e3c-2626-1402ec74c3ec | | 3/3 |
| 17755c58-f8af-793c-1d45-8cdcd4b253a0 | | 3/3 |
| a49a6258-65d6-973c-ef5e-1402ec74c930 | | 3/3 |
| 0ff22258-14b8-813d-0317-1402ec74c930 | | 3/3 |
| 88755c58-5236-953d-1531-1402ec74c930 | | 3/3 |
| 9c2a2358-f3b8-fa3d-cdea-1402ec74c930 | | 3/3 |
| 7bff2158-215d-b83e-eee8-1402ec74c930 | | 3/3 |
| 4c755c58-7cce-2f3f-227e-8cdcd4b253a0 | | 3/3 |
| 9aff2158-e9ad-4240-03bd-1402ec74c3ec | | 3/3 |
| a7f42158-a6bb-7741-afe2-8cdcd4b2598c | | 3/3 |
| 02662558-e68c-7841-dbdb-8cdcd4b253a0 | | 3/3 |
| 837d6358-71c1-0a43-65c0-8cdcd4b2598c | | 3/3 |
| 6ceb2158-8110-e647-9863-1402ec74c3ec | | 3/3 |
| c2e76358-fe93-e748-bdb4-8cdcd4b253a0 | | 3/3 |
| 96eb2158-401f-634a-7226-1402ec74c930 | | 3/3 |
| ec745c58-cb95-5c4c-2c3a-1402ec74c930 | | 3/3 |
| 86f42158-c46b-d14c-86f8-8cdcd4b2598c | | 3/3 |
| d73a2358-13d2-354d-7cb7-1402ec74c930 | | 3/3 |
| b9ff2158-558a-a04e-3047-8cdcd4b2598c | | 3/3 |
| bd745c58-7454-1e50-3732-1402ec74c3ec | | 3/3 |
| 132b2358-9d44-4950-c1b3-1402ec74c3ec | | 3/3 |
| 71755c58-d5b3-6b52-8b5a-8cdcd4b253a0 | | 3/3 |
| be745c58-0af3-3153-2e9e-8cdcd4b253a0 | | 3/3 |
| 87f42158-834c-f155-01f1-8cdcd4b2598c | | 3/3 |
| 15802558-2357-6858-ca33-1402ec74c3ec | | 3/3 |
| ba7c2558-a6e8-ac58-2f06-8cdcd4b253a0 | | 3/3 |
| 43ff2358-cce2-005a-1eb1-1402ec74c930 | | 3/3 |
| 67002258-a322-2e5a-2aa6-1402ec74c930 | | 3/3 |
| c0905c58-a142-e25b-1a9c-8cdcd4b2598c | | 3/3 |
| 0e825c58-82a8-a15c-8806-1402ec74c3ec | | 3/3 |
| ca755c58-9898-4e5d-7501-1402ec74c3ec | | 3/3 |
| e9755c58-c1b4-1b5f-de4b-1402ec74c3ec | | 3/3 |
| 67002258-8a86-5f5f-6b07-1402ec74c930 | | 3/3 |
| d95e2358-6cb4-b45f-32f9-1402ec74c930 | | 3/3 |
| 4c252358-13cc-0463-0ca1-8cdcd4b2598c | | 3/3 |
| 15865c58-b73d-3163-cf4b-1402ec74c930 | | 3/3 |
| da802558-6e77-8664-ecd2-8cdcd4b2598c | | 3/3 |
| 45802558-985f-b564-2cf8-1402ec74c930 | | 3/3 |
| b98d2258-a4a1-c965-de8d-1402ec74c930 | | 3/3 |
| c0745c58-9f44-0466-aa2b-8cdcd4b2598c | | 3/3 |
| 132b2358-a7e0-7866-7459-1402ec74c930 | | 3/3 |
| 03e42258-57bf-9766-ee95-1402ec74c930 | | 3/3 |
| d12c2358-2b2d-2868-3232-1402ec74c3ec | | 3/3 |
| ba755c58-9898-096b-537a-1402ec74c930 | | 3/3 |
| 89855c58-ae33-ec6b-98bb-1402ec74c930 | | 3/3 |
| ca755c58-0d17-e76c-bcdb-1402ec74c3ec | | 3/3 |
| e2f12258-3a0b-196d-4282-8cdcd4b2598c | | 3/3 |
| cbe32258-1216-8b6d-69b6-8cdcd4b253a0 | | 3/3 |
| 7dd62358-3b9d-c571-9212-8cdcd4b2598c | | 3/3 |
| 55642558-d7dc-bb73-2e30-8cdcd4b253a0 | | 3/3 |
| baff2158-e824-8174-6aa3-1402ec74c3ec | | 3/3 |
| 0df22258-3219-a874-2c9f-8cdcd4b2598c | | 3/3 |
| 68322358-f9f6-ab74-f89c-1402ec74c3ec | | 3/3 |
| a8a32558-a9ea-8275-8ef8-1402ec74c930 | | 3/3 |
| 7ff22258-3fe3-c376-474b-8cdcd4b2598c | | 3/3 |
| f0e32258-41d3-9077-2723-1402ec74c930 | | 3/3 |
| 00682658-7af6-f477-9a2d-1402ec74c930 | | 3/3 |
| 30002258-85d4-657c-f2a9-8cdcd4b2598c | | 3/3 |
| 4d002258-f637-b87d-6f5f-8cdcd4b2598c | | 3/3 |
| 04855c58-3bdd-ea7e-6f08-8cdcd4b253a0 | | 3/3 |
| cbe32258-5696-8980-56d5-8cdcd4b2598c | | 3/3 |
| ab755c58-3728-f483-266a-8cdcd4b2598c | | 3/3 |
| dff12258-1bea-3686-a9be-1402ec74c930 | | 3/3 |
| 86f42158-d9d8-9f86-4e63-1402ec74c930 | | 3/3 |
| 30002258-3fae-ee86-fe92-8cdcd4b2598c | | 3/3 |
| 008e2258-9861-5c87-bb63-1402ec74c930 | | 3/3 |
| 3b855c58-d397-1e88-f9fb-8cdcd4b2598c | | 3/3 |
| a9642558-0254-f489-7c61-1402ec74c3ec | | 3/3 |
| 79ff2158-855c-2e8c-35ce-8cdcd4b2598c | | 3/3 |
| cae32258-22be-7d8d-bbc8-1402ec74c3ec | | 3/3 |
| 6f755c58-fa6e-4090-11ff-1402ec74c930 | | 3/3 |
| 38d76358-cc3e-e191-c282-8cdcd4b2598c | | 3/3 |
| 92ad6458-db5b-7392-6ac8-1402ec74c3ec | | 3/3 |
| 54e42258-16a2-0f93-4c26-1402ec74c930 | | 3/3 |
| 36652558-45e5-5f93-a0ed-8cdcd4b2598c | | 3/3 |
| faff2158-4da9-ae93-c45d-1402ec74c3ec | | 3/3 |
| d9f12258-8aeb-2694-bf1d-8cdcd4b253a0 | | 3/3 |
| b3755c58-3289-7694-4ad1-8cdcd4b2598c | | 3/3 |
| 35855c58-363e-4f95-885e-8cdcd4b253a0 | | 3/3 |
| deff2158-788d-2596-f588-1402ec74c3ec | | 3/3 |
| 4a002258-bcc7-2b96-3c8f-1402ec74c3ec | | 3/3 |
| b8ff2158-f4f1-7896-65d1-1402ec74c3ec | | 3/3 |
| f7642558-34c1-e09a-3636-1402ec74c930 | | 3/3 |
| b2eb5c58-7d5c-6c9b-7ec5-8cdcd4b2598c | | 3/3 |
| 5a865c58-f453-209d-99f1-8cdcd4b253a0 | | 3/3 |
| c9e32258-c731-359e-2e0f-8cdcd4b253a0 | | 3/3 |
| a0f12258-f2d2-b79f-873c-8cdcd4b253a0 | | 3/3 |
| 1d032658-d03c-d59f-2139-8cdcd4b253a0 | | 3/3 |
| 4d002258-87b4-ef9f-42ab-8cdcd4b2598c | | 3/3 |
| cfe32258-693f-bfa1-c24d-1402ec74c3ec | | 3/3 |
| 8f6a2558-6934-49a2-b12f-1402ec74c3ec | | 3/3 |
| 978d2258-20f1-b6a2-39ba-1402ec74c3ec | | 3/3 |
| 8a002258-3ccb-2aa3-3982-1402ec74c930 | | 3/3 |
| e7745c58-22af-30a5-ae0e-1402ec74c3ec | | 3/3 |
| ddff2158-dac8-f8a5-242e-8cdcd4b2598c | | 3/3 |
| e7e32258-82df-3da7-9272-8cdcd4b2598c | | 3/3 |
| 7b755c58-b042-48a7-1b6b-1402ec74c3ec | | 3/3 |
| dd8d2258-2bc7-9da8-34eb-8cdcd4b2598c | | 3/3 |
| 67eb2158-1da3-a7ad-93e2-1402ec74c930 | | 3/3 |
| 4f755c58-c03d-d8ad-8644-1402ec74c3ec | | 3/3 |
| 98795c58-de75-b5ae-5c6b-8cdcd4b2598c | | 3/3 |
| 3c2a2358-42e0-e2ae-9b02-1402ec74c930 | | 3/3 |
| e7745c58-833a-7db1-8c8e-1402ec74c3ec | | 3/3 |
| 1b755c58-8349-2cb2-0ab6-1402ec74c930 | | 3/3 |
| 22755c58-0b75-77b2-2fba-1402ec74c930 | | 3/3 |
| 66865c58-3a30-fbb2-7eff-8cdcd4b253a0 | | 3/3 |
| b88d2258-a47d-86b4-0a6e-1402ec74c930 | | 3/3 |
| e7845c58-26ae-95b5-e614-8cdcd4b2598c | | 3/3 |
| 86f42158-52ea-f6b5-a25a-8cdcd4b2598c | | 3/3 |
| 23002258-3dbf-beb6-26bc-8cdcd4b2598c | | 3/3 |
| 5a2a2358-a82b-56b8-e2bb-1402ec74c930 | | 3/3 |
| 57d86358-e208-abb8-cd97-8cdcd4b2598c | | 3/3 |
| 4c755c58-d47c-36b9-c10f-8cdcd4b2598c | | 3/3 |
| 7aff2158-fe5f-61bb-4498-1402ec74c930 | | 3/3 |
| dcff2158-f510-dabb-8dbe-1402ec74c930 | | 3/3 |
| 4b002258-bb44-3bbc-40be-1402ec74c3ec | | 3/3 |
| b8ff2158-3e75-6fbc-6635-8cdcd4b2598c | | 3/3 |
| 21755c58-f6da-18c0-172b-8cdcd4b253a0 | | 3/3 |
| 51252358-ea33-62c1-4bdd-1402ec74c930 | | 3/3 |
| 80755c58-3582-38c2-747b-1402ec74c930 | | 3/3 |
| 5a002258-2c99-b6c3-edd8-1402ec74c3ec | | 3/3 |
| 70eb2158-65b3-fcc5-d3e4-1402ec74c930 | | 3/3 |
| c9f42158-87ce-04c7-9508-8cdcd4b2598c | | 3/3 |
| bf7d2558-bc1e-1fc7-3f32-1402ec74c930 | | 3/3 |
| 93262358-b48d-6dc7-55fe-1402ec74c930 | | 3/3 |
| 0ff22258-7607-54c8-d3fd-8cdcd4b253a0 | | 3/3 |
| 22755c58-b9e3-bec9-463d-1402ec74c930 | | 3/3 |
| 08e42258-4089-13ca-803d-1402ec74c3ec | | 3/3 |
| 44f22258-07e8-87cd-6e83-8cdcd4b2598c | | 3/3 |
| 17052658-57c5-78ce-aee6-8cdcd4b253a0 | | 3/3 |
| e08d2258-4dd5-bdce-32c8-1402ec74c3ec | | 3/3 |
| d4755c58-827d-8acf-a6b0-8cdcd4b253a0 | | 3/3 |
| 7cff2158-5098-8acf-1c78-1402ec74c3ec | | 3/3 |
| 15002258-c621-abd0-48ea-8cdcd4b2598c | | 3/3 |
| 03682658-c835-b3d1-6e43-1402ec74c930 | | 3/3 |
| 367f2558-feeb-cbd1-13b9-1402ec74c930 | | 3/3 |
| 13e42258-4bb7-60d2-d0fa-8cdcd4b253a0 | | 3/3 |
| a7f42158-c875-d0d5-121d-8cdcd4b2598c | | 3/3 |
| f0745c58-7770-f2d7-905b-8cdcd4b2598c | | 3/3 |
| c9f42158-b816-3bd8-ae59-1402ec74c3ec | | 3/3 |
| 607f2558-8a9c-5fd8-bb35-8cdcd4b2598c | | 3/3 |
| ba8d2258-ef7e-08d9-643c-1402ec74c930 | | 3/3 |
| 31e42258-0461-6dd9-a721-8cdcd4b253a0 | | 3/3 |
| e3e32258-9bdb-d9d9-078c-1402ec74c930 | | 3/3 |
+-----------------------------------------+---------+---------------------------+
+------------------------------------------------------------------+
| Legend: * = all unhealthy comps were deleted (disks present) |
| - = some unhealthy comps deleted, some not or can't tell |
| no symbol = We cannot conclude any comps were deleted |
+------------------------------------------------------------------+
/localhost/[Datacenter-Name]/computers>
從 report的結果來看，可以看到 vSAN datastore中確實有很多垃圾檔案，在刪除這些 object之前，可以先用指令來查詢 object的相關資訊，確認 object真的是沒有用到了。在此例因為 cluster上已經沒有任何 VM，所以可以很確定這些 object都可以刪除
接著，SSH登入到 Cluster中的其中一台 ESXi，切換至 vSAN datastore路徑，執行以下指令來查詢 object相關資訊
/user/lib/vmware/osfs/bin/objtool getAttr -u [object uuid]
執行以下指令刪除 object
/usr/lib/vmware/osfs/bin/objtool delete -u [uuid]
手動刪除幾個 object後，從 vsphere client可以觀察到消失的空間回來了
沒有留言:
張貼留言