vHoge

VMwareのアレコレ備忘録。CLIでがんばるネタ多め。

MINISFORUM EliteMini HM90 ってどう?

今年のネタ、今年のウチに♪

2021 最後の My New Gear...


(なんかピンぼけしてるな…)

また買ってしまった Minisforum のミニ PC EtlieMini HM90。
今回はベアボーンモデルということで、ESXi 用途としては更にお得に。
(セール特価で 55,590 JPY)
Minisforum EliteMini HM90store.minisforum.jp

基本スペック

コンポーネント スペック値
製品名 MINISFORUM EliteMini HM90
CPU Ryzen9 4900H 8c/16t
Memory (ベアボーン)
GPU AMD Radeon™ Graphics (1750MHz)
Disk (ベアボーン)
拡張Disk 2.5inch SATA 3.0 スロット x 2
NIC M.2 2230 WI-Fi6 / 2.5Gbps NIC / 1Gbps NIC
電源 Type-C 給電 DC19V/6.3A (≒120W)
本体サイズ 149.6 x 149.6 x 55.5mm

HM80 比で Ryzen7 4700U → Ryzen9 4900H になったのが大きな変更点。
というか、本当にそれぐらいでは?
(ベアボーンモデルが出たというのは大きい)

外観

HM80 と並べて。IF もサイズ感も全く同じ。

梱包物、電源がゴツくなりましたね…

HM80 のレポは ↓ 参照 vhoge.hateblo.jp

個別調達品

今回はベアボーンということで、メモリと Disk(NVMe) は別調達。
丁度 Amazonブラックフライデー時期だったのでそこから適当に安いものを。


また、それらとは別に自宅で余っていた SATA SSD(CT500MX500SSD1)も載せる。

余談:メモリ2枚モデル? メモリ1枚モデル x 2?

今回は 1 枚モデル 2 個買いというトリッキーな買い方。

メモリは基本的にデュアルチャンネルで使うため、2 枚 1 組が基本。
そこで変に相性問題で出ないように製造ロットを確実に合わせるということで、2 枚モデルを買うのが推奨というか一般的。
価格もほとんど変わらないし (2 枚の方が安い場合も)

が今回、見ていると価格差が…ということで敢えての 1枚モデル 2 個買い。
同じお店から同時で 2枚買いするのであればロットがずれる可能性は低いし、その昔に比べて地雷メモリも大分淘汰されたので、そこまでのリスクは無い…と判断。

実際シリアルは連番で特に問題は無く動いているのでひとまずは好判断かな。 半導体不足で色々入手が不安定な昨今。一事例としてご参考までに。

装着

背面のネジを外してケースを開く。

メモリは斜めに入れ、スロットに入ったら上から押しこみ両サイドの留め具をハメる。


M.2 はネジを外し、メモリ同様に斜めに入れネジを留めなおす。 SATA SSD は背面に置き、カバーを取りつけ同梱ケーブルで配線。


ESXi をインストール

と、ここまで書いてきましたが、実は Hirotaka Sato(@hirotaka0426) さんのもとには一足お先に製品が到着しており、レポを投稿してくれていますので、インストール自体は勝ち馬に乗るだけ。
(M.2 NVMe を認識してくれるかはありますが…) qiita.com
I225-V なので、HM80 の時のインストールイメージをそのまま利用。

うぇーい

ESXi から見る


バイス。あれ、HM80 だと見えた M.2 2230 Wi-FI が見えない…?

ディスクまわり


SATA SSD はまだ未フォーマット。

NIC はレポ通り I225-V (+Realtek)。

上級者用

HM80 と同じように ESXi 上で CLI を叩く。

esxcli hardware hoge

[root@minis03:~] esxcli hardware cpu list
CPU:0
   Id: 0
   Package Id: 0
   Family: 23
   Model: 96
   Type: 0
   Stepping: 1
   Brand: AuthenticAMD
   Core Speed: 3293811384
   Bus Speed: 99812410
   APIC ID: 0x0
   Node: 0
   L2 Cache Size: 524288
   L2 Cache Associativity: 8
   L2 Cache Line Size: 64
   L2 Cache CPU Count: 2
   L3 Cache Size: 4194304
   L3 Cache Associativity: 16
   L3 Cache Line Size: 64
   L3 Cache CPU Count: 8

CPU:1
   Id: 1
   Package Id: 0
   Family: 23
   Model: 96
   Type: 0
   Stepping: 1
   Brand: AuthenticAMD
   Core Speed: 3293811384
   Bus Speed: 99812410
   APIC ID: 0x1
   Node: 0
   L2 Cache Size: 524288
   L2 Cache Associativity: 8
   L2 Cache Line Size: 64
   L2 Cache CPU Count: 2
   L3 Cache Size: 4194304
   L3 Cache Associativity: 16
   L3 Cache Line Size: 64
   L3 Cache CPU Count: 8

CPU:2
   Id: 2
   Package Id: 0
   Family: 23
   Model: 96
   Type: 0
   Stepping: 1
   Brand: AuthenticAMD
   Core Speed: 3293811384
   Bus Speed: 99812410
   APIC ID: 0x2
   Node: 0
   L2 Cache Size: 524288
   L2 Cache Associativity: 8
   L2 Cache Line Size: 64
   L2 Cache CPU Count: 2
   L3 Cache Size: 4194304
   L3 Cache Associativity: 16
   L3 Cache Line Size: 64
   L3 Cache CPU Count: 8

CPU:3
   Id: 3
   Package Id: 0
   Family: 23
   Model: 96
   Type: 0
   Stepping: 1
   Brand: AuthenticAMD
   Core Speed: 3293811384
   Bus Speed: 99812410
   APIC ID: 0x3
   Node: 0
   L2 Cache Size: 524288
   L2 Cache Associativity: 8
   L2 Cache Line Size: 64
   L2 Cache CPU Count: 2
   L3 Cache Size: 4194304
   L3 Cache Associativity: 16
   L3 Cache Line Size: 64
   L3 Cache CPU Count: 8

CPU:4
   Id: 4
   Package Id: 0
   Family: 23
   Model: 96
   Type: 0
   Stepping: 1
   Brand: AuthenticAMD
   Core Speed: 3293811384
   Bus Speed: 99812410
   APIC ID: 0x4
   Node: 0
   L2 Cache Size: 524288
   L2 Cache Associativity: 8
   L2 Cache Line Size: 64
   L2 Cache CPU Count: 2
   L3 Cache Size: 4194304
   L3 Cache Associativity: 16
   L3 Cache Line Size: 64
   L3 Cache CPU Count: 8

CPU:5
   Id: 5
   Package Id: 0
   Family: 23
   Model: 96
   Type: 0
   Stepping: 1
   Brand: AuthenticAMD
   Core Speed: 3293811384
   Bus Speed: 99812410
   APIC ID: 0x5
   Node: 0
   L2 Cache Size: 524288
   L2 Cache Associativity: 8
   L2 Cache Line Size: 64
   L2 Cache CPU Count: 2
   L3 Cache Size: 4194304
   L3 Cache Associativity: 16
   L3 Cache Line Size: 64
   L3 Cache CPU Count: 8

CPU:6
   Id: 6
   Package Id: 0
   Family: 23
   Model: 96
   Type: 0
   Stepping: 1
   Brand: AuthenticAMD
   Core Speed: 3293811384
   Bus Speed: 99812410
   APIC ID: 0x6
   Node: 0
   L2 Cache Size: 524288
   L2 Cache Associativity: 8
   L2 Cache Line Size: 64
   L2 Cache CPU Count: 2
   L3 Cache Size: 4194304
   L3 Cache Associativity: 16
   L3 Cache Line Size: 64
   L3 Cache CPU Count: 8

CPU:7
   Id: 7
   Package Id: 0
   Family: 23
   Model: 96
   Type: 0
   Stepping: 1
   Brand: AuthenticAMD
   Core Speed: 3293811384
   Bus Speed: 99812410
   APIC ID: 0x7
   Node: 0
   L2 Cache Size: 524288
   L2 Cache Associativity: 8
   L2 Cache Line Size: 64
   L2 Cache CPU Count: 2
   L3 Cache Size: 4194304
   L3 Cache Associativity: 16
   L3 Cache Line Size: 64
   L3 Cache CPU Count: 8

CPU:8
   Id: 8
   Package Id: 0
   Family: 23
   Model: 96
   Type: 0
   Stepping: 1
   Brand: AuthenticAMD
   Core Speed: 3293811384
   Bus Speed: 99812410
   APIC ID: 0x8
   Node: 0
   L2 Cache Size: 524288
   L2 Cache Associativity: 8
   L2 Cache Line Size: 64
   L2 Cache CPU Count: 2
   L3 Cache Size: 4194304
   L3 Cache Associativity: 16
   L3 Cache Line Size: 64
   L3 Cache CPU Count: 8

CPU:9
   Id: 9
   Package Id: 0
   Family: 23
   Model: 96
   Type: 0
   Stepping: 1
   Brand: AuthenticAMD
   Core Speed: 3293811384
   Bus Speed: 99812410
   APIC ID: 0x9
   Node: 0
   L2 Cache Size: 524288
   L2 Cache Associativity: 8
   L2 Cache Line Size: 64
   L2 Cache CPU Count: 2
   L3 Cache Size: 4194304
   L3 Cache Associativity: 16
   L3 Cache Line Size: 64
   L3 Cache CPU Count: 8

CPU:10
   Id: 10
   Package Id: 0
   Family: 23
   Model: 96
   Type: 0
   Stepping: 1
   Brand: AuthenticAMD
   Core Speed: 3293811384
   Bus Speed: 99812410
   APIC ID: 0xa
   Node: 0
   L2 Cache Size: 524288
   L2 Cache Associativity: 8
   L2 Cache Line Size: 64
   L2 Cache CPU Count: 2
   L3 Cache Size: 4194304
   L3 Cache Associativity: 16
   L3 Cache Line Size: 64
   L3 Cache CPU Count: 8

CPU:11
   Id: 11
   Package Id: 0
   Family: 23
   Model: 96
   Type: 0
   Stepping: 1
   Brand: AuthenticAMD
   Core Speed: 3293811384
   Bus Speed: 99812410
   APIC ID: 0xb
   Node: 0
   L2 Cache Size: 524288
   L2 Cache Associativity: 8
   L2 Cache Line Size: 64
   L2 Cache CPU Count: 2
   L3 Cache Size: 4194304
   L3 Cache Associativity: 16
   L3 Cache Line Size: 64
   L3 Cache CPU Count: 8

CPU:12
   Id: 12
   Package Id: 0
   Family: 23
   Model: 96
   Type: 0
   Stepping: 1
   Brand: AuthenticAMD
   Core Speed: 3293811384
   Bus Speed: 99812410
   APIC ID: 0xc
   Node: 0
   L2 Cache Size: 524288
   L2 Cache Associativity: 8
   L2 Cache Line Size: 64
   L2 Cache CPU Count: 2
   L3 Cache Size: 4194304
   L3 Cache Associativity: 16
   L3 Cache Line Size: 64
   L3 Cache CPU Count: 8

CPU:13
   Id: 13
   Package Id: 0
   Family: 23
   Model: 96
   Type: 0
   Stepping: 1
   Brand: AuthenticAMD
   Core Speed: 3293811384
   Bus Speed: 99812410
   APIC ID: 0xd
   Node: 0
   L2 Cache Size: 524288
   L2 Cache Associativity: 8
   L2 Cache Line Size: 64
   L2 Cache CPU Count: 2
   L3 Cache Size: 4194304
   L3 Cache Associativity: 16
   L3 Cache Line Size: 64
   L3 Cache CPU Count: 8

CPU:14
   Id: 14
   Package Id: 0
   Family: 23
   Model: 96
   Type: 0
   Stepping: 1
   Brand: AuthenticAMD
   Core Speed: 3293811384
   Bus Speed: 99812410
   APIC ID: 0xe
   Node: 0
   L2 Cache Size: 524288
   L2 Cache Associativity: 8
   L2 Cache Line Size: 64
   L2 Cache CPU Count: 2
   L3 Cache Size: 4194304
   L3 Cache Associativity: 16
   L3 Cache Line Size: 64
   L3 Cache CPU Count: 8

CPU:15
   Id: 15
   Package Id: 0
   Family: 23
   Model: 96
   Type: 0
   Stepping: 1
   Brand: AuthenticAMD
   Core Speed: 3293811384
   Bus Speed: 99812410
   APIC ID: 0xf
   Node: 0
   L2 Cache Size: 524288
   L2 Cache Associativity: 8
   L2 Cache Line Size: 64
   L2 Cache CPU Count: 2
   L3 Cache Size: 4194304
   L3 Cache Associativity: 16
   L3 Cache Line Size: 64
   L3 Cache CPU Count: 8
[root@minis03:~] esxcli hardware memory get
   Physical Memory: 68096290816 Bytes
   Reliable Memory: 0 Bytes
   NUMA Node Count: 1
[root@minis03:~] esxcli hardware platform get
Platform Information
   UUID: 0x3 0x0 0x2 0x0 0x4 0x0 0x5 0x0 0x0 0x6 0x0 0x7 0x0 0x8 0x0 0x9
   Product Name: HM90
   Vendor Name: BESSTAR TECH LIMITED
   Serial Number: Default string
   Enclosure Serial Number: Default string
   BIOS Asset Tag: Default string
   IPMI Supported: false

esxcli network nic list

[root@minis03:~] esxcli network nic list
Name    PCI Device    Driver         Admin Status  Link Status  Speed  Duplex  MAC Address         MTU  Description
------  ------------  -------------  ------------  -----------  -----  ------  -----------------  ----  -----------
vmnic0  0000:04:00.0  igc-community  Up            Up            1000  Full    1c:83:41:29:9f:e7  1500  Intel Corporation Ethernet Controller I225-V

esxcli storage core hoge

[root@minis03:~] esxcli storage core device list
t10.NVMe____KINGSTON_SNVSE500G______________________655A955168B72600
   Display Name: Local NVMe Disk (t10.NVMe____KINGSTON_SNVSE500G______________________655A955168B72600)
   Has Settable Display Name: false
   Size: 476940
   Device Type: Direct-Access
   Multipath Plugin: HPP
   Devfs Path: /vmfs/devices/disks/t10.NVMe____KINGSTON_SNVSE500G______________________655A955168B72600
   Vendor: NVMe
   Model: KINGSTON SNVSE50
   Revision: EDFK
   SCSI Level: 7
   Is Pseudo: false
   Status: on
   Is RDM Capable: false
   Is Local: true
   Is Removable: false
   Is SSD: true
   Is VVOL PE: false
   Is Offline: false
   Is Perennially Reserved: false
   Queue Full Sample Size: 0
   Queue Full Threshold: 0
   Thin Provisioning Status: yes
   Attached Filters:
   VAAI Status: unsupported
   Other UIDs: vml.05073f2a885c12de15a12173e143764edc07bdff9960fe454f078c5f88af4c6d45
   Is Shared Clusterwide: false
   Is SAS: false
   Is USB: false
   Is Boot Device: true
   Device Max Queue Depth: 1023
   No of outstanding IOs with competing worlds: 32
   Drive Type: physical
   RAID Level: NA
   Number of Physical Drives: 1
   Protection Enabled: false
   PI Activated: false
   PI Type: 0
   PI Protection Mask: NO PROTECTION
   Supported Guard Types: NO GUARD SUPPORT
   DIX Enabled: false
   DIX Guard Type: NO GUARD SUPPORT
   Emulated DIX/DIF Enabled: false

t10.ATA_____CT500MX500SSD1__________________________1851E1DF7EB8________
   Display Name: Local ATA Disk (t10.ATA_____CT500MX500SSD1__________________________1851E1DF7EB8________)
   Has Settable Display Name: false
   Size: 476940
   Device Type: Direct-Access
   Multipath Plugin: HPP
   Devfs Path: /vmfs/devices/disks/t10.ATA_____CT500MX500SSD1__________________________1851E1DF7EB8________
   Vendor: ATA
   Model: CT500MX500SSD1
   Revision: 023
   SCSI Level: 5
   Is Pseudo: false
   Status: on
   Is RDM Capable: false
   Is Local: true
   Is Removable: false
   Is SSD: true
   Is VVOL PE: false
   Is Offline: false
   Is Perennially Reserved: false
   Queue Full Sample Size: 0
   Queue Full Threshold: 0
   Thin Provisioning Status: yes
   Attached Filters:
   VAAI Status: unsupported
   Other UIDs: vml.0100000000313835314531444637454238202020202020202043543530304d
   Is Shared Clusterwide: false
   Is SAS: false
   Is USB: false
   Is Boot Device: false
   Device Max Queue Depth: 31
   No of outstanding IOs with competing worlds: 31
   Drive Type: unknown
   RAID Level: unknown
   Number of Physical Drives: unknown
   Protection Enabled: false
   PI Activated: false
   PI Type: 0
   PI Protection Mask: NO PROTECTION
   Supported Guard Types: NO GUARD SUPPORT
   DIX Enabled: false
   DIX Guard Type: NO GUARD SUPPORT
   Emulated DIX/DIF Enabled: false
[root@minis03:~] esxcli storage core adapter list
HBA Name  Driver     Link State  UID          Capabilities  Description
--------  ---------  ----------  -----------  ------------  -----------
vmhba0    vmw_ahci   link-n/a    sata.vmhba0                (0000:07:00.0) Advanced Micro Devices Inc AMD FCH SATA Controller [AHCI Mode]
vmhba1    vmw_ahci   link-n/a    sata.vmhba1                (0000:07:00.1) Advanced Micro Devices Inc AMD FCH SATA Controller [AHCI Mode]
vmhba2    nvme_pcie  link-n/a    pcie.100                   (0000:01:00.0) Kingston Technology Company, Inc. <class> Non-Volatile memory controller

esxcfg-scsidevs -l

[root@minis03:~] esxcfg-scsidevs -l
t10.ATA_____CT500MX500SSD1__________________________1851E1DF7EB8________
   Device Type: Direct-Access
   Size: 476940 MB
   Display Name: Local ATA Disk (t10.ATA_____CT500MX500SSD1__________________________1851E1DF7EB8________)
   Multipath Plugin: HPP
   Console Device: /vmfs/devices/disks/t10.ATA_____CT500MX500SSD1__________________________1851E1DF7EB8________
   Devfs Path: /vmfs/devices/disks/t10.ATA_____CT500MX500SSD1__________________________1851E1DF7EB8________
   Vendor: ATA       Model: CT500MX500SSD1    Revis: 023
   SCSI Level: 5  Is Pseudo: false Status: on
   Is RDM Capable: false Is Removable: false
   Is Local: true  Is SSD: true
   Other Names:
      vml.0100000000313835314531444637454238202020202020202043543530304d
   VAAI Status: unsupported
t10.NVMe____KINGSTON_SNVSE500G______________________655A955168B72600
   Device Type: Direct-Access
   Size: 476940 MB
   Display Name: Local NVMe Disk (t10.NVMe____KINGSTON_SNVSE500G______________________655A955168B72600)
   Multipath Plugin: HPP
   Console Device: /vmfs/devices/disks/t10.NVMe____KINGSTON_SNVSE500G______________________655A955168B72600
   Devfs Path: /vmfs/devices/disks/t10.NVMe____KINGSTON_SNVSE500G______________________655A955168B72600
   Vendor: NVMe      Model: KINGSTON SNVSE50  Revis: EDFK
   SCSI Level: 7  Is Pseudo: false Status: on
   Is RDM Capable: false Is Removable: false
   Is Local: true  Is SSD: true
   Other Names:
      vml.05073f2a885c12de15a12173e143764edc07bdff9960fe454f078c5f88af4c6d45
      vml.0100000000363535415f393535315f363842375f32363030004b494e475354
   VAAI Status: unsupported

lspci -vvv

[root@minis03:~] lspci -vvv
0000:00:00.0 Bridge Host bridge: Advanced Micro Devices, Inc. [AMD] Renoir Root Complex
         Class 0600: 1022:1630

0000:00:00.2 Generic system peripheral IOMMU: Advanced Micro Devices, Inc. [AMD] Renoir IOMMU
         Class 0806: 1022:1631

0000:00:01.0 Bridge Host bridge: Advanced Micro Devices, Inc. [AMD] Renoir PCIe Dummy Host Bridge
         Class 0600: 1022:1632

0000:00:01.2 Bridge PCI bridge: Advanced Micro Devices, Inc. [AMD] Renoir PCIe GPP Bridge [PCIe RP[0000:00:01.2]]
         Class 0604: 1022:1634

0000:00:01.3 Bridge PCI bridge: Advanced Micro Devices, Inc. [AMD] Renoir PCIe GPP Bridge [PCIe RP[0000:00:01.3]]
         Class 0604: 1022:1634

0000:00:02.0 Bridge Host bridge: Advanced Micro Devices, Inc. [AMD] Renoir PCIe Dummy Host Bridge
         Class 0600: 1022:1632

0000:00:02.1 Bridge PCI bridge: Advanced Micro Devices, Inc. [AMD] Renoir PCIe GPP Bridge [PCIe RP[0000:00:02.1]]
         Class 0604: 1022:1634

0000:00:02.2 Bridge PCI bridge: Advanced Micro Devices, Inc. [AMD] Renoir PCIe GPP Bridge [PCIe RP[0000:00:02.2]]
         Class 0604: 1022:1634

0000:00:02.3 Bridge PCI bridge: Advanced Micro Devices, Inc. [AMD] Renoir PCIe GPP Bridge [PCIe RP[0000:00:02.3]]
         Class 0604: 1022:1634

0000:00:08.0 Bridge Host bridge: Advanced Micro Devices, Inc. [AMD] Renoir PCIe Dummy Host Bridge
         Class 0600: 1022:1632

0000:00:08.1 Bridge PCI bridge: Advanced Micro Devices, Inc. [AMD] Renoir Internal PCIe GPP Bridge to Bus [PCIe RP[0000:00:08.1]]
         Class 0604: 1022:1635

0000:00:08.2 Bridge PCI bridge: Advanced Micro Devices, Inc. [AMD] Renoir Internal PCIe GPP Bridge to Bus [PCIe RP[0000:00:08.2]]
         Class 0604: 1022:1635

0000:00:14.0 Serial bus controller SMBus: Advanced Micro Devices, Inc. [AMD] FCH SMBus Controller
         Class 0c05: 1022:790b

0000:00:14.3 Bridge ISA bridge: Advanced Micro Devices, Inc. [AMD] FCH LPC Bridge
         Class 0601: 1022:790e

0000:00:18.0 Bridge Host bridge: Advanced Micro Devices, Inc. [AMD] Renoir Device 24: Function 0
         Class 0600: 1022:1448

0000:00:18.1 Bridge Host bridge: Advanced Micro Devices, Inc. [AMD] Renoir Device 24: Function 1
         Class 0600: 1022:1449

0000:00:18.2 Bridge Host bridge: Advanced Micro Devices, Inc. [AMD] Renoir Device 24: Function 2
         Class 0600: 1022:144a

0000:00:18.3 Bridge Host bridge: Advanced Micro Devices, Inc. [AMD] Renoir Device 24: Function 3
         Class 0600: 1022:144b

0000:00:18.4 Bridge Host bridge: Advanced Micro Devices, Inc. [AMD] Renoir Device 24: Function 4
         Class 0600: 1022:144c

0000:00:18.5 Bridge Host bridge: Advanced Micro Devices, Inc. [AMD] Renoir Device 24: Function 5
         Class 0600: 1022:144d

0000:00:18.6 Bridge Host bridge: Advanced Micro Devices, Inc. [AMD] Renoir Device 24: Function 6
         Class 0600: 1022:144e

0000:00:18.7 Bridge Host bridge: Advanced Micro Devices, Inc. [AMD] Renoir Device 24: Function 7
         Class 0600: 1022:144f

0000:01:00.0 Mass storage controller Non-Volatile memory controller: Kingston Technology Company, Inc. Device 500e [vmhba2]
         Class 0108: 2646:500e

0000:02:00.0 Network controller Ethernet controller: Realtek Semiconductor Co., Ltd. RTL8111/8168/8411 PCI Express Gigabit Ethernet Controller
         Class 0200: 10ec:8168

0000:03:00.0 Network controller Network controller: MEDIATEK Corp. Device 0608
         Class 0280: 14c3:0608

0000:04:00.0 Network controller Ethernet controller: Intel Corporation Ethernet Controller I225-V [vmnic0]
         Class 0200: 8086:15f3

0000:05:00.0 Serial bus controller USB controller: VIA Technologies, Inc. VL805 USB 3.0 Host Controller
         Class 0c03: 1106:3483

0000:06:00.0 Display controller VGA compatible controller: Advanced Micro Devices, Inc. [AMD/ATI] Renoir
         Class 0300: 1002:1636

0000:06:00.1 Multimedia controller Audio device: Advanced Micro Devices, Inc. [AMD/ATI] Device 1637
         Class 0403: 1002:1637

0000:06:00.2 Encryption controller Encryption controller: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 10h-1fh) Platform Security Processor
         Class 1080: 1022:15df

0000:06:00.3 Serial bus controller USB controller: Advanced Micro Devices, Inc. [AMD] Renoir USB 3.1
         Class 0c03: 1022:1639

0000:06:00.4 Serial bus controller USB controller: Advanced Micro Devices, Inc. [AMD] Renoir USB 3.1
         Class 0c03: 1022:1639

0000:06:00.5 Multimedia controller Multimedia controller: Advanced Micro Devices, Inc. [AMD] Raven/Raven2/FireFlight/Renoir Audio Processor
         Class 0480: 1022:15e2

0000:06:00.6 Multimedia controller Audio device: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 10h-1fh) HD Audio Controller
         Class 0403: 1022:15e3

0000:06:00.7 Signal processing controller Signal processing controller: Advanced Micro Devices, Inc. [AMD] Raven/Raven2/Renoir Sensor Fusion Hub
         Class 1180: 1022:15e4

0000:07:00.0 Mass storage controller SATA controller: Advanced Micro Devices Inc AMD FCH SATA Controller [AHCI Mode] [vmhba0]
         Class 0106: 1022:7901

0000:07:00.1 Mass storage controller SATA controller: Advanced Micro Devices Inc AMD FCH SATA Controller [AHCI Mode] [vmhba1]
         Class 0106: 1022:7901

smbiosDump

[root@minis03:~] smbiosDump
Dumping live SMBIOS data!
  BIOS Info (Type 0): #0
    Size: 0x0001a
    Vendor: "American Megatrends Inc."
    Version: "5.16"
    Date: "10/13/2021"
    Start Address: 0xf0000
    ROM Size: 16384 kB
    Features: 0x0d03000000013f8b9880
      PCI supported
      BIOS flashable
      BIOS shadowing allowed
      CD boot supported
      Selectable boot supported
      BIOS ROM socketed
      EDD spec supported
      1.2MB Floppy supported
      720kB Floppy supported
      2.88MB Floppy supported
      Print Screen supported
      8042 Keyboard Services supported
      Serial Services supported
      Printer Services supported
      ACPI supported
      USB Legacy supported
      BIOS Boot Spec supported
      Enable targeted content distribution
      UEFI supported
    System BIOS release: 5.16
  System Info (Type 1): #1
    Manufacturer: "BESSTAR TECH LIMITED"
    Product: "HM90"
    Version: "Default string"
    Serial: "Default string"
    SKU: "Default string"
    Family: "Default string"
    UUID: 09000800070006000500040003000200
    Wake-up: 0x06 (Power Switch)
  Baseboard Info (Type 2): #2
    Manufacturer: "BESSTAR TECH LIMITED"
    Product: "HM90"
    Version: "Default string"
    Serial: "Default string"
    Asset Tag: "Default string"
    Type: 0x0a (Motherboard)
    Features: 0x09
      Hosting Board
      Replaceable
    Location: "Default string"
    Chassis: #3
  Chassis Info (Type 3): #3
    Manufacturer: "Default string"
    Version: "Default string"
    Serial: "Default string"
    Asset Tag: "Default string"
    Type: 0x03 (Desktop)
    Bootup State: 0x03 (Safe)
    Power Supply State: 0x03 (Safe)
    Thermal State: 0x03 (Safe)
    Security Status: 0x03 (None)
    Power Cords: 1
    SKU: "Default string"
  Onboard Devices (Type 10): #4
    Video: "To Be Filled By O.E.M."
  OEM Strings (Type 11): #5
    Default string
  System Config Options (Type 12) #6:
    Default string
  Type 32 Record: #7
    Data 00: 20 14 07 00 00 00 00 00 00 00 00 00 00 00 00 00
    Data 10: 00 00 00 00
  Type 43 Record: #8
    Data 00: 2b 1f 08 00 41 4d 44 00 02 00 2f 00 03 00 05 00
    Data 10: 00 00 02 10 00 00 00 00 00 00 00 00 00 00 00
    String 1: "TPM 2.0"
    String 2: "AMD"
  32bit-Memory Error Info (Type 18): #9
    Type: 0x03 (OK)
    Granularity: 0x02 (Unknown)
    Operation: 0x02 (Unknown)
  Physical Memory Array (Type 16): #10
    Use: 0x03 (System memory)
    Location: 0x03 (Motherboard)
    Slots: 2
    Max. Size: 32 GB
    ECC: 0x03 (None)
    Error Info: #9
  Memory Array Mapping (Type 19): #11
    Memory Array: #10
    Partition Width: 2
    Start Address: 0x0000000000000000
    End Address: 0x0000001000000000
  Cache Info (Type 7): #12
    Designation: "L1 - Cache"
    Level: L1
    State: Enabled
    Mode: 0x01 (Write Back)
    Location: 0x00 (Internal, Not Socketed)
    ECC: 0x06 (Multi-bit)
    Type: 0x05 (Unified)
    Associativity: 0x07 (8-way Set-Associative)
    Max. Size: 512 kB
    Current Size: 512 kB
    Speed: 1 ns
    Supported SRAM Types: 0x0010 (Pipeline Burst)
    Current SRAM Type: 0x0010 (Pipeline Burst)
  Cache Info (Type 7): #13
    Designation: "L2 - Cache"
    Level: L2
    State: Enabled
    Mode: 0x01 (Write Back)
    Location: 0x00 (Internal, Not Socketed)
    ECC: 0x06 (Multi-bit)
    Type: 0x05 (Unified)
    Associativity: 0x07 (8-way Set-Associative)
    Max. Size: 4096 kB
    Current Size: 4096 kB
    Speed: 1 ns
    Supported SRAM Types: 0x0010 (Pipeline Burst)
    Current SRAM Type: 0x0010 (Pipeline Burst)
  Cache Info (Type 7): #14
    Designation: "L3 - Cache"
    Level: L3
    State: Enabled
    Mode: 0x01 (Write Back)
    Location: 0x00 (Internal, Not Socketed)
    ECC: 0x06 (Multi-bit)
    Type: 0x05 (Unified)
    Associativity: 0x08 (16-way Set-Associative)
    Max. Size: 8192 kB
    Current Size: 8192 kB
    Speed: 1 ns
    Supported SRAM Types: 0x0010 (Pipeline Burst)
    Current SRAM Type: 0x0010 (Pipeline Burst)
  Processor Info (Type 4): #15
    Payload length: 0x30
    Socket: "FP6"
    Socket Type: 0x06 (None)
    Socket Status: Populated
    Type: 0x03 (CPU)
    Family: 0x6b (Zen)
    Manufacturer: "Advanced Micro Devices, Inc."
    Version: "AMD Ryzen 9 4900H with Radeon Graphics"
    Serial: "Unknown"
    Asset Tag: "Unknown"
    Part Number: "Unknown"
    Processor ID: 0x178bfbff00860f01
    Status: 0x01 (Enabled)
    Voltage: 1.2 V
    External Clock: 100 MHz
    Max. Speed: 4450 MHz
    Current Speed: 3300 MHz
    L1 Cache: #12
    L2 Cache: #13
    L3 Cache: #14
    Core Count: 8
    Core Enabled Count: 8
    Thread Count: 16
    Characteristics: 0x00fc (64-bit Capable, Multi-Core, Hardware Thread, Execute Protection, Enhanced Virtualization, Power/Performance Control)
  32bit-Memory Error Info (Type 18): #16
    Type: 0x03 (OK)
    Granularity: 0x02 (Unknown)
    Operation: 0x02 (Unknown)
  Memory Device (Type 17): #17
    Location: "DIMM 0"
    Bank: "P0 CHANNEL A"
    Manufacturer: "Unknown"
    Serial: "00000000"
    Part Number: "TN432G32D822"
    Memory Array: #10
    Error Info: #16
    Form Factor: 0x0d (SODIMM)
    Type: 0x1a (DDR4)
    Type Detail: 0x4080 (Synchronous, Unregistered)
    Data Width: 64 bits
    Size: 32 GB
    Max. Speed: 3200 MT/s
    Rank: 2
    Configured Speed: 3200 MT/s
    Min. Voltage: 1200 mV
    Max. Voltage: 1200 mV
    Configured Voltage: 1200 mV
    Technology: 0x03 (DRAM)
    Mode Capability: 0x0008 (Volatile)
    Firmware Version: "Unknown"
    Module Manufacturer ID: 0x6d06
    Volatile Size: 34359738368 bytes
  Memory Device Mapping (Type 20): #18
    Memory Device: #17
    Array Mapping: #11
    Start Address: 0x0000000000000000
    End Address: 0x0000001000000000
  32bit-Memory Error Info (Type 18): #19
    Type: 0x03 (OK)
    Granularity: 0x02 (Unknown)
    Operation: 0x02 (Unknown)
  Memory Device (Type 17): #20
    Location: "DIMM 0"
    Bank: "P0 CHANNEL B"
    Manufacturer: "Unknown"
    Serial: "00000000"
    Part Number: "TN432G32D822"
    Memory Array: #10
    Error Info: #19
    Form Factor: 0x0d (SODIMM)
    Type: 0x1a (DDR4)
    Type Detail: 0x4080 (Synchronous, Unregistered)
    Data Width: 64 bits
    Size: 32 GB
    Max. Speed: 3200 MT/s
    Rank: 2
    Configured Speed: 3200 MT/s
    Min. Voltage: 1200 mV
    Max. Voltage: 1200 mV
    Configured Voltage: 1200 mV
    Technology: 0x03 (DRAM)
    Mode Capability: 0x0008 (Volatile)
    Firmware Version: "Unknown"
    Module Manufacturer ID: 0x6d06
    Volatile Size: 34359738368 bytes
  Memory Device Mapping (Type 20): #21
    Memory Device: #20
    Array Mapping: #11
    Start Address: 0x0000000000000000
    End Address: 0x0000001000000000
  Port Connector (Type 8): #22
    Type: 0x0d (Keyboard Port)
    Internal Designator: "J2304/J2300"
    External Designator: "Keyboard"
    External Connector: 0x0f (PS/2)
  Port Connector (Type 8): #23
    Type: 0x0e (Mouse Port)
    Internal Designator: "J3811"
    External Designator: "Touch pad"
    External Connector: 0x0f (PS/2)
  Port Connector (Type 8): #24
    Type: 0x10 (USB)
    Internal Designator: "J1504"
    External Designator: "USB 3.0"
    External Connector: 0x12 (Access Bus [USB])
  Port Connector (Type 8): #25
    Type: 0x10 (USB)
    Internal Designator: "J1500"
    External Designator: "USB 3.1"
    External Connector: 0x12 (Access Bus [USB])
  Port Connector (Type 8): #26
    Type: 0x10 (USB)
    Internal Designator: "J1502"
    External Designator: "USB 3.1"
    External Connector: 0x12 (Access Bus [USB])
  Port Connector (Type 8): #27
    Type: 0x10 (USB)
    Internal Designator: "J1501"
    External Designator: "USB 3.1 Type-C"
    External Connector: 0x12 (Access Bus [USB])
  Port Connector (Type 8): #28
    Type: 0x10 (USB)
    Internal Designator: "J1503"
    External Designator: "USB 3.1 Type-C"
    External Connector: 0x12 (Access Bus [USB])
  Port Connector (Type 8): #29
    Type: 0x1f (Network Port)
    Internal Designator: "J1300"
    External Designator: "Network"
    External Connector: 0x0b (RJ-45)
  Port Connector (Type 8): #30
    Type: 0x20 (SATA)
    Internal Designator: "J1701"
    Internal Connector: 0x22 (SAS/SATA Plug Receptacle)
    External Designator: "Sata HDD"
  Port Connector (Type 8): #31
    Type: 0x20 (SATA)
    Internal Designator: "J1703"
    Internal Connector: 0x22 (SAS/SATA Plug Receptacle)
    External Designator: "Sata ODD"
  Port Connector (Type 8): #32
    Type: 0x1c (Video Port)
    Internal Designator: "J1101"
    External Designator: "DP0"
  Port Connector (Type 8): #33
    Type: 0x1c (Video Port)
    Internal Designator: "J1100"
    External Designator: "DP1"
  Port Connector (Type 8): #34
    Type: 0x1d (Audio Port)
    Internal Designator: "J2103"
    External Designator: "Microphone"
    External Connector: 0x1f (Mini-jack [headphones])
  Port Connector (Type 8): #35
    Type: 0x1d (Audio Port)
    Internal Designator: "J2105"
    External Designator: "Headphone"
    External Connector: 0x1f (Mini-jack [headphones])
  System Slot (Type 9): #36
    Designation: "J3604"
    Type: 0xa9 (PCI Express x8)
    Bus Width: 0x0b (x8)
    Status: 0x03 (Available)
    Length: 0x03 (Short)
    Slot ID: 1
    Characteristics: 0x0304 (3.3 V, PME#, Hot-Plug)
    PCI Address: 0200:00:01.1
  System Slot (Type 9): #37
    Designation: "J3711"
    Type: 0x15 (M.2 Socket 1-SD [Mechanical Key E])
    Bus Width: 0x08 (x1)
    Status: 0x04 (In Use)
    Length: 0x03 (Short)
    Slot ID: 3
    Characteristics: 0x0304 (3.3 V, PME#, Hot-Plug)
    PCI Address: 0000:00:01.2
  System Slot (Type 9): #38
    Designation: "J3704"
    Type: 0x17 (M.2 Socket 3 [Mechanical Key M])
    Bus Width: 0x09 (x2)
    Status: 0x03 (Available)
    Length: 0x03 (Short)
    Slot ID: 5
    Characteristics: 0x0304 (3.3 V, PME#, Hot-Plug)
    PCI Address: 0200:00:01.7
  System Slot (Type 9): #39
    Designation: "J3709"
    Type: 0x15 (M.2 Socket 1-SD [Mechanical Key E])
    Bus Width: 0x08 (x1)
    Status: 0x03 (Available)
    Length: 0x03 (Short)
    Slot ID: 6
    Characteristics: 0x0304 (3.3 V, PME#, Hot-Plug)
    PCI Address: 0200:00:01.5
  Onboard Device (Type 41): #40
    Designation: "Onboard LAN Brodcom"
    Status: Enabled
    Type: 0x05 (Ethernet)
    Instance: 0x01
    PCI Address: 0000:02:00.0
  Onboard Device (Type 41): #41
    Designation: "HD Audio Controller"
    Status: Enabled
    Type: 0x07 (Sound)
    Instance: 0x01
    PCI Address: 0000:06:00.6
  Language Info (Type 13): #42
    Languages: en|US|iso8859-1
    Current: en|US|iso8859-1

まとめ

HM80 でも誤家庭向け ESXi 機としてはかなりコスパ良いモデルと思っていましたが、CPU が強化されベアボーンも選べる HM90 は誤家庭 ESXi 機としてはコスパ最強なのでは?と思える仕上がり。

初心者向けには NUC と言うのは揺るぎないですが、ほぼノートラブルで、現状 NUC ではできない 8c/16t を満たせる辺り、コレもかなりオススメできる一品かと。

Salt でサーバに味付けを

こちらの投稿は vExperts Advent Calendar 2021 の 13 日目になります。
今回は大変長くなっております(`・ω・´)
adventar.org

Salt とは?

SaltStack 社により開発が行われていた Python 製のオープンソースな構成管理ツール。
構成管理ツールというと Chef や Puppet、Ansible が有名。
後発だが、初版リリースは Ansible より早いらしい。

2020 年に VMware 社が SaltStack 社を買収したことにより、VMware ファミリーの一員となり、vRealize Automation 8.3 から「vRealize Automation SaltStack Config」、「vRealize Automation SaltStack SecOps」として組み込まれています。
blogs.vmware.com www.vmware.com
なお、Salt のコア部分については VMware 社支援のもと、今まで通りオープンソースプロジェクトとして開発が進んでいます。 github.com
なので…
Salt は VMwareポートフォリオの 1つです
Salt は VMwareポートフォリオの 1つです
大事なことなので(ry

アーキテクチャ

Salt はクライアント/サーバモデルとなっており、Master と呼ばれるコントローラサーバと Minion と呼ばれる各クライアント環境で動くエージェントで構成されます。
Master-Minion 間は SSH は使わず、4505/TCP、4506/TCP で ZeroMQ によるメッセージングライブラリを介して通信を行います。
f:id:masahiroirie:20211212000609j:plain

エージェントとなると各 OS にインストールとなるので、LinuxWindows 等の PC 用の汎用的な OS になってしまうのですが、Salt Proxy Minion を利用することで、Proxy Minion から制御対象に対し APISSH 経由で構成管理を行うことができます。
f:id:masahiroirie:20211212000646j:plain
基本は Minion インストールによるエージェント型なのですが、Salt SSH という方式を使うことで、対象に Minion をインストールすることなく、Master から SSH 経由で管理を行うことも可能。
ただし、Minion に比べると遅いので、初回の Minion インストールや事情により Minion が利用できないケースに使うことが推奨なようです。

インストール

今回は Ubuntu 20.04 の VM に公式リポジトリからapt でインストール。
repo.saltproject.io

Master

mirie@salttest01:~$ sudo curl -fsSL -o /usr/share/keyrings/salt-archive-keyring.gpg https://repo.saltproject.io/py3/ubuntu/20.04/amd64/latest/salt-archive-keyring.gpg
mirie@salttest01:~$ echo "deb [signed-by=/usr/share/keyrings/salt-archive-keyring.gpg arch=amd64] https://repo.saltproject.io/py3/ubuntu/20.04/amd64/latest focal main" | sudo tee /etc/apt/sources.list.d/salt.list
mirie@salttest01:~$ sudo apt update
mirie@salttest01:~$ sudo apt install salt-master

salt-master はとりあえずであれば設定不要。
コレで salt-master のプロセスが起動し、4505/TCP、4506/TCP が LISTEN になっていればおけ。

Minion

リポジトリは同じで、インストール対象が salt-minion に。

mirie@minion01:~$ sudo apt install salt-minion

salt-minion の設定として、salt-master の指定を conf に行う。

mirie@minion01:~$ echo "master: 192.168.100.153" | sudo tee -a /etc/salt/minion
mirie@minion01:~$ sudo systemctl restart salt-minion

こちらは salt-minion のプロセスが起動すれば一旦おけ。

ちなみに Windowsインストーラで Minion をインストールできます。(Master は無さげ)

インストーラでのインストール

インストーラのダウンロードはこちらから。 docs.saltproject.io f:id:masahiroirie:20211208180741j:plain f:id:masahiroirie:20211208180751j:plain f:id:masahiroirie:20211208180803j:plain インストーラの中で Master 指定/識別名指定。 f:id:masahiroirie:20211208180817j:plain f:id:masahiroirie:20211208180917j:plain f:id:masahiroirie:20211208180932j:plain

Minion の認証

Master 指定があっていれば、salt-master で Minion の Key が見えるように。

mirie@salttest01:~$ sudo salt-key -L
Accepted Keys:
Denied Keys:
Unaccepted Keys:
minion01
Rejected Keys:

心当たりがあれば Accept してやる。

mirie@salttest01:~$ sudo salt-key -A
The following keys are going to be accepted:
Unaccepted Keys:
minion01
Proceed? [n/Y] Y
Key for minion minion01 accepted.

これで Master と各 Minion がやりとりするように。

機能

結構多機能なようで触り切れてないのですが、ひとまず自動化・構成管理まわりのトピックとして "Grains""Remote Execution""State" を紹介。
他にも beacon とか reactor とか salt-runner とか色々あるらしいのですが、また機会があれば(←まだ触れてない)

Grains

Salt において、 管理対象のハード情報や OS 情報、ネットワーク情報などあまり変更されない静的に近いシステム情報のことを Grains と言います。
Master から対象 Minion の Grains を取得し参照が可能です。

grains.items の結果(長い)

mirie@salttest01:~$ sudo salt 'minion01' grains.items
minion01:
    ----------
    biosreleasedate:
        11/12/2020
    biosversion:
        6.00
    cpu_flags:
        - fpu
        - vme
        - de
        - pse
        - tsc
        - msr
        - pae
        - mce
        - cx8
        - apic
        - sep
        - mtrr
        - pge
        - mca
        - cmov
        - pat
        - pse36
        - clflush
        - mmx
        - fxsr
        - sse
        - sse2
        - syscall
        - nx
        - mmxext
        - fxsr_opt
        - pdpe1gb
        - rdtscp
        - lm
        - constant_tsc
        - rep_good
        - nopl
        - tsc_reliable
        - nonstop_tsc
        - cpuid
        - extd_apicid
        - pni
        - pclmulqdq
        - ssse3
        - fma
        - cx16
        - sse4_1
        - sse4_2
        - x2apic
        - movbe
        - popcnt
        - aes
        - xsave
        - avx
        - f16c
        - rdrand
        - hypervisor
        - lahf_lm
        - extapic
        - cr8_legacy
        - abm
        - sse4a
        - misalignsse
        - 3dnowprefetch
        - osvw
        - topoext
        - ssbd
        - ibpb
        - vmmcall
        - fsgsbase
        - bmi1
        - avx2
        - smep
        - bmi2
        - rdseed
        - adx
        - smap
        - clflushopt
        - clwb
        - sha_ni
        - xsaveopt
        - xsavec
        - xgetbv1
        - xsaves
        - clzero
        - wbnoinvd
        - arat
        - umip
        - rdpid
        - overflow_recov
        - succor
    cpu_model:
        AMD Ryzen 7 4800U with Radeon Graphics
    cpuarch:
        x86_64
    cwd:
        /
    disks:
        - sr0
    dns:
        ----------
        domain:
        ip4_nameservers:
            - 192.168.100.2
        ip6_nameservers:
        nameservers:
            - 192.168.100.2
        options:
        search:
            - home.lab
        sortlist:
    domain:
    efi:
        False
    efi-secure-boot:
        False
    fqdn:
        minion01
    fqdn_ip4:
        - 127.0.1.1
    fqdn_ip6:
    fqdns:
        - minion01
    gid:
        0
    gpus:
        |_
          ----------
          model:
              SVGA II Adapter
          vendor:
              vmware
    groupname:
        root
    host:
        minion01
    hwaddr_interfaces:
        ----------
        ens192:
            00:50:56:8d:87:a3
        lo:
            00:00:00:00:00:00
    id:
        minion01
    init:
        systemd
    ip4_gw:
        192.168.100.1
    ip4_interfaces:
        ----------
        ens192:
            - 192.168.100.154
        lo:
            - 127.0.0.1
    ip6_gw:
        False
    ip6_interfaces:
        ----------
        ens192:
            - fe80::250:56ff:fe8d:87a3
        lo:
            - ::1
    ip_gw:
        True
    ip_interfaces:
        ----------
        ens192:
            - 192.168.100.154
            - fe80::250:56ff:fe8d:87a3
        lo:
            - 127.0.0.1
            - ::1
    ipv4:
        - 127.0.0.1
        - 192.168.100.154
    ipv6:
        - ::1
        - fe80::250:56ff:fe8d:87a3
    kernel:
        Linux
    kernelparams:
        |_
          - BOOT_IMAGE
          - /boot/vmlinuz-5.4.0-91-generic
        |_
          - root
          - None
        |_
          - ro
          - None
        |_
          - maybe-ubiquity
          - None
    kernelrelease:
        5.4.0-91-generic
    kernelversion:
        #102-Ubuntu SMP Fri Nov 5 16:31:28 UTC 2021
    locale_info:
        ----------
        defaultencoding:
            UTF-8
        defaultlanguage:
            en_US
        detectedencoding:
            utf-8
        timezone:
            UTC
    localhost:
        minion01
    lsb_distrib_codename:
        focal
    lsb_distrib_description:
        Ubuntu 20.04.2 LTS
    lsb_distrib_id:
        Ubuntu
    lsb_distrib_release:
        20.04
    lvm:
        ----------
    machine_id:
        23480b5e791e447eb52bd5e85909d52f
    manufacturer:
        VMware, Inc.
    master:
        192.168.100.153
    mdadm:
    mem_total:
        7962
    nodename:
        minion01
    num_cpus:
        2
    num_gpus:
        1
    os:
        Ubuntu
    os_family:
        Debian
    osarch:
        amd64
    oscodename:
        focal
    osfinger:
        Ubuntu-20.04
    osfullname:
        Ubuntu
    osmajorrelease:
        20
    osrelease:
        20.04
    osrelease_info:
        - 20
        - 4
    path:
        /usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/snap/bin
    pid:
        227322
    productname:
        VMware Virtual Platform
    ps:
        ps -efHww
    pythonexecutable:
        /usr/bin/python3
    pythonpath:
        - /usr/bin
        - /usr/lib/python38.zip
        - /usr/lib/python3.8
        - /usr/lib/python3.8/lib-dynload
        - /usr/local/lib/python3.8/dist-packages
        - /usr/lib/python3/dist-packages
    pythonversion:
        - 3
        - 8
        - 10
        - final
        - 0
    saltpath:
        /usr/lib/python3/dist-packages/salt
    saltversion:
        3004
    saltversioninfo:
        - 3004
    serialnumber:
        VMware-42 0d f1 47 3e f6 10 7b-57 b0 71 dc af 55 22 6c
    server_id:
        1293882994
    shell:
        /bin/sh
    ssds:
        - sda
    swap_total:
        4095
    systemd:
        ----------
        features:
            +PAM +AUDIT +SELINUX +IMA +APPARMOR +SMACK +SYSVINIT +UTMP +LIBCRYPTSETUP +GCRYPT +GNUTLS +ACL +XZ +LZ4 +SECCOMP +BLKID +ELFUTILS +KMOD +IDN2 -IDN +PCRE2 default-hierarchy=hybrid
        version:
            245
    systempath:
        - /usr/local/sbin
        - /usr/local/bin
        - /usr/sbin
        - /usr/bin
        - /sbin
        - /bin
        - /snap/bin
    transactional:
        False
    uid:
        0
    username:
        root
    uuid:
        47f10d42-f63e-7b10-57b0-71dcaf55226c
    virtual:
        VMware
    zfs_feature_flags:
        False
    zfs_support:
        False
    zmqversion:
        4.3.2

システム情報以外にも、/etc/salt/grainYAML 形式でユーザ定義することが可能です。
これを使うことで、例えばサーバグルーピングやメタ情報付与といったことが可能になり、また、それらを利用した対象指定の条件ができます。

# Grains より OS が Ubuntu のものに test.ping を実行
# (1台しかないので分かり難いけど…)
mirie@salttest01:~$ sudo salt -G 'os:Ubuntu' test.ping
minion01:
    True

Remote Execution

端的に言うと psshfabric みたいなもので、Minion としてぶら下がっている対象に対して一斉にコマンドを発行することができます。

mirie@salttest01:~$ sudo salt '*' cmd.run 'uname -a'
minion01:
    Linux minion01 5.4.0-91-generic #102-Ubuntu SMP Fri Nov 5 16:31:28 UTC 2021 x86_64 x86_64 x86_64 GNU/Linux

コマンド実行ができればどうにでもなりますが、汎用的なものや API を叩くようなものは Execition Module として用意されています。
また、それでも足りないものは自分で独自に拡張することも可能です。

# nginx インストール
mirie@salttest01:~$ sudo salt '*' pkg.install nginx
minion01:
    ----------
    fontconfig-config:
        ----------
        new:
            2.13.1-2ubuntu3
        old:
【中略】
    nginx:
        ----------
        new:
            1.18.0-0ubuntu1.2
        old:
    nginx-common:
        ----------
        new:
            1.18.0-0ubuntu1.2
        old:
    nginx-core:
        ----------
        new:
            1.18.0-0ubuntu1.2
        old:

# nginx の configtest
mirie@salttest01:~$ sudo salt '*' nginx.configtest
minion01:
    ----------
    comment:
        Syntax OK
    result:
        True
    stdout:
        nginx: the configuration file /etc/nginx/nginx.conf syntax is ok
        nginx: configuration file /etc/nginx/nginx.conf test is successful

# systemctl からの nginx restart
mirie@salttest01:~$ sudo salt '*' service.restart nginx
minion01:
    True

Execution Module として準備されてるものは以下のページに。
docs.saltproject.io

State

基本的な実行

IaC 的に構成をファイルに記述し、ツールがそれに従って一連のコマンドを実行し、構成や設定を投入するやり方。
Salt だとそのファイルは State と呼ばれ、YAML 形式の sls ファイルで構成を記述します。
↑ と同じように nginx インストール → configtest → restart を構成すると以下。

# デフォルトだと /srv/salt の下を見に行く。
mirie@salttest01:~$ cat /srv/salt/nginx_install.sls
nginx_test:
  pkg.installed:
    - pkgs:
       - nginx

configtest:
  cmd.run:
    - name: /usr/sbin/nginx -t
    - require:
      - nginx_test

nginx_restart:
  cmd.run:
    - name: 'salt-call service.restart nginx'
    - require:
      - nginx_test

これで、salt コマンドで state.apply にて、対象ホストと state を指定すると定義した内容に従ってインストールやコマンドが実行されます。

mirie@salttest01:~$ sudo salt '*' state.apply nginx_install
minion01:
----------
          ID: nginx_test
    Function: pkg.installed
      Result: True
     Comment: The following packages were installed/updated: nginx
     Started: 14:00:22.884601
    Duration: 5405.443 ms
     Changes:
              ----------
              nginx:
                  ----------
                  new:
                      1.18.0-0ubuntu1.2
                  old:
----------
          ID: configtest
    Function: cmd.run
        Name: /usr/sbin/nginx -t
      Result: True
     Comment: Command "/usr/sbin/nginx -t" run
     Started: 14:00:28.291968
    Duration: 11.563 ms
     Changes:
              ----------
              pid:
                  352955
              retcode:
                  0
              stderr:
                  nginx: the configuration file /etc/nginx/nginx.conf syntax is ok
                  nginx: configuration file /etc/nginx/nginx.conf test is successful
              stdout:
----------
          ID: nginx_restart
    Function: cmd.run
        Name: salt-call service.restart nginx
      Result: True
     Comment: Command "salt-call service.restart nginx" run
     Started: 14:00:28.303740
    Duration: 875.27 ms
     Changes:
              ----------
              pid:
                  352957
              retcode:
                  0
              stderr:
              stdout:
                  local:
                      True

Summary for minion01
------------
Succeeded: 3 (changed=3)
Failed:    0
------------
Total states run:     3
Total run time:   6.292 s

State でのホスト指定

数台規模であれば CLI からのホスト指定/ state 指定でもどうにかなりますが、多数のホストに多数の state を管理となってくるとどのホストにどの state かをイチイチ指定していくのはシンドい…
top.sls というファイルに対象ホストや state を指定することで対象と state の管理が可能。

mirie@salttest01:~$ cat /srv/salt/top.sls
base:
  '*':
    - init_server
  'minion01':
    - nginx_install
  'minion02':
    - mysql_install

saltstate.apply にて state 指定なしで top.sls の定義に従って実行されます。

# top.sls に従って全 Minion を実行
mirie@salttest01:~$ sudo salt '*' state.apply

# 特定の対象だけも指定可能
mirie@salttest01:~$ sudo salt 'minion01' state.apply

補:State ファイルの話

State は YAML ファイルと言ったな
あれは嘘だ

State ファイルは YAML 形式のファイルと書きましたが、実は Jinja2 テンプレートなので、ちょっとしたロジックを仕込むことも可能です。
例えば Grains の OS 種類から apache のパッケージ指定するとこんな感じに。

apache:
  pkg.installed:
    {% if grains['os'] == 'RedHat' %}
    - name: httpd
    {% elif grains['os'] == 'Ubuntu' %}
    - name: apache2
    {% endif %}

docs.saltproject.io ちなみに State ファイルにはパスワードとか暗号化キー、可変的な Value を直書きするのはよろしくなく、その辺は pillar という別の機構に格納し、State からは {{ pillar['hoge] }} みたいな形で参照するのがお作法的には正しいようです。

所感

エージェント型となると導入が面倒ではありますが、その分できることは豊富。
Remote Execution だったり、今回は試してないですが、beacon とか salt-runner 辺りが使いこなせればさらに構成管理や日常運用が楽になりそう?
また、エージェント導入も Salt SSH でカバーできたりで大きなマイナスではないかも。

ネックはとにかく情報量の少なさ…
利用が増え、情報量が増えたりモジュール開発がより活発になれば、他の構成管理ツールより強力なツールになり得るポテンシャルは十分に秘めていそうです。

ところで vRealize Automation SaltStack Config は何するの?

そんな Salt の GUIダッシュボード、統合管理、認証、監査ログなどなど、エンタープライズ向け機能が追加されているものが旧 SaltStack Enterprise で、現在で言うところの vRealize Automation SaltStack Config になります。
(Ansible における Ansible Tower みたいな感じ?)

で、試してみようと思うわけですが…MyVMware を見てみると
f:id:masahiroirie:20211208200632p:plain
Download できず。試用不可。

vExpert Portal 上にも何もなく、入手すら不可という状態…orz
(ライセンスは vRealize Suite でいける?)
そのうち検証版出たりするかなぁ。

Appendix

2021/12/15 に開催される VMware DevOps Meetup #11 にて Salt で話をします! vmware.connpass.com ブログ内容ベースにこぼれたネタ + デモを入れる予定ですが、話のボリュームが…

参考サイト

saltproject.io

docs.saltproject.io

docs.vmware.com

www.ipswitch.com

toe.bbtower.co.jp

MINISFORUM EliteMini HM80 ってどう? (ESXi 編)

昨日の続き、MINISFORUM EliteMini HM80 に ESXi をインストールしてみる。 vhoge.hateblo.jp

OS イメージ

8/7 現在最新の ESXi 7.0u2 をそのまま入れると NIC ドライバが無く、インストールが途中でコケる。
(最初は I225-V 載ってるのを知らず、USB-NIC でいくつもりだったけど、そちらもデフォだと入ってないのね…) f:id:masahiroirie:20210811232110p:plain

というわけで、I225-V のコミュニティドライバである igb-community (とついでに USB-NIC も) を突っ込んだカスタムイメージを作り、それを使ってインストールする。

flings.vmware.com

flings.vmware.com

カスタムイメージの作り方は昔の記事参考。
ちなみに VMware.ImageBuilder は core 対応しておらず、最近の PowerShell はデフォだと Core 版が立ち上がるので、旧版に切り替える必要あり。

vhoge.hateblo.jp

vhoge.hateblo.jp

ESXi から見る

HostClient から。 まぁ、OS が変わっただけでハード自体は同じなので特に違いは無いですが…
にしても 8 core 表示は見ていて満足度が高い。 f:id:masahiroirie:20210811235354j:plain 使えるかはさておき、Intel Wi-Fi-6 AX200 (M.2 2230) は出てくるんですね。
f:id:masahiroirie:20210811235054j:plain f:id:masahiroirie:20210811235106j:plain NVMe データストア
autoPartitionOSDataSize はいじってないので約 128GB は ESXi 領域にとられている状態。 f:id:masahiroirie:20210811235909j:plain 物理 NIC (USB-NIC は挿していない状態)。
デュアル NICRealtek もあるが、案の定そちらは認識せず。
I225-V もハード的には 2.5Gbps だけど、対向スイッチが 1Gbps なので 1000 Mbps…に。 f:id:masahiroirie:20210812000051j:plain こちらで見ると 2500 Mbps も見えますね。 f:id:masahiroirie:20210812001039j:plain

上級者用

コマンドのメモ代わりに CLI からハード情報を取ってみる。

ちなみにesxcfg-info の結果は貼るとブラウザ死ぬので割愛…

esxcli hardware hoge

[root@minis01:~] esxcli hardware cpu list
CPU:0
   Id: 0
   Package Id: 0
   Family: 23
   Model: 96
   Type: 0
   Stepping: 1
   Brand: AuthenticAMD
   Core Speed: 1796624579
   Bus Speed: 99812440
   APIC ID: 0x0
   Node: 0
   L2 Cache Size: 524288
   L2 Cache Associativity: 8
   L2 Cache Line Size: 64
   L2 Cache CPU Count: 2
   L3 Cache Size: 4194304
   L3 Cache Associativity: 16
   L3 Cache Line Size: 64
   L3 Cache CPU Count: 8

CPU:1
   Id: 1
   Package Id: 0
   Family: 23
   Model: 96
   Type: 0
   Stepping: 1
   Brand: AuthenticAMD
   Core Speed: 1796624579
   Bus Speed: 99812440
   APIC ID: 0x1
   Node: 0
   L2 Cache Size: 524288
   L2 Cache Associativity: 8
   L2 Cache Line Size: 64
   L2 Cache CPU Count: 2
   L3 Cache Size: 4194304
   L3 Cache Associativity: 16
   L3 Cache Line Size: 64
   L3 Cache CPU Count: 8

CPU:2
   Id: 2
   Package Id: 0
   Family: 23
   Model: 96
   Type: 0
   Stepping: 1
   Brand: AuthenticAMD
   Core Speed: 1796624579
   Bus Speed: 99812440
   APIC ID: 0x2
   Node: 0
   L2 Cache Size: 524288
   L2 Cache Associativity: 8
   L2 Cache Line Size: 64
   L2 Cache CPU Count: 2
   L3 Cache Size: 4194304
   L3 Cache Associativity: 16
   L3 Cache Line Size: 64
   L3 Cache CPU Count: 8

CPU:3
   Id: 3
   Package Id: 0
   Family: 23
   Model: 96
   Type: 0
   Stepping: 1
   Brand: AuthenticAMD
   Core Speed: 1796624579
   Bus Speed: 99812440
   APIC ID: 0x3
   Node: 0
   L2 Cache Size: 524288
   L2 Cache Associativity: 8
   L2 Cache Line Size: 64
   L2 Cache CPU Count: 2
   L3 Cache Size: 4194304
   L3 Cache Associativity: 16
   L3 Cache Line Size: 64
   L3 Cache CPU Count: 8

CPU:4
   Id: 4
   Package Id: 0
   Family: 23
   Model: 96
   Type: 0
   Stepping: 1
   Brand: AuthenticAMD
   Core Speed: 1796624579
   Bus Speed: 99812440
   APIC ID: 0x4
   Node: 0
   L2 Cache Size: 524288
   L2 Cache Associativity: 8
   L2 Cache Line Size: 64
   L2 Cache CPU Count: 2
   L3 Cache Size: 4194304
   L3 Cache Associativity: 16
   L3 Cache Line Size: 64
   L3 Cache CPU Count: 8

CPU:5
   Id: 5
   Package Id: 0
   Family: 23
   Model: 96
   Type: 0
   Stepping: 1
   Brand: AuthenticAMD
   Core Speed: 1796624579
   Bus Speed: 99812440
   APIC ID: 0x5
   Node: 0
   L2 Cache Size: 524288
   L2 Cache Associativity: 8
   L2 Cache Line Size: 64
   L2 Cache CPU Count: 2
   L3 Cache Size: 4194304
   L3 Cache Associativity: 16
   L3 Cache Line Size: 64
   L3 Cache CPU Count: 8

CPU:6
   Id: 6
   Package Id: 0
   Family: 23
   Model: 96
   Type: 0
   Stepping: 1
   Brand: AuthenticAMD
   Core Speed: 1796624579
   Bus Speed: 99812440
   APIC ID: 0x6
   Node: 0
   L2 Cache Size: 524288
   L2 Cache Associativity: 8
   L2 Cache Line Size: 64
   L2 Cache CPU Count: 2
   L3 Cache Size: 4194304
   L3 Cache Associativity: 16
   L3 Cache Line Size: 64
   L3 Cache CPU Count: 8

CPU:7
   Id: 7
   Package Id: 0
   Family: 23
   Model: 96
   Type: 0
   Stepping: 1
   Brand: AuthenticAMD
   Core Speed: 1796624579
   Bus Speed: 99812440
   APIC ID: 0x7
   Node: 0
   L2 Cache Size: 524288
   L2 Cache Associativity: 8
   L2 Cache Line Size: 64
   L2 Cache CPU Count: 2
   L3 Cache Size: 4194304
   L3 Cache Associativity: 16
   L3 Cache Line Size: 64
   L3 Cache CPU Count: 8

CPU:8
   Id: 8
   Package Id: 0
   Family: 23
   Model: 96
   Type: 0
   Stepping: 1
   Brand: AuthenticAMD
   Core Speed: 1796624579
   Bus Speed: 99812440
   APIC ID: 0x8
   Node: 0
   L2 Cache Size: 524288
   L2 Cache Associativity: 8
   L2 Cache Line Size: 64
   L2 Cache CPU Count: 2
   L3 Cache Size: 4194304
   L3 Cache Associativity: 16
   L3 Cache Line Size: 64
   L3 Cache CPU Count: 8

CPU:9
   Id: 9
   Package Id: 0
   Family: 23
   Model: 96
   Type: 0
   Stepping: 1
   Brand: AuthenticAMD
   Core Speed: 1796624579
   Bus Speed: 99812440
   APIC ID: 0x9
   Node: 0
   L2 Cache Size: 524288
   L2 Cache Associativity: 8
   L2 Cache Line Size: 64
   L2 Cache CPU Count: 2
   L3 Cache Size: 4194304
   L3 Cache Associativity: 16
   L3 Cache Line Size: 64
   L3 Cache CPU Count: 8

CPU:10
   Id: 10
   Package Id: 0
   Family: 23
   Model: 96
   Type: 0
   Stepping: 1
   Brand: AuthenticAMD
   Core Speed: 1796624579
   Bus Speed: 99812440
   APIC ID: 0xa
   Node: 0
   L2 Cache Size: 524288
   L2 Cache Associativity: 8
   L2 Cache Line Size: 64
   L2 Cache CPU Count: 2
   L3 Cache Size: 4194304
   L3 Cache Associativity: 16
   L3 Cache Line Size: 64
   L3 Cache CPU Count: 8

CPU:11
   Id: 11
   Package Id: 0
   Family: 23
   Model: 96
   Type: 0
   Stepping: 1
   Brand: AuthenticAMD
   Core Speed: 1796624579
   Bus Speed: 99812440
   APIC ID: 0xb
   Node: 0
   L2 Cache Size: 524288
   L2 Cache Associativity: 8
   L2 Cache Line Size: 64
   L2 Cache CPU Count: 2
   L3 Cache Size: 4194304
   L3 Cache Associativity: 16
   L3 Cache Line Size: 64
   L3 Cache CPU Count: 8

CPU:12
   Id: 12
   Package Id: 0
   Family: 23
   Model: 96
   Type: 0
   Stepping: 1
   Brand: AuthenticAMD
   Core Speed: 1796624579
   Bus Speed: 99812440
   APIC ID: 0xc
   Node: 0
   L2 Cache Size: 524288
   L2 Cache Associativity: 8
   L2 Cache Line Size: 64
   L2 Cache CPU Count: 2
   L3 Cache Size: 4194304
   L3 Cache Associativity: 16
   L3 Cache Line Size: 64
   L3 Cache CPU Count: 8

CPU:13
   Id: 13
   Package Id: 0
   Family: 23
   Model: 96
   Type: 0
   Stepping: 1
   Brand: AuthenticAMD
   Core Speed: 1796624579
   Bus Speed: 99812440
   APIC ID: 0xd
   Node: 0
   L2 Cache Size: 524288
   L2 Cache Associativity: 8
   L2 Cache Line Size: 64
   L2 Cache CPU Count: 2
   L3 Cache Size: 4194304
   L3 Cache Associativity: 16
   L3 Cache Line Size: 64
   L3 Cache CPU Count: 8

CPU:14
   Id: 14
   Package Id: 0
   Family: 23
   Model: 96
   Type: 0
   Stepping: 1
   Brand: AuthenticAMD
   Core Speed: 1796624579
   Bus Speed: 99812440
   APIC ID: 0xe
   Node: 0
   L2 Cache Size: 524288
   L2 Cache Associativity: 8
   L2 Cache Line Size: 64
   L2 Cache CPU Count: 2
   L3 Cache Size: 4194304
   L3 Cache Associativity: 16
   L3 Cache Line Size: 64
   L3 Cache CPU Count: 8

CPU:15
   Id: 15
   Package Id: 0
   Family: 23
   Model: 96
   Type: 0
   Stepping: 1
   Brand: AuthenticAMD
   Core Speed: 1796624579
   Bus Speed: 99812440
   APIC ID: 0xf
   Node: 0
   L2 Cache Size: 524288
   L2 Cache Associativity: 8
   L2 Cache Line Size: 64
   L2 Cache CPU Count: 2
   L3 Cache Size: 4194304
   L3 Cache Associativity: 16
   L3 Cache Line Size: 64
   L3 Cache CPU Count: 8
[root@minis01:~] esxcli hardware memory get
   Physical Memory: 33736523776 Bytes
   Reliable Memory: 0 Bytes
   NUMA Node Count: 1
[root@minis01:~] esxcli hardware platform get
Platform Information
   UUID: 0x3 0x0 0x2 0x0 0x4 0x0 0x5 0x0 0x0 0x6 0x0 0x7 0x0 0x8 0x0 0x9
   Product Name: HM80
   Vendor Name: BESSTAR TECH LIMITED
   Serial Number: Default string
   Enclosure Serial Number: Default string
   BIOS Asset Tag: Default string
   IPMI Supported: false
`esxcli hardware pci list` も長すぎて死ねる… あと ipmi は載ってないので`esxcli hardware ipmi hoge`も省略。

esxcli network nic list

[root@minis01:~] esxcli network nic list
Name    PCI Device    Driver         Admin Status  Link Status  Speed  Duplex  MAC Address         MTU  Description
------  ------------  -------------  ------------  -----------  -----  ------  -----------------  ----  -----------
vmnic0  0000:04:00.0  igc-community  Up            Up            1000  Full    1c:83:41:30:12:ac  1500  Intel Corporation Ethernet Controller I225-V

esxcli storage core hoge

[root@minis01:~] esxcli storage core device list
t10.NVMe____KINGSTON_OM8PCP3512F2DA02________________F5EB7F4A68B72600
   Display Name: Local NVMe Disk (t10.NVMe____KINGSTON_OM8PCP3512F2DA02________________F5EB7F4A68B72600)
   Has Settable Display Name: false
   Size: 488386
   Device Type: Direct-Access
   Multipath Plugin: HPP
   Devfs Path: /vmfs/devices/disks/t10.NVMe____KINGSTON_OM8PCP3512F2DA02________________F5EB7F4A68B72600
   Vendor: NVMe
   Model: KINGSTON OM8PCP3
   Revision: ECFK
   SCSI Level: 7
   Is Pseudo: false
   Status: on
   Is RDM Capable: false
   Is Local: true
   Is Removable: false
   Is SSD: true
   Is VVOL PE: false
   Is Offline: false
   Is Perennially Reserved: false
   Queue Full Sample Size: 0
   Queue Full Threshold: 0
   Thin Provisioning Status: yes
   Attached Filters:
   VAAI Status: unsupported
   Other UIDs: vml.053bf8d1d17026c7b81c8838726d27702df3f12293828ae2142edf55122182da81
   Is Shared Clusterwide: false
   Is SAS: false
   Is USB: false
   Is Boot Device: true
   Device Max Queue Depth: 1023
   No of outstanding IOs with competing worlds: 32
   Drive Type: physical
   RAID Level: NA
   Number of Physical Drives: 1
   Protection Enabled: false
   PI Activated: false
   PI Type: 0
   PI Protection Mask: NO PROTECTION
   Supported Guard Types: NO GUARD SUPPORT
   DIX Enabled: false
   DIX Guard Type: NO GUARD SUPPORT
   Emulated DIX/DIF Enabled: false
[root@minis01:~] esxcli storage core adapter list
HBA Name  Driver     Link State  UID          Capabilities  Description
--------  ---------  ----------  -----------  ------------  -----------
vmhba0    vmw_ahci   link-n/a    sata.vmhba0                (0000:07:00.0) Advanced Micro Devices Inc AMD FCH SATA Controller [AHCI Mode]
vmhba1    vmw_ahci   link-n/a    sata.vmhba1                (0000:07:00.1) Advanced Micro Devices Inc AMD FCH SATA Controller [AHCI Mode]
vmhba2    nvme_pcie  link-n/a    pcie.100                   (0000:01:00.0) Kingston Technology Company, Inc. <class> Non-Volatile memory controller
[root@minis01:~] esxcli storage core path list
pcie.100-pcie.0:0-t10.NVMe____KINGSTON_OM8PCP3512F2DA02________________F5EB7F4A68B72600
   UID: pcie.100-pcie.0:0-t10.NVMe____KINGSTON_OM8PCP3512F2DA02________________F5EB7F4A68B72600
   Runtime Name: vmhba2:C0:T0:L0
   Device: t10.NVMe____KINGSTON_OM8PCP3512F2DA02________________F5EB7F4A68B72600
   Device Display Name: Local NVMe Disk (t10.NVMe____KINGSTON_OM8PCP3512F2DA02________________F5EB7F4A68B72600)
   Adapter: vmhba2
   Channel: 0
   Target: 0
   LUN: 0
   Plugin: HPP
   State: active
   Transport: pcie
   Adapter Identifier: pcie.100
   Target Identifier: pcie.0:0
   Adapter Transport Details: Unavailable or path is unclaimed
   Target Transport Details: Unavailable or path is unclaimed

esxcfg-scsidevs -l

[root@minis01:~] esxcfg-scsidevs -l
t10.NVMe____KINGSTON_OM8PCP3512F2DA02________________F5EB7F4A68B72600
   Device Type: Direct-Access
   Size: 488386 MB
   Display Name: Local NVMe Disk (t10.NVMe____KINGSTON_OM8PCP3512F2DA02________________F5EB7F4A68B72600)
   Multipath Plugin: HPP
   Console Device: /vmfs/devices/disks/t10.NVMe____KINGSTON_OM8PCP3512F2DA02________________F5EB7F4A68B72600
   Devfs Path: /vmfs/devices/disks/t10.NVMe____KINGSTON_OM8PCP3512F2DA02________________F5EB7F4A68B72600
   Vendor: NVMe      Model: KINGSTON OM8PCP3  Revis: ECFK
   SCSI Level: 7  Is Pseudo: false Status: on
   Is RDM Capable: false Is Removable: false
   Is Local: true  Is SSD: true
   Other Names:
      vml.053bf8d1d17026c7b81c8838726d27702df3f12293828ae2142edf55122182da81
      vml.0100000000463545425f374634415f363842375f32363030004b494e475354
   VAAI Status: unsupported

lspci -vvv

[root@minis01:~] lspci -vvv
0000:00:00.0 Bridge Host bridge: Advanced Micro Devices, Inc. [AMD] Renoir Root Complex
         Class 0600: 1022:1630

0000:00:00.2 Generic system peripheral IOMMU: Advanced Micro Devices, Inc. [AMD] Renoir IOMMU
         Class 0806: 1022:1631

0000:00:01.0 Bridge Host bridge: Advanced Micro Devices, Inc. [AMD] Renoir PCIe Dummy Host Bridge
         Class 0600: 1022:1632

0000:00:01.2 Bridge PCI bridge: Advanced Micro Devices, Inc. [AMD] Renoir PCIe GPP Bridge [PCIe RP[0000:00:01.2]]
         Class 0604: 1022:1634

0000:00:01.3 Bridge PCI bridge: Advanced Micro Devices, Inc. [AMD] Renoir PCIe GPP Bridge [PCIe RP[0000:00:01.3]]
         Class 0604: 1022:1634

0000:00:02.0 Bridge Host bridge: Advanced Micro Devices, Inc. [AMD] Renoir PCIe Dummy Host Bridge
         Class 0600: 1022:1632

0000:00:02.1 Bridge PCI bridge: Advanced Micro Devices, Inc. [AMD] Renoir PCIe GPP Bridge [PCIe RP[0000:00:02.1]]
         Class 0604: 1022:1634

0000:00:02.2 Bridge PCI bridge: Advanced Micro Devices, Inc. [AMD] Renoir PCIe GPP Bridge [PCIe RP[0000:00:02.2]]
         Class 0604: 1022:1634

0000:00:02.3 Bridge PCI bridge: Advanced Micro Devices, Inc. [AMD] Renoir PCIe GPP Bridge [PCIe RP[0000:00:02.3]]
         Class 0604: 1022:1634

0000:00:08.0 Bridge Host bridge: Advanced Micro Devices, Inc. [AMD] Renoir PCIe Dummy Host Bridge
         Class 0600: 1022:1632

0000:00:08.1 Bridge PCI bridge: Advanced Micro Devices, Inc. [AMD] Renoir Internal PCIe GPP Bridge to Bus [PCIe RP[0000:00:08.1]]
         Class 0604: 1022:1635

0000:00:08.2 Bridge PCI bridge: Advanced Micro Devices, Inc. [AMD] Renoir Internal PCIe GPP Bridge to Bus [PCIe RP[0000:00:08.2]]
         Class 0604: 1022:1635

0000:00:14.0 Serial bus controller SMBus: Advanced Micro Devices, Inc. [AMD] FCH SMBus Controller
         Class 0c05: 1022:790b

0000:00:14.3 Bridge ISA bridge: Advanced Micro Devices, Inc. [AMD] FCH LPC Bridge
         Class 0601: 1022:790e

0000:00:18.0 Bridge Host bridge: Advanced Micro Devices, Inc. [AMD] Renoir Device 24: Function 0
         Class 0600: 1022:1448

0000:00:18.1 Bridge Host bridge: Advanced Micro Devices, Inc. [AMD] Renoir Device 24: Function 1
         Class 0600: 1022:1449

0000:00:18.2 Bridge Host bridge: Advanced Micro Devices, Inc. [AMD] Renoir Device 24: Function 2
         Class 0600: 1022:144a

0000:00:18.3 Bridge Host bridge: Advanced Micro Devices, Inc. [AMD] Renoir Device 24: Function 3
         Class 0600: 1022:144b

0000:00:18.4 Bridge Host bridge: Advanced Micro Devices, Inc. [AMD] Renoir Device 24: Function 4
         Class 0600: 1022:144c

0000:00:18.5 Bridge Host bridge: Advanced Micro Devices, Inc. [AMD] Renoir Device 24: Function 5
         Class 0600: 1022:144d

0000:00:18.6 Bridge Host bridge: Advanced Micro Devices, Inc. [AMD] Renoir Device 24: Function 6
         Class 0600: 1022:144e

0000:00:18.7 Bridge Host bridge: Advanced Micro Devices, Inc. [AMD] Renoir Device 24: Function 7
         Class 0600: 1022:144f

0000:01:00.0 Mass storage controller Non-Volatile memory controller: Kingston Technology Company, Inc. Device 500c [vmhba2]
         Class 0108: 2646:500c

0000:02:00.0 Network controller Ethernet controller: Realtek Semiconductor Co., Ltd. RTL8111/8168/8411 PCI Express Gigabit Ethernet Controller
         Class 0200: 10ec:8168

0000:03:00.0 Network controller Network controller: Intel Corporation Wi-Fi 6 AX200
         Class 0280: 8086:2723

0000:04:00.0 Network controller Ethernet controller: Intel Corporation Ethernet Controller I225-V [vmnic0]
         Class 0200: 8086:15f3

0000:05:00.0 Serial bus controller USB controller: VIA Technologies, Inc. VL805 USB 3.0 Host Controller
         Class 0c03: 1106:3483

0000:06:00.0 Display controller VGA compatible controller: Advanced Micro Devices, Inc. [AMD/ATI] Renoir
         Class 0300: 1002:1636

0000:06:00.1 Multimedia controller Audio device: Advanced Micro Devices, Inc. [AMD/ATI] Device 1637
         Class 0403: 1002:1637

0000:06:00.2 Encryption controller Encryption controller: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 10h-1fh) Platform Security Processor
         Class 1080: 1022:15df

0000:06:00.3 Serial bus controller USB controller: Advanced Micro Devices, Inc. [AMD] Renoir USB 3.1
         Class 0c03: 1022:1639

0000:06:00.4 Serial bus controller USB controller: Advanced Micro Devices, Inc. [AMD] Renoir USB 3.1
         Class 0c03: 1022:1639

0000:06:00.5 Multimedia controller Multimedia controller: Advanced Micro Devices, Inc. [AMD] Raven/Raven2/FireFlight/Renoir Audio Processor
         Class 0480: 1022:15e2

0000:06:00.6 Multimedia controller Audio device: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 10h-1fh) HD Audio Controller
         Class 0403: 1022:15e3

0000:06:00.7 Signal processing controller Signal processing controller: Advanced Micro Devices, Inc. [AMD] Raven/Raven2/Renoir Sensor Fusion Hub
         Class 1180: 1022:15e4

0000:07:00.0 Mass storage controller SATA controller: Advanced Micro Devices Inc AMD FCH SATA Controller [AHCI Mode] [vmhba0]
         Class 0106: 1022:7901

0000:07:00.1 Mass storage controller SATA controller: Advanced Micro Devices Inc AMD FCH SATA Controller [AHCI Mode] [vmhba1]
         Class 0106: 1022:7901

smbiosDump

[root@minis01:~] smbiosDump
Dumping live SMBIOS data!
  BIOS Info (Type 0): #0
    Size: 0x0001a
    Vendor: "American Megatrends Inc."
    Version: "5.16"
    Date: "07/09/2021"
    Start Address: 0xf0000
    ROM Size: 16384 kB
    Features: 0x0d03000000013f8b9880
      PCI supported
      BIOS flashable
      BIOS shadowing allowed
      CD boot supported
      Selectable boot supported
      BIOS ROM socketed
      EDD spec supported
      1.2MB Floppy supported
      720kB Floppy supported
      2.88MB Floppy supported
      Print Screen supported
      8042 Keyboard Services supported
      Serial Services supported
      Printer Services supported
      ACPI supported
      USB Legacy supported
      BIOS Boot Spec supported
      Enable targeted content distribution
      UEFI supported
    System BIOS release: 5.16
  System Info (Type 1): #1
    Manufacturer: "BESSTAR TECH LIMITED"
    Product: "HM80"
    Version: "Default string"
    Serial: "Default string"
    SKU: "Default string"
    Family: "Default string"
    UUID: 09000800070006000500040003000200
    Wake-up: 0x06 (Power Switch)
  Baseboard Info (Type 2): #2
    Manufacturer: "BESSTAR TECH LIMITED"
    Product: "HM80"
    Version: "Default string"
    Serial: "Default string"
    Asset Tag: "Default string"
    Type: 0x0a (Motherboard)
    Features: 0x09
      Hosting Board
      Replaceable
    Location: "Default string"
    Chassis: #3
  Chassis Info (Type 3): #3
    Manufacturer: "Default string"
    Version: "Default string"
    Serial: "Default string"
    Asset Tag: "Default string"
    Type: 0x03 (Desktop)
    Bootup State: 0x03 (Safe)
    Power Supply State: 0x03 (Safe)
    Thermal State: 0x03 (Safe)
    Security Status: 0x03 (None)
    Power Cords: 1
    SKU: "Default string"
  Onboard Devices (Type 10): #4
    Video: "To Be Filled By O.E.M."
  OEM Strings (Type 11): #5
    Default string
  System Config Options (Type 12) #6:
    Default string
  Type 32 Record: #7
    Data 00: 20 14 07 00 00 00 00 00 00 00 00 00 00 00 00 00
    Data 10: 00 00 00 00
  Type 43 Record: #8
    Data 00: 2b 1f 08 00 41 4d 44 00 02 00 2f 00 03 00 05 00
    Data 10: 00 00 02 10 00 00 00 00 00 00 00 00 00 00 00
    String 1: "TPM 2.0"
    String 2: "AMD"
  32bit-Memory Error Info (Type 18): #9
    Type: 0x03 (OK)
    Granularity: 0x02 (Unknown)
    Operation: 0x02 (Unknown)
  Physical Memory Array (Type 16): #10
    Use: 0x03 (System memory)
    Location: 0x03 (Motherboard)
    Slots: 2
    Max. Size: 32 GB
    ECC: 0x03 (None)
    Error Info: #9
  Memory Array Mapping (Type 19): #11
    Memory Array: #10
    Partition Width: 2
    Start Address: 0x0000000000000000
    End Address: 0x0000000800000000
  Cache Info (Type 7): #12
    Designation: "L1 - Cache"
    Level: L1
    State: Enabled
    Mode: 0x01 (Write Back)
    Location: 0x00 (Internal, Not Socketed)
    ECC: 0x06 (Multi-bit)
    Type: 0x05 (Unified)
    Associativity: 0x07 (8-way Set-Associative)
    Max. Size: 512 kB
    Current Size: 512 kB
    Speed: 1 ns
    Supported SRAM Types: 0x0010 (Pipeline Burst)
    Current SRAM Type: 0x0010 (Pipeline Burst)
  Cache Info (Type 7): #13
    Designation: "L2 - Cache"
    Level: L2
    State: Enabled
    Mode: 0x01 (Write Back)
    Location: 0x00 (Internal, Not Socketed)
    ECC: 0x06 (Multi-bit)
    Type: 0x05 (Unified)
    Associativity: 0x07 (8-way Set-Associative)
    Max. Size: 4096 kB
    Current Size: 4096 kB
    Speed: 1 ns
    Supported SRAM Types: 0x0010 (Pipeline Burst)
    Current SRAM Type: 0x0010 (Pipeline Burst)
  Cache Info (Type 7): #14
    Designation: "L3 - Cache"
    Level: L3
    State: Enabled
    Mode: 0x01 (Write Back)
    Location: 0x00 (Internal, Not Socketed)
    ECC: 0x06 (Multi-bit)
    Type: 0x05 (Unified)
    Associativity: 0x08 (16-way Set-Associative)
    Max. Size: 8192 kB
    Current Size: 8192 kB
    Speed: 1 ns
    Supported SRAM Types: 0x0010 (Pipeline Burst)
    Current SRAM Type: 0x0010 (Pipeline Burst)
  Processor Info (Type 4): #15
    Payload length: 0x30
    Socket: "FP6"
    Socket Type: 0x06 (None)
    Socket Status: Populated
    Type: 0x03 (CPU)
    Family: 0x6b (Zen)
    Manufacturer: "Advanced Micro Devices, Inc."
    Version: "AMD Ryzen 7 4800U with Radeon Graphics"
    Serial: "Unknown"
    Asset Tag: "Unknown"
    Part Number: "Unknown"
    Processor ID: 0x178bfbff00860f01
    Status: 0x01 (Enabled)
    Voltage: 1.2 V
    External Clock: 100 MHz
    Max. Speed: 4300 MHz
    Current Speed: 1800 MHz
    L1 Cache: #12
    L2 Cache: #13
    L3 Cache: #14
    Core Count: 8
    Core Enabled Count: 8
    Thread Count: 16
    Characteristics: 0x00fc (64-bit Capable, Multi-Core, Hardware Thread, Execute Protection, Enhanced Virtualization, Power/Performance Control)
  32bit-Memory Error Info (Type 18): #16
    Type: 0x03 (OK)
    Granularity: 0x02 (Unknown)
    Operation: 0x02 (Unknown)
  Memory Device (Type 17): #17
    Location: "DIMM 0"
    Bank: "P0 CHANNEL A"
    Manufacturer: "Kingston"
    Serial: "726349A1"
    Part Number: "CBD32D4S2S8ME-16"
    Memory Array: #10
    Error Info: #16
    Form Factor: 0x0d (SODIMM)
    Type: 0x1a (DDR4)
    Type Detail: 0x4080 (Synchronous, Unregistered)
    Data Width: 64 bits
    Size: 16 GB
    Max. Speed: 3200 MT/s
    Rank: 1
    Configured Speed: 3200 MT/s
    Min. Voltage: 1200 mV
    Max. Voltage: 1200 mV
    Configured Voltage: 1200 mV
    Technology: 0x03 (DRAM)
    Mode Capability: 0x0008 (Volatile)
    Firmware Version: "Unknown"
    Module Manufacturer ID: 0x9801
    Volatile Size: 17179869184 bytes
  Memory Device Mapping (Type 20): #18
    Memory Device: #17
    Array Mapping: #11
    Start Address: 0x0000000000000000
    End Address: 0x0000000800000000
  32bit-Memory Error Info (Type 18): #19
    Type: 0x03 (OK)
    Granularity: 0x02 (Unknown)
    Operation: 0x02 (Unknown)
  Memory Device (Type 17): #20
    Location: "DIMM 0"
    Bank: "P0 CHANNEL B"
    Manufacturer: "Kingston"
    Serial: "7D634996"
    Part Number: "CBD32D4S2S8ME-16"
    Memory Array: #10
    Error Info: #19
    Form Factor: 0x0d (SODIMM)
    Type: 0x1a (DDR4)
    Type Detail: 0x4080 (Synchronous, Unregistered)
    Data Width: 64 bits
    Size: 16 GB
    Max. Speed: 3200 MT/s
    Rank: 1
    Configured Speed: 3200 MT/s
    Min. Voltage: 1200 mV
    Max. Voltage: 1200 mV
    Configured Voltage: 1200 mV
    Technology: 0x03 (DRAM)
    Mode Capability: 0x0008 (Volatile)
    Firmware Version: "Unknown"
    Module Manufacturer ID: 0x9801
    Volatile Size: 17179869184 bytes
  Memory Device Mapping (Type 20): #21
    Memory Device: #20
    Array Mapping: #11
    Start Address: 0x0000000000000000
    End Address: 0x0000000800000000
  Port Connector (Type 8): #22
    Type: 0x0d (Keyboard Port)
    Internal Designator: "J2304/J2300"
    External Designator: "Keyboard"
    External Connector: 0x0f (PS/2)
  Port Connector (Type 8): #23
    Type: 0x0e (Mouse Port)
    Internal Designator: "J3811"
    External Designator: "Touch pad"
    External Connector: 0x0f (PS/2)
  Port Connector (Type 8): #24
    Type: 0x10 (USB)
    Internal Designator: "J1504"
    External Designator: "USB 3.0"
    External Connector: 0x12 (Access Bus [USB])
  Port Connector (Type 8): #25
    Type: 0x10 (USB)
    Internal Designator: "J1500"
    External Designator: "USB 3.1"
    External Connector: 0x12 (Access Bus [USB])
  Port Connector (Type 8): #26
    Type: 0x10 (USB)
    Internal Designator: "J1502"
    External Designator: "USB 3.1"
    External Connector: 0x12 (Access Bus [USB])
  Port Connector (Type 8): #27
    Type: 0x10 (USB)
    Internal Designator: "J1501"
    External Designator: "USB 3.1 Type-C"
    External Connector: 0x12 (Access Bus [USB])
  Port Connector (Type 8): #28
    Type: 0x10 (USB)
    Internal Designator: "J1503"
    External Designator: "USB 3.1 Type-C"
    External Connector: 0x12 (Access Bus [USB])
  Port Connector (Type 8): #29
    Type: 0x1f (Network Port)
    Internal Designator: "J1300"
    External Designator: "Network"
    External Connector: 0x0b (RJ-45)
  Port Connector (Type 8): #30
    Type: 0x20 (SATA)
    Internal Designator: "J1701"
    Internal Connector: 0x22 (SAS/SATA Plug Receptacle)
    External Designator: "Sata HDD"
  Port Connector (Type 8): #31
    Type: 0x20 (SATA)
    Internal Designator: "J1703"
    Internal Connector: 0x22 (SAS/SATA Plug Receptacle)
    External Designator: "Sata ODD"
  Port Connector (Type 8): #32
    Type: 0x1c (Video Port)
    Internal Designator: "J1101"
    External Designator: "DP0"
  Port Connector (Type 8): #33
    Type: 0x1c (Video Port)
    Internal Designator: "J1100"
    External Designator: "DP1"
  Port Connector (Type 8): #34
    Type: 0x1d (Audio Port)
    Internal Designator: "J2103"
    External Designator: "Microphone"
    External Connector: 0x1f (Mini-jack [headphones])
  Port Connector (Type 8): #35
    Type: 0x1d (Audio Port)
    Internal Designator: "J2105"
    External Designator: "Headphone"
    External Connector: 0x1f (Mini-jack [headphones])
  System Slot (Type 9): #36
    Designation: "J3604"
    Type: 0xa9 (PCI Express x8)
    Bus Width: 0x0b (x8)
    Status: 0x03 (Available)
    Length: 0x03 (Short)
    Slot ID: 1
    Characteristics: 0x0304 (3.3 V, PME#, Hot-Plug)
    PCI Address: 0200:00:01.1
  System Slot (Type 9): #37
    Designation: "J3711"
    Type: 0x15 (M.2 Socket 1-SD [Mechanical Key E])
    Bus Width: 0x08 (x1)
    Status: 0x04 (In Use)
    Length: 0x03 (Short)
    Slot ID: 3
    Characteristics: 0x0304 (3.3 V, PME#, Hot-Plug)
    PCI Address: 0000:00:01.2
  System Slot (Type 9): #38
    Designation: "J3704"
    Type: 0x17 (M.2 Socket 3 [Mechanical Key M])
    Bus Width: 0x09 (x2)
    Status: 0x03 (Available)
    Length: 0x03 (Short)
    Slot ID: 5
    Characteristics: 0x0304 (3.3 V, PME#, Hot-Plug)
    PCI Address: 0200:00:01.7
  System Slot (Type 9): #39
    Designation: "J3709"
    Type: 0x15 (M.2 Socket 1-SD [Mechanical Key E])
    Bus Width: 0x08 (x1)
    Status: 0x03 (Available)
    Length: 0x03 (Short)
    Slot ID: 6
    Characteristics: 0x0304 (3.3 V, PME#, Hot-Plug)
    PCI Address: 0200:00:01.5
  Onboard Device (Type 41): #40
    Designation: "Onboard LAN Brodcom"
    Status: Enabled
    Type: 0x05 (Ethernet)
    Instance: 0x01
    PCI Address: 0000:02:00.0
  Onboard Device (Type 41): #41
    Designation: "HD Audio Controller"
    Status: Enabled
    Type: 0x07 (Sound)
    Instance: 0x01
    PCI Address: 0000:06:00.6
  Language Info (Type 13): #42
    Languages: en|US|iso8859-1
    Current: en|US|iso8859-1

FYI

何するかはさておき、8c/16t でコスパ抜群と満足度高めな HM80 ですが、
早くも MINISFORUM の後継(?)モデルが…

Minisforum EliteMini HX90store.minisforum.jp

同じ 8c/16t ではあるが、CPU が Zen3 な AMD Ryzen9 5900HX になり、4画面出力対応。
メモリ/NVMe 無しのベアボーンモデルがあるので、メモリ 64GB 載せるつもりならこちらの方がお得…?

にしても MINISFORUM、他にも多数新モデル出してたりと勢いあるなぁ…

MINISFORUM EliteMini HM80 ってどう?

予約開始からはや 2 カ月、ようやく MINISFORUM EliteMini HM80 が納品。

Minisforum EliteMini HM80store.minisforum.jp

f:id:masahiroirie:20210810231841j:plain

Ryzen 4800U、32GB MEM/512GB NVMe、Win10Pro 搭載ながら予約特価 97,000 というかなりのコストパフォーマンス。

基本スペック

コンポーネント スペック値
製品名 MINISFORUM EliteMini HM80
CPU Ryzen 4800U 8c/16t
Memory DDR4 SO-DIMM 32GB
GPU AMD Radeon™ Graphics (1750MHz)
Disk NVMe 512GB
拡張Disk 2.5inch SATA 3.0 スロット x 2
NIC M.2 2230 WI-Fi6 / 2.5Gbps NIC / 1Gbps NIC
電源 Type-C 給電 DC19V/3.42A (≒65W)
本体サイズ 149.6 x 149.6 x 55.5mm

外観

正面、オーディオに USB 3.1 Gen.2 x 2、USB Type-C (兼 DP) f:id:masahiroirie:20210810233728j:plain

背面、USB 3.0 x 4、1G/2.5Gbps NIC、DP、HDMI、電源(Type-C)、セキュリティスロット f:id:masahiroirie:20210810234040j:plain

サイズ感、NUC より一回り大きい f:id:masahiroirie:20210810234430j:plain

梱包物、各ケーブルに VESA マウント用ブラケット f:id:masahiroirie:20210810234454j:plain

もうちょい詳しく

プリインストール Windows からもうちょい見てみる。
システム情報 f:id:masahiroirie:20210810235934j:plain

CPUZより
f:id:masahiroirie:20210810235134j:plainf:id:masahiroirie:20210810235138j:plainf:id:masahiroirie:20210810235151j:plain f:id:masahiroirie:20210810235308j:plain

メモリは Kingston 製 DDR4-3200 で Micron チップ
f:id:masahiroirie:20210810235459j:plain f:id:masahiroirie:20210810235511j:plain

f:id:masahiroirie:20210810235619j:plainf:id:masahiroirie:20210810235649j:plain

ネットワークアダプタ
2.5Gbps はなんと Intel I225-V (1Gps は Realtek)
AMD なので諦めていたが、コレはうれしい誤算。 f:id:masahiroirie:20210811000059j:plain

バイスマネージャ
NVMe も Kingston 製 f:id:masahiroirie:20210811000557j:plainf:id:masahiroirie:20210811000607j:plain

型番的にはこの辺りの後継? www.kingston.com

Windows から見た限りはこんなもので。
I225-V ということでますます ESXi 向きじゃんとますます期待が高まる。

長くなったので ESXi インストールしてみた編はまた後日。

ホスト追加が"Unable to push signed certificate to host"でエラーになるときー

Raspberry Pi 4B を追加調達したので ESXi を入れて vCenter に登録しようとすると… f:id:masahiroirie:20210809182407j:plain f:id:masahiroirie:20210809182509j:plain "Unable to push signed certificate to host [ホスト]"でエラー…
なんだこれ?

そのホスト…時間あってます?

エラーメッセージから若干察しにくいが、大体ホストの時間がずれているせい。
f:id:masahiroirie:20210809183012j:plain ちなみにキャプチャ取得現在は 8/9 18:00 過ぎ。
時間を修正して再度 vCenter に登録する。
f:id:masahiroirie:20210809183246j:plain 今度は成功。


x86 でも起こる事象ではあるが、Raspberry PI は RTC を持っていないこともあって結構踏みやすい。の割にメッセージから原因がピンと来にくかったりするので、知見として持っておいた方がよさそうです…