42%0.84 / 0.46 / 0.18
Load Avg
13%2.4G / 19G
Disk /
10%10.1%
Sys CPU
0%0.0%
CPU
12%116.68 MB
Memory
🛡
v0.6.110
Warden
📦
v0.7.2-edge.1
Iggy
running
📦
v0.3.2-edge.1
Connectors
running
📂
379
Open FDs
9
Threads
3/3 healthy
Runtimes
1000
Messages
prober: 11
1m 9s
Uptime
2
Streams
2
Topics
2
Partitions
3
Clients
0
Consumer Groups
I/O Throughput
Net RX
42.04 MB
Net TX
1.61 MB
Read
3.23 MB
Written
626.69 KB
0
Sources
0
Sinks

Iggy server snapshot included as iggy_snapshot.zip in this bundle.

System Information6 entries

uname -a
Linux ip-10-0-0-116 6.17.0-1007-aws #7~24.04.1-Ubuntu SMP Thu Jan 22 21:04:49 UTC 2026 x86_64 x86_64 x86_64 GNU/Linux
/etc/os-release
PRETTY_NAME="Ubuntu 24.04.4 LTS"
NAME="Ubuntu"
VERSION_ID="24.04"
VERSION="24.04.4 LTS (Noble Numbat)"
VERSION_CODENAME=noble
ID=ubuntu
ID_LIKE=debian
HOME_URL="https://www.ubuntu.com/"
SUPPORT_URL="https://help.ubuntu.com/"
BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
UBUNTU_CODENAME=noble
LOGO=ubuntu-logo
uptime
 12:51:06 up 1 min,  0 user,  load average: 0.84, 0.46, 0.18
hostname & domain
hostname: ip-10-0-0-116
hostname -f: ip-10-0-0-116
hostname -I: 10.0.0.116 
timedatectl
               Local time: Mon 2026-03-16 12:51:06 UTC
           Universal time: Mon 2026-03-16 12:51:06 UTC
                 RTC time: Mon 2026-03-16 12:51:05
                Time zone: Etc/UTC (UTC, +0000)
System clock synchronized: yes
              NTP service: active
          RTC in local TZ: no
Cloud metadata (provider detection)
--- AWS ---
t3.micro
us-west-1c
--- GCP ---
(not GCP)

CPU3 entries

lscpu
Architecture:                            x86_64
CPU op-mode(s):                          32-bit, 64-bit
Address sizes:                           46 bits physical, 48 bits virtual
Byte Order:                              Little Endian
CPU(s):                                  2
On-line CPU(s) list:                     0,1
Vendor ID:                               GenuineIntel
Model name:                              Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
CPU family:                              6
Model:                                   85
Thread(s) per core:                      2
Core(s) per socket:                      1
Socket(s):                               1
Stepping:                                7
BogoMIPS:                                4999.99
Flags:                                   fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 ss ht syscall nx pdpe1gb rdtscp lm constant_tsc rep_good nopl xtopology nonstop_tsc cpuid tsc_known_freq pni pclmulqdq ssse3 fma cx16 pcid sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand hypervisor lahf_lm abm 3dnowprefetch cpuid_fault pti fsgsbase tsc_adjust bmi1 avx2 smep bmi2 erms invpcid mpx avx512f avx512dq rdseed adx smap clflushopt clwb avx512cd avx512bw avx512vl xsaveopt xsavec xgetbv1 xsaves ida arat pku ospke
Hypervisor vendor:                       KVM
Virtualization type:                     full
L1d cache:                               32 KiB (1 instance)
L1i cache:                               32 KiB (1 instance)
L2 cache:                                1 MiB (1 instance)
L3 cache:                                35.8 MiB (1 instance)
NUMA node(s):                            1
NUMA node0 CPU(s):                       0,1
Vulnerability Gather data sampling:      Unknown: Dependent on hypervisor status
Vulnerability Ghostwrite:                Not affected
Vulnerability Indirect target selection: Mitigation; Aligned branch/return thunks
Vulnerability Itlb multihit:             KVM: Mitigation: VMX unsupported
Vulnerability L1tf:                      Mitigation; PTE Inversion
Vulnerability Mds:                       Vulnerable: Clear CPU buffers attempted, no microcode; SMT Host state unknown
Vulnerability Meltdown:                  Mitigation; PTI
Vulnerability Mmio stale data:           Vulnerable: Clear CPU buffers attempted, no microcode; SMT Host state unknown
Vulnerability Old microcode:             Not affected
Vulnerability Reg file data sampling:    Not affected
Vulnerability Retbleed:                  Vulnerable
Vulnerability Spec rstack overflow:      Not affected
Vulnerability Spec store bypass:         Vulnerable
Vulnerability Spectre v1:                Mitigation; usercopy/swapgs barriers and __user pointer sanitization
Vulnerability Spectre v2:                Mitigation; Retpolines; STIBP disabled; RSB filling; PBRSB-eIBRS Not affected; BHI Retpoline
Vulnerability Srbds:                     Not affected
Vulnerability Tsa:                       Not affected
Vulnerability Tsx async abort:           Not affected
Vulnerability Vmscape:                   Not affected
CPU usage per core (mpstat)
Linux 6.17.0-1007-aws (ip-10-0-0-116) 	03/16/26 	_x86_64_	(2 CPU)

12:51:06     CPU    %usr   %nice    %sys %iowait    %irq   %soft  %steal  %guest  %gnice   %idle
12:51:07     all   46.00    0.00   44.00   10.00    0.00    0.00    0.00    0.00    0.00    0.00
12:51:07       0   47.00    0.00   43.00   10.00    0.00    0.00    0.00    0.00    0.00    0.00
12:51:07       1   45.00    0.00   45.00   10.00    0.00    0.00    0.00    0.00    0.00    0.00

Average:     CPU    %usr   %nice    %sys %iowait    %irq   %soft  %steal  %guest  %gnice   %idle
Average:     all   46.00    0.00   44.00   10.00    0.00    0.00    0.00    0.00    0.00    0.00
Average:       0   47.00    0.00   43.00   10.00    0.00    0.00    0.00    0.00    0.00    0.00
Average:       1   45.00    0.00   45.00   10.00    0.00    0.00    0.00    0.00    0.00    0.00
Load average history
0.84 0.46 0.18 10/186 1560

CPU count: 2

Memory5 entries

free -h
               total        used        free      shared  buff/cache   available
Mem:           911Mi       484Mi       139Mi       2.7Mi       446Mi       427Mi
Swap:             0B          0B          0B
/proc/meminfo (key fields)
MemTotal:         933328 kB
MemFree:          142120 kB
MemAvailable:     437412 kB
Buffers:           20152 kB
Cached:           417032 kB
SwapTotal:             0 kB
SwapFree:              0 kB
Dirty:              5084 kB
Writeback:             0 kB
AnonPages:        206272 kB
Mapped:           131568 kB
Shmem:              2752 kB
Slab:              65104 kB
SReclaimable:      19956 kB
SUnreclaim:        45148 kB
WritebackTmp:          0 kB
ShmemHugePages:        0 kB
ShmemPmdMapped:        0 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
Huge pages status
=== Huge Pages ===
AnonHugePages:    102400 kB
ShmemHugePages:        0 kB
FileHugePages:         0 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
Hugetlb:               0 kB

=== Transparent Huge Pages ===
always [madvise] never

=== NUMA Memory ===
available: 1 nodes (0)
node 0 cpus: 0 1
node 0 size: 911 MB
node 0 free: 138 MB
node distances:
node   0 
  0:  10 
Top memory consumers (top 20)
USER         PID %CPU %MEM    VSZ   RSS TTY      STAT START   TIME COMMAND
ubuntu      1482  1.2 12.2 1446184 113928 ?      Ssl  12:50   0:00 /opt/iggy/current/iggy-server
root         628  0.3  4.1 1848976 38696 ?       Ssl  12:49   0:00 /usr/lib/snapd/snapd
root         182  0.0  2.9 288960 27292 ?        SLsl 12:49   0:00 /sbin/multipathd -d -s
ubuntu      1513  0.4  2.8 1205116 26824 ?       Ssl  12:50   0:00 /opt/connectors/current/iggy-connectors
ubuntu      1409  0.5  2.8 907656 26492 ?        Ssl  12:50   0:00 /opt/warden/current/laser-warden
root         776  0.1  2.4 110020 22648 ?        Ssl  12:49   0:00 /usr/bin/python3 /usr/share/unattended-upgrades/unattended-upgrade-shutdown --wait-for-signal
root         626  0.8  2.3 1756628 21940 ?       Ssl  12:49   0:00 /snap/amazon-ssm-agent/12322/amazon-ssm-agent
root         622  0.1  2.2  32424 20736 ?        Ss   12:49   0:00 /usr/bin/python3 /usr/bin/networkd-dispatcher --run-startup-triggers
root         120  0.3  1.8  42396 17048 ?        S<s  12:49   0:00 /usr/lib/systemd/systemd-journald
root           1  2.9  1.4  22724 13832 ?        Ss   12:49   0:03 /sbin/init
root         631  0.0  1.4 469008 13832 ?        Ssl  12:49   0:00 /usr/libexec/udisks2/udisksd
systemd+     307  0.1  1.3  21604 12940 ?        Ss   12:49   0:00 /usr/lib/systemd/systemd-resolved
root         773  0.0  1.3 318156 12704 ?        Ssl  12:49   0:00 /usr/sbin/ModemManager
polkitd      624  0.1  1.0 383712  9944 ?        Ssl  12:49   0:00 /usr/lib/polkit-1/polkitd --no-debug
systemd+    1417  0.0  1.0  19004  9700 ?        Ss   12:50   0:00 /usr/lib/systemd/systemd-networkd
root         186  0.2  0.8  26456  8304 ?        Ss   12:49   0:00 /usr/lib/systemd/systemd-udevd
root         630  0.1  0.8  17648  8220 ?        Ss   12:49   0:00 /usr/lib/systemd/systemd-logind
root        1544 25.0  0.8  17292  7612 ?        Ss   12:51   0:00 /usr/lib/systemd/systemd-timedated
ubuntu      1519  0.0  0.7 149268  7008 ?        Ssl  12:50   0:00 /opt/prober/current/laser-prober
syslog       769  0.1  0.6 222516  6184 ?        Ssl  12:49   0:00 /usr/sbin/rsyslogd -n -iNONE
OOM killer activity

Disk & Storage8 entries

df -h
Filesystem       Size  Used Avail Use% Mounted on
/dev/root         19G  2.4G   16G  13% /
tmpfs            456M     0  456M   0% /dev/shm
tmpfs            183M  880K  182M   1% /run
tmpfs            5.0M     0  5.0M   0% /run/lock
efivarfs         128K  3.8K  120K   4% /sys/firmware/efi/efivars
/dev/nvme0n1p16  881M   94M  726M  12% /boot
/dev/nvme0n1p15  105M  6.2M   99M   6% /boot/efi
df -i (inodes)
Filesystem       Inodes IUsed   IFree IUse% Mounted on
/dev/root       2490368 98423 2391945    4% /
tmpfs            116666     2  116664    1% /dev/shm
tmpfs            819200   659  818541    1% /run
tmpfs            116666     3  116663    1% /run/lock
efivarfs              0     0       0     - /sys/firmware/efi/efivars
/dev/nvme0n1p16   58496   601   57895    2% /boot
/dev/nvme0n1p15       0     0       0     - /boot/efi
lsblk -f (with filesystems)
NAME         FSTYPE   FSVER LABEL           UUID                                 FSAVAIL FSUSE% MOUNTPOINTS
loop0        squashfs 4.0                                                              0   100% /snap/amazon-ssm-agent/12322
loop1        squashfs 4.0                                                              0   100% /snap/core22/2339
loop2        squashfs 4.0                                                              0   100% /snap/snapd/25935
nvme0n1                                                                                         
├─nvme0n1p1  ext4     1.0   cloudimg-rootfs 0df68d9a-e70c-413e-9a10-736ae3f00a7a     16G    13% /
├─nvme0n1p14                                                                                    
├─nvme0n1p15 vfat     FAT32 UEFI            AFA7-BC80                              98.2M     6% /boot/efi
└─nvme0n1p16 ext4     1.0   BOOT            1bbab773-c98f-47ee-aa18-6277cc35d82f  725.4M    11% /boot
mount
/dev/nvme0n1p1 on / type ext4 (rw,relatime,discard,errors=remount-ro,commit=30)
devtmpfs on /dev type devtmpfs (rw,nosuid,noexec,relatime,size=454964k,nr_inodes=113741,mode=755,inode64)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev,inode64)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,size=186668k,nr_inodes=819200,mode=755,inode64)
tmpfs on /run/lock type tmpfs (rw,nosuid,nodev,noexec,relatime,size=5120k,inode64)
cgroup2 on /sys/fs/cgroup type cgroup2 (rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot)
none on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
efivarfs on /sys/firmware/efi/efivars type efivarfs (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
systemd-1 on /proc/sys/fs/binfmt_misc type autofs (rw,relatime,fd=32,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=1418)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,nosuid,nodev,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,nosuid,nodev,noexec,relatime)
mqueue on /dev/mqueue type mqueue (rw,nosuid,nodev,noexec,relatime)
tracefs on /sys/kernel/tracing type tracefs (rw,nosuid,nodev,noexec,relatime)
fusectl on /sys/fs/fuse/connections type fusectl (rw,nosuid,nodev,noexec,relatime)
configfs on /sys/kernel/config type configfs (rw,nosuid,nodev,noexec,relatime)
/var/lib/snapd/snaps/snapd_25935.snap on /snap/snapd/25935 type squashfs (ro,nodev,relatime,errors=continue,threads=single,x-gdu.hide,x-gvfs-hide)
/dev/nvme0n1p16 on /boot type ext4 (rw,relatime)
/var/lib/snapd/snaps/amazon-ssm-agent_12322.snap on /snap/amazon-ssm-agent/12322 type squashfs (ro,nodev,relatime,errors=continue,threads=single,x-gdu.hide,x-gvfs-hide)
/dev/nvme0n1p15 on /boot/efi type vfat (rw,relatime,fmask=0077,dmask=0077,codepage=437,iocharset=iso8859-1,shortname=mixed,errors=remount-ro)
/var/lib/snapd/snaps/core22_2339.snap on /snap/core22/2339 type squashfs (ro,nodev,relatime,errors=continue,threads=single,x-gdu.hide,x-gvfs-hide)
binfmt_misc on /proc/sys/fs/binfmt_misc type binfmt_misc (rw,nosuid,nodev,noexec,relatime)
Iggy data directory size
=== /opt/iggy/local_data ===
624K	/opt/iggy/local_data
Subdirectories:
552K	/opt/iggy/local_data/streams
44K	/opt/iggy/local_data/logs
16K	/opt/iggy/local_data/state
8.0K	/opt/iggy/local_data/runtime
File count: 11

=== Connectors state ===
4.0K	/opt/connectors/state
=== Connectors plugins ===
total 8
drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 16 11:43 .
drwxr-xr-x 3 ubuntu ubuntu 4096 Mar 16 11:43 ..
NVMe health (if present)
=== /dev/nvme0n1 ===
(cannot read smart log)

Disk I/O stats (iostat)
Linux 6.17.0-1007-aws (ip-10-0-0-116) 	03/16/26 	_x86_64_	(2 CPU)

avg-cpu:  %user   %nice %system %iowait  %steal   %idle
           4.88    0.00    2.90   46.82    0.32   45.09

Device            r/s     rkB/s   rrqm/s  %rrqm r_await rareq-sz     w/s     wkB/s   wrqm/s  %wrqm w_await wareq-sz     d/s     dkB/s   drqm/s  %drqm d_await dareq-sz     f/s f_await  aqu-sz  %util
loop0            1.43     40.20     0.00   0.00   10.71    28.19    0.00      0.00     0.00   0.00    0.00     0.00    0.00      0.00     0.00   0.00    0.00     0.00    0.00    0.00    0.02   1.21
loop1            0.55     11.13     0.00   0.00   21.70    20.08    0.00      0.00     0.00   0.00    0.00     0.00    0.00      0.00     0.00   0.00    0.00     0.00    0.00    0.00    0.01   0.78
loop2            0.51      4.52     0.00   0.00   19.66     8.89    0.00      0.00     0.00   0.00    0.00     0.00    0.00      0.00     0.00   0.00    0.00     0.00    0.00    0.00    0.01   0.83
loop3            0.09      0.09     0.00   0.00    0.20     1.00    0.00      0.00     0.00   0.00    0.00     0.00    0.00      0.00     0.00   0.00    0.00     0.00    0.00    0.00    0.00   0.00
nvme0n1         72.92   3317.59    20.99  22.35   11.23    45.49   12.84   1935.63    13.97  52.10    1.97   150.70    0.00      0.00     0.00   0.00    0.00     0.00    0.00    0.00    0.84  32.89


DRBD status (if present)
(DRBD not installed)

Network9 entries

ip addr
1: lo: <LOOPBACK,UP,LOWER_UP> mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000
    link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00
    inet 127.0.0.1/8 scope host lo
       valid_lft forever preferred_lft forever
    inet6 ::1/128 scope host noprefixroute 
       valid_lft forever preferred_lft forever
2: ens5: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 9001 qdisc htb state UP group default qlen 1000
    link/ether 02:ce:80:e7:0c:5d brd ff:ff:ff:ff:ff:ff
    altname enp0s5
    inet 10.0.0.116/28 metric 100 brd 10.0.0.127 scope global dynamic ens5
       valid_lft 3537sec preferred_lft 3537sec
    inet6 fe80::ce:80ff:fee7:c5d/64 scope link 
       valid_lft forever preferred_lft forever
3: ifb0: <BROADCAST,NOARP,UP,LOWER_UP> mtu 1500 qdisc htb state UNKNOWN group default qlen 32
    link/ether 62:41:78:11:e8:0b brd ff:ff:ff:ff:ff:ff
    inet6 fe80::6041:78ff:fe11:e80b/64 scope link 
       valid_lft forever preferred_lft forever
ip route
default via 10.0.0.113 dev ens5 proto dhcp src 10.0.0.116 metric 100 
10.0.0.2 via 10.0.0.113 dev ens5 proto dhcp src 10.0.0.116 metric 100 
10.0.0.112/28 dev ens5 proto kernel scope link src 10.0.0.116 metric 100 
10.0.0.113 dev ens5 proto dhcp scope link src 10.0.0.116 metric 100 
ss -tulnp (listening ports)
Netid State  Recv-Q Send-Q   Local Address:Port Peer Address:PortProcess                                    
udp   UNCONN 0      0      10.0.0.116%ens5:68        0.0.0.0:*                                              
udp   UNCONN 0      0            127.0.0.1:323       0.0.0.0:*                                              
udp   UNCONN 0      0           127.0.0.54:53        0.0.0.0:*                                              
udp   UNCONN 0      0        127.0.0.53%lo:53        0.0.0.0:*                                              
udp   UNCONN 0      0                [::1]:323          [::]:*                                              
tcp   LISTEN 0      128          127.0.0.1:3000      0.0.0.0:*    users:(("iggy-server",pid=1482,fd=10))    
tcp   LISTEN 0      65535        127.0.0.1:5000      0.0.0.0:*    users:(("laser-warden",pid=1409,fd=11))   
tcp   LISTEN 0      65535        127.0.0.1:8081      0.0.0.0:*    users:(("iggy-connectors",pid=1513,fd=12))
tcp   LISTEN 0      65535          0.0.0.0:80        0.0.0.0:*    users:(("laser-warden",pid=1409,fd=12))   
tcp   LISTEN 0      65535    127.0.0.53%lo:53        0.0.0.0:*                                              
tcp   LISTEN 0      65535       127.0.0.54:53        0.0.0.0:*                                              
tcp   LISTEN 0      65535          0.0.0.0:22        0.0.0.0:*                                              
tcp   LISTEN 0      65535          0.0.0.0:443       0.0.0.0:*    users:(("laser-warden",pid=1409,fd=13))   
tcp   LISTEN 0      128            0.0.0.0:8090      0.0.0.0:*    users:(("iggy-server",pid=1482,fd=8))     
tcp   LISTEN 0      128            0.0.0.0:8070      0.0.0.0:*    users:(("iggy-server",pid=1482,fd=9))     
tcp   LISTEN 0      65535             [::]:22           [::]:*                                              
ss -s (socket statistics summary)
Total: 191
TCP:   34 (estab 19, closed 4, orphaned 0, timewait 4)

Transport Total     IP        IPv6
RAW	  1         0         1        
UDP	  6         5         1        
TCP	  30        29        1        
INET	  37        34        3        
FRAG	  0         0         0        

/etc/resolv.conf
# This is /run/systemd/resolve/stub-resolv.conf managed by man:systemd-resolved(8).
# Do not edit.
#
# This file might be symlinked as /etc/resolv.conf. If you're looking at
# /etc/resolv.conf and seeing this text, you have followed the symlink.
#
# This is a dynamic resolv.conf file for connecting local clients to the
# internal DNS stub resolver of systemd-resolved. This file lists all
# configured search domains.
#
# Run "resolvectl status" to see details about the uplink DNS servers
# currently in use.
#
# Third party programs should typically not access this file directly, but only
# through the symlink at /etc/resolv.conf. To manage man:resolv.conf(5) in a
# different way, replace this symlink by a static file or a different symlink.
#
# See man:systemd-resolved.service(8) for details about the supported modes of
# operation for /etc/resolv.conf.

nameserver 127.0.0.53
options edns0 trust-ad
search us-west-1.compute.internal
iptables -L -n -v
--- stderr ---
iptables v1.8.10 (nf_tables): Could not fetch rule set generation id: Permission denied (you must be root)
tc qdisc show (traffic shaping)
qdisc noqueue 0: dev lo root refcnt 2 
qdisc htb 1: dev ens5 root refcnt 3 r2q 10 default 0x20 direct_packets_stat 0 direct_qlen 1000
qdisc ingress ffff: dev ens5 parent ffff:fff1 ---------------- 
qdisc htb 2: dev ifb0 root refcnt 2 r2q 10 default 0x20 direct_packets_stat 0 direct_qlen 32
Network errors & drops
Inter-|   Receive                                                |  Transmit
 face |bytes    packets errs drop fifo frame compressed multicast|bytes    packets errs drop fifo colls carrier compressed
    lo:  176365     896    0    0    0     0          0         0   176365     896    0    0    0     0       0          0
  ifb0:  594227     602    0    5    0     0          0         0   593877     597    0    0    0     0       0          0
TCP connection states (per process)
=== TCP connection state summary ===
     19 ESTAB
     11 LISTEN
      4 TIME-WAIT

=== LaserData process connections ===
--- laser-warden ---
      8 ESTAB
Total connections: 8

--- iggy-server ---
      5 ESTAB
Total connections: 5

--- iggy-connectors ---
      5 ESTAB
Total connections: 5

--- laser-prober ---
      1 ESTAB
Total connections: 1

=== TIME_WAIT count ===
TIME_WAIT: 6

=== CLOSE_WAIT count ===
CLOSE_WAIT: 1

Processes3 entries

ps aux --sort=-%mem (top 50)
USER         PID %CPU %MEM    VSZ   RSS TTY      STAT START   TIME COMMAND
ubuntu      1482  1.2 12.2 1446184 113928 ?      Ssl  12:50   0:00 /opt/iggy/current/iggy-server
root         628  0.3  4.1 1848976 38696 ?       Ssl  12:49   0:00 /usr/lib/snapd/snapd
root         182  0.0  2.9 288960 27292 ?        SLsl 12:49   0:00 /sbin/multipathd -d -s
ubuntu      1513  0.4  2.8 1205116 26824 ?       Ssl  12:50   0:00 /opt/connectors/current/iggy-connectors
ubuntu      1409  0.5  2.8 907656 26488 ?        Ssl  12:50   0:00 /opt/warden/current/laser-warden
root         776  0.1  2.4 110020 22648 ?        Ssl  12:49   0:00 /usr/bin/python3 /usr/share/unattended-upgrades/unattended-upgrade-shutdown --wait-for-signal
root         626  0.8  2.3 1756628 21940 ?       Ssl  12:49   0:00 /snap/amazon-ssm-agent/12322/amazon-ssm-agent
root         622  0.1  2.2  32424 20736 ?        Ss   12:49   0:00 /usr/bin/python3 /usr/bin/networkd-dispatcher --run-startup-triggers
root         120  0.3  1.8  42396 17048 ?        S<s  12:49   0:00 /usr/lib/systemd/systemd-journald
root           1  2.9  1.4  22724 13832 ?        Ss   12:49   0:03 /sbin/init
root         631  0.0  1.4 469008 13832 ?        Ssl  12:49   0:00 /usr/libexec/udisks2/udisksd
systemd+     307  0.1  1.3  21604 12940 ?        Ss   12:49   0:00 /usr/lib/systemd/systemd-resolved
root         773  0.0  1.3 318156 12704 ?        Ssl  12:49   0:00 /usr/sbin/ModemManager
polkitd      624  0.1  1.0 383712  9944 ?        Ssl  12:49   0:00 /usr/lib/polkit-1/polkitd --no-debug
systemd+    1417  0.0  1.0  19004  9700 ?        Ss   12:50   0:00 /usr/lib/systemd/systemd-networkd
root         186  0.2  0.8  26456  8304 ?        Rs   12:49   0:00 /usr/lib/systemd/systemd-udevd
root         630  0.1  0.8  17648  8220 ?        Ss   12:49   0:00 /usr/lib/systemd/systemd-logind
root        1544 18.5  0.8  17292  7612 ?        Ss   12:51   0:00 /usr/lib/systemd/systemd-timedated
ubuntu      1519  0.0  0.7 149268  7008 ?        Ssl  12:50   0:00 /opt/prober/current/laser-prober
syslog       769  0.1  0.6 222516  6184 ?        Ssl  12:49   0:00 /usr/sbin/rsyslogd -n -iNONE
message+     614  0.4  0.6   9912  5760 ?        Ss   12:49   0:00 @dbus-daemon --system --address=systemd: --nofork --nopidfile --systemd-activation --syslog-only
ubuntu      1603  0.0  0.4  11460  4600 ?        R    12:51   0:00 ps aux --sort=-%mem
ubuntu      1561  0.0  0.4  11328  4576 ?        R    12:51   0:00 ps aux --sort=-%mem
root         619  0.0  0.4  82928  4260 ?        Ssl  12:49   0:00 /usr/sbin/irqbalance
_chrony      748  0.0  0.4  19412  3792 ?        S    12:49   0:00 /usr/sbin/chronyd -F 1
ubuntu      1612  0.0  0.3  10684  3720 ?        R    12:51   0:00 pgrep -x laser-warden
ubuntu      1610  0.0  0.3  10536  3700 ?        S    12:51   0:00 top -bn1
ubuntu      1608  0.0  0.3   7868  3648 ?        S    12:51   0:00 bash -c echo '=== /etc/laserdata/certs/ ==='; ls -la /etc/laserdata/certs/ 2>/dev/null || echo '(directory not found)'; echo ''; for cert in /etc/laserdata/certs/*.crt /etc/laserdata/certs/*.pem; do   [ -f "$cert" ] || continue;   echo "--- $cert ---";   openssl x509 -in "$cert" -noout -subject -issuer -dates -serial -fingerprint -sha256 2>/dev/null || { echo '(cannot parse)'; continue; };   echo "Signature Algorithm: $(openssl x509 -in "$cert" -noout -text 2>/dev/null | grep 'Signature Algorithm' | head -1 | sed 's/.*: //')";   echo "Key: $(openssl x509 -in "$cert" -noout -text 2>/dev/null | grep -A1 'Public Key Algorithm' | tr -d '\n' | sed 's/.*Algorithm: //;s/  */ /g')";   SANS=$(openssl x509 -in "$cert" -noout -ext subjectAltName 2>/dev/null | grep -v 'Subject Alternative' | tr -d ' ' | tr ',' '\n' || true);   if [ -n "$SANS" ]; then echo "SANs:"; echo "$SANS" | sed 's/^/  /'; else echo 'SANs: none'; fi;   EXPIRY=$(openssl x509 -in "$cert" -noout -enddate 2>/dev/null | cut -d= -f2);   if [ -n "$EXPIRY" ]; then     EXPIRY_EPOCH=$(date -d "$EXPIRY" +%s 2>/dev/null);     NOW_EPOCH=$(date +%s);     DAYS_LEFT=$(( (EXPIRY_EPOCH - NOW_EPOCH) / 86400 ));     echo "Days until expiry: $DAYS_LEFT";     [ $DAYS_LEFT -lt 14 ] && echo '*** WARNING: Certificate expires soon! ***';     [ $DAYS_LEFT -lt 0 ] && echo '*** CRITICAL: Certificate has EXPIRED! ***';   fi;   echo ''; done
ubuntu      1601  0.0  0.3   7748  3640 ?        S    12:51   0:00 bash -c echo '=== Deployment Symlinks ==='; for d in /opt/warden/current /opt/iggy/current /opt/connectors/current /opt/prober/current; do   if [ -L "$d" ]; then     echo "$d -> $(readlink $d)";   elif [ -d "$d" ]; then     echo "$d (directory, not symlink)";   else     echo "$d (MISSING)";   fi; done; echo ''; echo '=== Binary --version Output ==='; for bin in /opt/warden/current/laser-warden /opt/iggy/current/iggy-server /opt/connectors/current/iggy-connectors /opt/prober/current/laser-prober; do   if [ -x "$bin" ]; then     echo "--- $(basename $bin) ---";     timeout 5 $bin --version 2>&1 || echo '(no --version output)';   else     echo "--- $(basename $bin): NOT FOUND ---";   fi;   echo ''; done; echo '=== All deployed versions ==='; for d in /opt/warden /opt/iggy /opt/connectors /opt/prober; do   [ -d "$d" ] && ls -1d $d/*/ 2>/dev/null | grep -v current || true; done
ubuntu      1571  0.0  0.3   7748  3636 ?        R    12:51   0:00 bash -c for d in /opt/iggy/local_data /srv/drbd0/iggy_data; do   if [ -d "$d" ]; then     echo "=== $d ===";     du -sh "$d" 2>/dev/null;     echo 'Subdirectories:';     du -sh "$d"/* 2>/dev/null | sort -rh | head -20;     echo 'File count:' $(find "$d" -type f 2>/dev/null | wc -l);     echo '';   fi; done; echo '=== Connectors state ===' && du -sh /opt/connectors/state 2>/dev/null || echo '(no state dir)'; echo '=== Connectors plugins ===' && ls -la /opt/connectors/plugins/lib/ 2>/dev/null || echo '(no plugins)'
ubuntu      1606  0.0  0.3   7748  3628 ?        S    12:51   0:00 bash -c echo 'minisign:' && which minisign 2>/dev/null && minisign -v 2>&1 || echo '(not installed)'; echo ''; echo '=== Signing pubkey (/etc/laserdata/laserdata.pub) ==='; if [ -f /etc/laserdata/laserdata.pub ]; then   ls -la /etc/laserdata/laserdata.pub;   echo '--- content ---';   cat /etc/laserdata/laserdata.pub; else   echo '(not found)'; fi
ubuntu      1624  0.0  0.3   7748  3624 ?        R    12:51   0:00 bash -c echo '=== Certbot certificates ==='; certbot certificates 2>/dev/null || echo '(certbot not installed or no certs)'; echo ''; echo '=== Certbot renewal config ==='; ls -la /etc/letsencrypt/renewal/ 2>/dev/null || echo '(no renewal configs)'; for conf in /etc/letsencrypt/renewal/*.conf; do   [ -f "$conf" ] || continue;   echo "--- $conf ---";   cat "$conf" 2>/dev/null;   echo ''; done; echo '=== Certbot timer/cron ==='; systemctl list-timers 2>/dev/null | grep -iE 'certbot|letsencrypt|acme' ||   ls -la /etc/cron.d/certbot 2>/dev/null ||   echo '(no certbot timer or cron found)'; echo ''; echo '=== Certbot renewal log (last 50 lines) ==='; tail -50 /var/log/letsencrypt/letsencrypt.log 2>/dev/null || echo '(no certbot log)'
ubuntu      1619  0.0  0.3   7752  3612 ?        S    12:51   0:00 bash -c echo '=== /etc/letsencrypt/live/warden/ ==='; ls -la /etc/letsencrypt/live/warden/ 2>/dev/null || echo '(directory not found)'; echo ''; for cert in /etc/letsencrypt/live/warden/fullchain.pem /etc/letsencrypt/live/warden/cert.pem; do   [ -f "$cert" ] || continue;   echo "--- $cert ---";   openssl x509 -in "$cert" -noout -subject -issuer -dates -serial -fingerprint -sha256 2>/dev/null || { echo '(cannot parse)'; continue; };   echo "Signature Algorithm: $(openssl x509 -in "$cert" -noout -text 2>/dev/null | grep 'Signature Algorithm' | head -1 | sed 's/.*: //')";   echo "Key: $(openssl x509 -in "$cert" -noout -text 2>/dev/null | grep -A1 'Public Key Algorithm' | tr -d '\n' | sed 's/.*Algorithm: //;s/  */ /g')";   SANS=$(openssl x509 -in "$cert" -noout -ext subjectAltName 2>/dev/null | grep -v 'Subject Alternative' | tr -d ' ' | tr ',' '\n' || true);   if [ -n "$SANS" ]; then echo "SANs:"; echo "$SANS" | sed 's/^/  /'; else echo 'SANs: none'; fi;   EXPIRY=$(openssl x509 -in "$cert" -noout -enddate 2>/dev/null | cut -d= -f2);   if [ -n "$EXPIRY" ]; then     EXPIRY_EPOCH=$(date -d "$EXPIRY" +%s 2>/dev/null);     NOW_EPOCH=$(date +%s);     DAYS_LEFT=$(( (EXPIRY_EPOCH - NOW_EPOCH) / 86400 ));     echo "Days until expiry: $DAYS_LEFT";     [ $DAYS_LEFT -lt 14 ] && echo '*** WARNING: Certificate expires soon! ***';     [ $DAYS_LEFT -lt 0 ] && echo '*** CRITICAL: Certificate has EXPIRED! ***';   fi;   echo ''; done
ubuntu      1549  0.0  0.3   7748  3588 ?        S    12:51   0:00 bash -c mpstat -P ALL 1 1 2>/dev/null || echo '(mpstat not available - install sysstat)'
ubuntu      1614  0.0  0.3   7748  3580 ?        S    12:51   0:00 bash -c if [ -f /etc/laserdata/certs/laserdata.crt ]; then   ls -la /etc/laserdata/certs/laserdata.crt;   echo '--- PEM content ---';   cat /etc/laserdata/certs/laserdata.crt; else   echo '(not found)'; fi
ubuntu      1602  0.0  0.3   7748  3576 ?        S    12:51   0:00 bash -c for bin in /opt/warden/current/laser-warden /opt/iggy/current/iggy-server /opt/connectors/current/iggy-connectors /opt/prober/current/laser-prober; do   if [ -f "$bin" ]; then     echo "--- $(basename $bin) ---";     file $bin 2>/dev/null;     getcap $bin 2>/dev/null || true;     ls -lh $bin;     echo '';   fi; done
ubuntu      1585  0.0  0.3   7748  3572 ?        S    12:51   0:00 bash -c echo '=== TCP connection state summary ==='; ss -tan 2>/dev/null | awk 'NR>1 {print $1}' | sort | uniq -c | sort -rn; echo ''; echo '=== LaserData process connections ==='; for name in laser-warden iggy-server iggy-connectors laser-prober; do   CONNS=$(ss -tnp 2>/dev/null | grep "$name" || true);   if [ -n "$CONNS" ]; then     echo "--- $name ---";     echo "$CONNS" | awk '{print $1}' | sort | uniq -c | sort -rn;     TOTAL=$(echo "$CONNS" | wc -l);     echo "Total connections: $TOTAL";     echo '';   fi; done; echo '=== TIME_WAIT count ==='; TW=$(ss -tan state time-wait 2>/dev/null | wc -l); echo "TIME_WAIT: $TW"; [ "$TW" -gt 1000 ] 2>/dev/null && echo '*** WARNING: High TIME_WAIT count ***' || true; echo ''; echo '=== CLOSE_WAIT count ==='; CW=$(ss -tan state close-wait 2>/dev/null | wc -l); echo "CLOSE_WAIT: $CW"; [ "$CW" -gt 50 ] 2>/dev/null && echo '*** WARNING: CLOSE_WAIT connections indicate possible leak ***' || true
ubuntu      1629  0.0  0.3   7748  3572 ?        S    12:51   0:00 bash -c echo '=== System CA bundle ==='; ls -la /etc/ssl/certs/ca-certificates.crt 2>/dev/null || echo '(not found)'; echo "CA count: $(grep -c 'BEGIN CERTIFICATE' /etc/ssl/certs/ca-certificates.crt 2>/dev/null || echo 'N/A')"; echo "Last update: $(stat -c '%y' /etc/ssl/certs/ca-certificates.crt 2>/dev/null || echo 'N/A')"; echo ''; echo '=== Custom CA certs ==='; ls -la /usr/local/share/ca-certificates/ 2>/dev/null || echo '(no custom CAs)'; echo ''; echo '=== OpenSSL version & default paths ==='; openssl version -a 2>/dev/null | head -5 || echo '(openssl not found)'
ubuntu      1620  0.0  0.3   7748  3564 ?        S    12:51   0:00 bash -c echo '=== Let'\''s Encrypt chain validation ==='; if [ -f /etc/letsencrypt/live/warden/fullchain.pem ]; then   openssl verify -verbose /etc/letsencrypt/live/warden/fullchain.pem 2>&1 || true;   echo '';   echo 'Chain depth:';   grep -c 'BEGIN CERTIFICATE' /etc/letsencrypt/live/warden/fullchain.pem 2>/dev/null || echo '(cannot determine)'; else   echo '(fullchain.pem not found)'; fi; echo ''; echo '=== LaserData cert chain validation ==='; for cert in /etc/laserdata/certs/*.crt /etc/laserdata/certs/*.pem; do   [ -f "$cert" ] || continue;   echo "--- $cert ---";   openssl verify -verbose "$cert" 2>&1 || true; done
ubuntu      1627  0.0  0.3   7748  3548 ?        S    12:51   0:00 bash -c for port_label in '443:warden-https'; do   PORT=$(echo "$port_label" | cut -d: -f1);   LABEL=$(echo "$port_label" | cut -d: -f2);   echo "=== $LABEL (port $PORT) ===";   RESULT=$(timeout 5 bash -c "echo | openssl s_client -connect localhost:$PORT -servername localhost 2>/dev/null" 2>/dev/null || true);   if [ -n "$RESULT" ]; then     echo "$RESULT" | openssl x509 -noout -subject -issuer -dates -fingerprint -sha256 2>/dev/null || echo '(no valid certificate)';     echo "Protocol: $(echo "$RESULT" | grep 'Protocol  :' | sed 's/.*: //')";     echo "Cipher: $(echo "$RESULT" | grep 'Cipher    :' | sed 's/.*: //')";     echo "$RESULT" | grep 'Verify return code:' || true;   else     echo '(no TLS or not reachable)';   fi;   echo ''; done
ubuntu      1556  0.0  0.3   7748  3504 ?        S    12:51   0:00 bash -c ps aux --sort=-%mem | head -21
ubuntu      1588  0.0  0.3   7748  3488 ?        S    12:51   0:00 bash -c top -bn1 | head -30
ubuntu      1587  0.0  0.3   7748  3480 ?        S    12:51   0:00 bash -c ps aux --sort=-%mem | head -50
ubuntu      1589  0.0  0.3   7748  3480 ?        S    12:51   0:00 bash -c for name in laser-warden iggy-server iggy-connectors laser-prober; do   pid=$(pgrep -x "$name" 2>/dev/null | head -1);   if [ -n "$pid" ]; then     echo "=== $name (PID $pid) ===";     echo "RSS: $(awk '/VmRSS/{print $2" "$3}' /proc/$pid/status 2>/dev/null || echo N/A)";     echo "VSZ: $(awk '/VmSize/{print $2" "$3}' /proc/$pid/status 2>/dev/null || echo N/A)";     echo "Threads: $(awk '/Threads/{print $2}' /proc/$pid/status 2>/dev/null || echo N/A)";     echo "FDs: $(ls /proc/$pid/fd 2>/dev/null | wc -l)";     echo "Uptime: $(ps -o etime= -p $pid 2>/dev/null | tr -d ' ')";     echo "CPU: $(ps -o %cpu= -p $pid 2>/dev/null | tr -d ' ')%";     echo '';   else     echo "=== $name: NOT RUNNING ==="; echo '';   fi; done
ubuntu      1591  0.0  0.3   7748  3464 ?        S    12:51   0:00 bash -c for pid in /proc/[0-9]*/fd; do echo "$(ls -1 $pid 2>/dev/null | wc -l) $(cat ${pid%/fd}/cmdline 2>/dev/null | tr '\0' ' ' | head -c 80)"; done 2>/dev/null | sort -rn | head -20
ubuntu      1616  0.0  0.3  19712  3340 ?        S    12:51   0:00 sort -rn
root         638  0.0  0.3   7232  2812 ?        Ss   12:49   0:00 /usr/sbin/cron -f -P
_chrony      786  0.0  0.2  11084  2448 ?        S    12:49   0:00 /usr/sbin/chronyd -F 1
ubuntu      1554  0.0  0.2   6104  2236 ?        S    12:51   0:00 mpstat -P ALL 1 1
top -bn1 (top 30)
top - 12:51:06 up 1 min,  0 user,  load average: 1.09, 0.52, 0.20
Tasks: 155 total,   8 running, 147 sleeping,   0 stopped,   0 zombie
%Cpu(s): 47.0 us, 53.0 sy,  0.0 ni,  0.0 id,  0.0 wa,  0.0 hi,  0.0 si,  0.0 st 
MiB Mem :    911.5 total,    114.2 free,    505.8 used,    450.4 buff/cache     
MiB Swap:      0.0 total,      0.0 free,      0.0 used.    405.7 avail Mem 

    PID USER      PR  NI    VIRT    RES    SHR S  %CPU  %MEM     TIME+ COMMAND
   1837 ubuntu    20   0   10184   7324   5964 R   9.7   0.8   0:00.03 openssl
      1 root      20   0   22724  13888   9512 S   6.5   1.5   0:03.32 systemd
    307 systemd+  20   0   21604  12940  10624 S   3.2   1.4   0:00.11 systemd+
    614 message+  20   0    9916   5816   4764 S   3.2   0.6   0:00.39 dbus-da+
    624 polkitd   20   0  383712   9944   7504 S   3.2   1.1   0:00.13 polkitd
   1610 ubuntu    20   0   12372   5568   3428 R   3.2   0.6   0:00.01 top
   1657 ubuntu    20   0    9924   6460   5368 R   3.2   0.7   0:00.02 openssl
   1661 ubuntu    20   0   29424  17516   2756 D   3.2   1.9   0:00.01 file
   1680 ubuntu    20   0    9928   6540   5468 R   3.2   0.7   0:00.02 openssl
   1702 ubuntu    20   0    9928   6516   5460 R   3.2   0.7   0:00.01 openssl
   1803 ubuntu    20   0   98316  12156  10304 R   3.2   1.3   0:00.01 curl
   1804 ubuntu    20   0   77020  28004  27332 R   3.2   3.0   0:00.01 apt
      2 root      20   0       0      0      0 S   0.0   0.0   0:00.00 kthreadd
      3 root      20   0       0      0      0 S   0.0   0.0   0:00.00 pool_wo+
      4 root       0 -20       0      0      0 I   0.0   0.0   0:00.00 kworker+
      5 root       0 -20       0      0      0 I   0.0   0.0   0:00.00 kworker+
      6 root       0 -20       0      0      0 I   0.0   0.0   0:00.00 kworker+
      7 root       0 -20       0      0      0 I   0.0   0.0   0:00.00 kworker+
      8 root       0 -20       0      0      0 I   0.0   0.0   0:00.00 kworker+
      9 root      20   0       0      0      0 I   0.0   0.0   0:00.00 kworker+
     10 root      20   0       0      0      0 I   0.0   0.0   0:00.04 kworker+
     11 root       0 -20       0      0      0 I   0.0   0.0   0:00.00 kworker+
     12 root      20   0       0      0      0 I   0.0   0.0   0:00.08 kworker+
LaserData process details
=== laser-warden (PID 1409) ===
RSS: 27436 kB
VSZ: 907620 kB
Threads: 10
FDs: 274
Uptime: 01:05
CPU: 0.5%

=== iggy-server (PID 1482) ===
RSS: 113928 kB
VSZ: 1446184 kB
Threads: 8
FDs: 195
Uptime: 01:04
CPU: 1.2%

=== iggy-connectors (PID 1513) ===
RSS: 26824 kB
VSZ: 1205116 kB
Threads: 3
FDs: 15
Uptime: 01:02
CPU: 0.4%

=== laser-prober (PID 1519) ===
RSS: 7008 kB
VSZ: 149268 kB
Threads: 3
FDs: 10
Uptime: 00:52
CPU: 0.0%

File Descriptors3 entries

/proc/sys/fs/file-nr
2005	0	2097152
Open files per process (top 20)
253 /opt/warden/current/laser-warden 
195 /opt/iggy/current/iggy-server 
15 /opt/connectors/current/iggy-connectors 
10 /opt/prober/current/laser-prober 
4 bash -c for pid in /proc/[0-9]*/fd; do echo "$(ls -1 $pid 2>/dev/null | wc -l) $
4 bash -c echo '=== /etc/laserdata/certs/ ==='; ls -la /etc/laserdata/certs/ 2>/de
3 sort -rn 
3 head -20 
3 bash -c for pid in /proc/[0-9]*/fd; do echo "$(ls -1 $pid 2>/dev/null | wc -l) $
0 @dbus-daemon --system --address=systemd: --nofork --nopidfile --systemd-activati
0 /usr/sbin/rsyslogd -n -iNONE 
0 /usr/sbin/irqbalance 
0 /usr/sbin/cron -f -P 
0 /usr/sbin/chronyd -F 1 
0 /usr/sbin/chronyd -F 1 
0 /usr/sbin/acpid 
0 /usr/sbin/ModemManager 
0 /usr/libexec/udisks2/udisksd 
0 /usr/lib/systemd/systemd-udevd 
0 /usr/lib/systemd/systemd-timedated 
ulimit -a
real-time non-blocking time  (microseconds, -R) unlimited
core file size              (blocks, -c) 0
data seg size               (kbytes, -d) unlimited
scheduling priority                 (-e) 0
file size                   (blocks, -f) unlimited
pending signals                     (-i) 3378
max locked memory           (kbytes, -l) 8192
max memory size             (kbytes, -m) unlimited
open files                          (-n) 524288
pipe size                (512 bytes, -p) 8
POSIX message queues         (bytes, -q) 819200
real-time priority                  (-r) 0
stack size                  (kbytes, -s) 8192
cpu time                   (seconds, -t) unlimited
max user processes                  (-u) 3378
virtual memory              (kbytes, -v) unlimited
file locks                          (-x) unlimited

Installed Versions3 entries

Binary symlinks & versions
=== Deployment Symlinks ===
/opt/warden/current -> warden-0.6.110
/opt/iggy/current -> server-0.7.2-edge.1
/opt/connectors/current -> connectors-0.3.2-edge.1
/opt/prober/current -> prober-0.1.8

=== Binary --version Output ===
--- laser-warden ---
Loaded environment variables from path: /etc/warden/warden.env
laser-warden 0.6.110

--- iggy-server ---
server 0.7.2-edge.1

--- iggy-connectors ---
iggy-connectors 0.3.2-edge.1

--- laser-prober ---
2026-03-16T12:51:06.947129Z ERROR laser_prober: LD_NODE_ID environment variable is required

=== All deployed versions ===
/opt/warden/warden-0.6.110/
/opt/iggy/local_data/
/opt/iggy/server-0.7.2-edge.1/
/opt/connectors/connectors-0.3.2-edge.1/
/opt/connectors/plugins/
/opt/connectors/state/
/opt/prober/prober-0.1.8/
Binary file info & capabilities
--- laser-warden ---
/opt/warden/current/laser-warden: ELF 64-bit LSB pie executable, x86-64, version 1 (SYSV), dynamically linked, interpreter /lib64/ld-linux-x86-64.so.2, for GNU/Linux 3.2.0, BuildID[sha1]=d5b19153f9ee45efde7b2d62fa138f8682bcaef5, not stripped
-rwxrwxr-x 1 ubuntu ubuntu 24M Mar 16 11:38 /opt/warden/current/laser-warden

--- iggy-server ---
/opt/iggy/current/iggy-server: ELF 64-bit LSB pie executable, x86-64, version 1 (SYSV), dynamically linked, interpreter /lib64/ld-linux-x86-64.so.2, for GNU/Linux 3.2.0, BuildID[sha1]=f2012a0e6024f5e36daab9424f4841433711f544, not stripped
-rwxr-xr-x 1 ubuntu ubuntu 18M Mar 16 12:49 /opt/iggy/current/iggy-server

--- iggy-connectors ---
/opt/connectors/current/iggy-connectors: ELF 64-bit LSB pie executable, x86-64, version 1 (SYSV), dynamically linked, interpreter /lib64/ld-linux-x86-64.so.2, for GNU/Linux 3.2.0, BuildID[sha1]=2d14de9da10f08555fa39a78ed600d64a4c5d4ad, not stripped
-rwxr-xr-x 1 ubuntu ubuntu 20M Mar 16 12:49 /opt/connectors/current/iggy-connectors

--- laser-prober ---
/opt/prober/current/laser-prober: ELF 64-bit LSB pie executable, x86-64, version 1 (SYSV), dynamically linked, interpreter /lib64/ld-linux-x86-64.so.2, for GNU/Linux 3.2.0, BuildID[sha1]=fa865fc8367fa8f0fb897ba8e05ff3d888047178, not stripped
-rwxrwxr-x 1 ubuntu ubuntu 12M Mar 11 20:58 /opt/prober/current/laser-prober

Minisign & signing key
minisign:
/usr/local/bin/minisign
minisign 0.11

=== Signing pubkey (/etc/laserdata/laserdata.pub) ===
-rw-r--r-- 1 ubuntu laserdata-certs 113 Mar 16 11:43 /etc/laserdata/laserdata.pub
--- content ---
untrusted comment: minisign public key 9871894D32566207
RWQHYlYyTYlxmH49iau8uH66EXyqkMOyKi4vLQ1DMPjgivxlK2H8YW+m

Certificates & TLS8 entries

LaserData certificates (full details)
=== /etc/laserdata/certs/ ===
total 24
drwxr-s--- 2 ubuntu laserdata-certs 4096 Mar 16 12:50 .
drwxr-x--- 3 ubuntu laserdata-certs 4096 Mar 16 12:49 ..
-rw-r----- 1 ubuntu laserdata-certs 2053 Mar 16 11:43 laserdata.crt
-rw-r--r-- 1 ubuntu laserdata-certs 6383 Mar 16 12:50 server-fullchain.crt
-rw------- 1 ubuntu laserdata-certs 3268 Mar 16 12:50 server.key

--- /etc/laserdata/certs/laserdata.crt ---
subject=C = US, ST = State, L = City, O = LaserData, OU = Security, CN = LaserData Root CA
issuer=C = US, ST = State, L = City, O = LaserData, OU = Security, CN = LaserData Root CA
notBefore=Mar 11 20:18:53 2026 GMT
notAfter=Mar  8 20:18:53 2036 GMT
serial=02FD97220CFBE82E4A59142E312508F4E9518ADD
sha256 Fingerprint=9A:A4:C1:D4:14:00:78:A4:D3:CF:7F:A8:F9:2F:90:2B:27:F9:D7:2C:94:AD:1F:8D:4E:85:96:E0:6D:FD:17:DB
Signature Algorithm: sha256WithRSAEncryption
Key: rsaEncryption Public-Key: (4096 bit)
SANs: none
Days until expiry: 3645

--- /etc/laserdata/certs/server-fullchain.crt ---
subject=CN = deployment-610918396816523869
issuer=C = US, ST = California, L = San Francisco, O = LaserData, OU = Infrastructure, CN = LaserData aws 324037274906 us-west-1
notBefore=Mar 16 12:49:17 2026 GMT
notAfter=Mar 15 12:49:17 2031 GMT
serial=6A0E80636359E5FC443711744C0ECDA02BDE7E68
sha256 Fingerprint=BD:36:6F:DF:4E:12:5B:99:84:C1:3F:2C:C4:35:A6:07:F9:C2:7F:37:0C:9E:E9:07:FF:CA:F5:F0:33:D1:27:73
Signature Algorithm: sha256WithRSAEncryption
Key: rsaEncryption Public-Key: (4096 bit)
SANs:
  DNS:starter-2zz1z-5yf83m1do20e1.us-west-1.aws.dev.laserdata.cloud
  DNS:localhost
  IPAddress:127.0.0.1
  IPAddress:10.0.0.116
Days until expiry: 1824

LaserData CA certificate (laserdata.crt content)
-rw-r----- 1 ubuntu laserdata-certs 2053 Mar 16 11:43 /etc/laserdata/certs/laserdata.crt
--- PEM content ---
-----BEGIN CERTIFICATE-----
MIIFvzCCA6egAwIBAgIUAv2XIgz76C5KWRQuMSUI9OlRit0wDQYJKoZIhvcNAQEL
BQAwbzELMAkGA1UEBhMCVVMxDjAMBgNVBAgMBVN0YXRlMQ0wCwYDVQQHDARDaXR5
MRIwEAYDVQQKDAlMYXNlckRhdGExETAPBgNVBAsMCFNlY3VyaXR5MRowGAYDVQQD
DBFMYXNlckRhdGEgUm9vdCBDQTAeFw0yNjAzMTEyMDE4NTNaFw0zNjAzMDgyMDE4
NTNaMG8xCzAJBgNVBAYTAlVTMQ4wDAYDVQQIDAVTdGF0ZTENMAsGA1UEBwwEQ2l0
eTESMBAGA1UECgwJTGFzZXJEYXRhMREwDwYDVQQLDAhTZWN1cml0eTEaMBgGA1UE
AwwRTGFzZXJEYXRhIFJvb3QgQ0EwggIiMA0GCSqGSIb3DQEBAQUAA4ICDwAwggIK
AoICAQDY9zXvan+EqDa9SgRlAd30G6+XxFc2CFWQsaW88yZxCqFFJCFrVryswTvY
zKZ+bbxknHCiOVByoTfa0oTh1pXxton9TTubTGNnqyCah/T2w1CnLH4LMR05yVzG
LE4m2f71l68Ej/37/G/zPdMBzMMtB41yruxdESTgMSDngqAvVgJ6e37CQh0634ox
X7VQ2jNwULLsiCwcVG9mcrL14eLqH5uVldZnUI/16HDPvBwsEJGamgDNEsmXGMc6
ulambztTWNUq6tHFRMXhOjdyWWro1ANMlmeeBoMg0kvUr48zRWwTUZ+egBrxgDm0
Z/xbD/uRlU7ZEKn0kUK6jmTwYOxvQc0LKrU6jYmdYeEn9mvPx4/kTizVM5Dn4mcd
wwtP+oaBqgXYUDPk1x0mbzZCqETb5pURmrXJKRT+88RcDmP4C2pOZCuCREzkFYrV
Jn3UiMmTypwoPuEEN1OHk8XSlA9JB1FhB8JZaA13Ad9ZP3iWwq2uIhnnqJqDfT4I
Z9siF7umzmlS0GTEotMClcNI/YhvCpNugNLr+mPWVMWWUpOHHzIjjCw+J3WTGLfC
PFMMAJlUmGzfoRSEhOf0TJ4Y2A7PpXmw2tK6Aj9zmK1DlGLKQD/cn3V0CmMtBdWc
prMujCU3t1CJpCW1TTgSzUBzFyK8FiunO8b82LIdpXy+z/bkbQIDAQABo1MwUTAd
BgNVHQ4EFgQUNH6mRK0ylgvMmJEvt5iD6IY+YXMwHwYDVR0jBBgwFoAUNH6mRK0y
lgvMmJEvt5iD6IY+YXMwDwYDVR0TAQH/BAUwAwEB/zANBgkqhkiG9w0BAQsFAAOC
AgEAv87aEbG/KFkCYvML+7UzlJ11rgGFetdX/XP8fxYmrK21R4KdXOThSYAcinRt
8dIOtdQjqN+0V9pLnzRbjHFY8O4sk652fo76cW4KTjUy3TZ+dGvwf3VrjszkdoBm
6Jcw4TuCN6TmNgsfzt3BftxXg+Y4JSRcstoQgGoi80myPVn/BGAqU1vkAW6ZSi7B
FGus74SPagwxJ/y57gt09YjUCsby7GUrCDqRpFoepioaThgmTcxEPGTqlFSJbxr9
TBwjjZVDSZieTPNBCpiH0aLxjJIlvf9YGldcimGrs4LBYYZFTq+Fzq0FITtH56w0
xbrNsmhcgVj/qdhTmsAJQ4AV9Ui4eOQA8cuijqHypSY+8t5VV1VAgrDvS7mlB4ZC
sZ/UdvskcmxwfTsoHm5nKY8/+8E9WGcWWNVd80LHmq7mmlsI5qs3o23UZZOsjJKM
581LS5oJd4x6hpXhdg9HLgoGoDyhiWGfT/5Sqo9EuLYQw7x9P+2rWeAYUaDna+nG
mLq1DMhsx1xjVbjgBZdb110A638USbIV/fTrMLYs0m7klmKwgP8+JZbdPWipqttm
POEWCedJ7JRM/duBW/hljXxjsPL6O1DHIveG5RIaVmDYiNgYt1MeR1bUIhHeToy2
JSx4EuBy76PvmzIGaZN8m/faOab5X5gDjQOSQzhe7lmt42s=
-----END CERTIFICATE-----
LaserData server certificate (server-fullchain.crt content)
-rw-r--r-- 1 ubuntu laserdata-certs 6383 Mar 16 12:50 /etc/laserdata/certs/server-fullchain.crt
--- PEM content ---
-----BEGIN CERTIFICATE-----
MIIGKTCCBBGgAwIBAgIUag6AY2NZ5fxENxF0TA7NoCvefmgwDQYJKoZIhvcNAQEL
BQAwgZYxCzAJBgNVBAYTAlVTMRMwEQYDVQQIDApDYWxpZm9ybmlhMRYwFAYDVQQH
DA1TYW4gRnJhbmNpc2NvMRIwEAYDVQQKDAlMYXNlckRhdGExFzAVBgNVBAsMDklu
ZnJhc3RydWN0dXJlMS0wKwYDVQQDDCRMYXNlckRhdGEgYXdzIDMyNDAzNzI3NDkw
NiB1cy13ZXN0LTEwHhcNMjYwMzE2MTI0OTE3WhcNMzEwMzE1MTI0OTE3WjAoMSYw
JAYDVQQDDB1kZXBsb3ltZW50LTYxMDkxODM5NjgxNjUyMzg2OTCCAiIwDQYJKoZI
hvcNAQEBBQADggIPADCCAgoCggIBAKvTpxN2RewL7BqlPR1es28clctt36yb6a0I
ZY6+Cz2CBKc+XRQz7/MIxRTBl4osVx9rtXZKEoxyLi2oKcBFwY3HFCBnxu9MKSJX
MU93/JqPcTqZI0fwOFUUuTQIiNCZRbqS74LwL7ggDa3w5vBg+Kt0JCw8v2C38zAu
MugOv7Bw+y3oKhQ/Se4O0ocHaJAO2yTpgCM7GycFmH67y+Hk7OLmmp+6q0wbSI1G
tb2HlyantK8urNlaI2RWaq1XQp6I4U28BsvO4+6GUFKxqJD9rpnJ2bCIaQg/Fr5Y
M+Edj/VFDRfLN7cpeMtok7myX7AGBg+Bi8mXrUGISL+BcBLPkyt75Wfg6XznIsFv
8yMl29UMlC/aVq0YGhUMqHjRZYlgKZKdiLAotxz9m+tkamZPWGk21P9Vi/fIhEjF
sEth3/ACziHFgRVAhe3FQWC6beK211AJPoEBMcpTpbNfB5QMn1PaAf8hENqOUUHJ
ILAvBrM/2bC3NmY4Ed7M1sDEB7lp2m7dibc7waWEMkKgnelnGJLz5zc6Gv4lSAqU
enj2U5d4k+YU42BpBkq9bHv0HL0drXk12p4db+PmwIJogULtYaxeF9btcHXBG049
GJXhqpZD6qvu15Lkx/Lt6MPMyaePyiiJyMDjweOk3ntH32QgX8twoptOa0gfp0pZ
x1H5s4AfAgMBAAGjgdswgdgwXwYDVR0RBFgwVoI9c3RhcnRlci0yenoxei01eWY4
M20xZG8yMGUxLnVzLXdlc3QtMS5hd3MuZGV2Lmxhc2VyZGF0YS5jbG91ZIIJbG9j
YWxob3N0hwR/AAABhwQKAAB0MAkGA1UdEwQCMAAwCwYDVR0PBAQDAgWgMB0GA1Ud
JQQWMBQGCCsGAQUFBwMBBggrBgEFBQcDAjAdBgNVHQ4EFgQUCfGnBMkXzTS7guLE
BSgaN63MNkQwHwYDVR0jBBgwFoAUcId0WEG0WxmAPGhlCCrmLFl7YlUwDQYJKoZI
hvcNAQELBQADggIBAHDJfbdpJzzO3yZ7UVUmfH2eR/mMA0AaDcnVkOc99luKQp01
BT8pqDZMBIPwhstdV5kIUwPVWpvBvMCFSi+BbIYJLZm9GH3B7AzW7/zVzx3f6MIP
mFjubsoya2zgH6n0sUs5XYPcithBfdcWJv86p6rkFJCsS3l+7KZPylYfgP4RIUmo
t/rU2ob/MBVZXMvYhmPKt8/ZER+83iWP6aGK+y24aE1ZunyVjRr+N55Ck+jowF2+
UGvE4jXBLHpecjov5MQVFAKhodrEWqnuvTRfC/wd8T+MLttrfTML2T/k/CJSBSzD
xiRYu89JKwNdz8fVseXUhSEPRHesdPN7KcIW9m8dewnSlpE5oYNe2VG+Om4RwIJY
072p2Ak8WKdy1toohkkqqO/0DAT7SM5kL1CB4HUSUEVbHzsjl4RFcRGMI8SbEtef
TgGi7K+k+rbdaPmrd7bBcIiZmJ9Lu2V2pKml9uAWffIRpg/1JTBZ++avee5QKVi8
WgigYEIJDrRfesFV5YEIvMNldnHyehbfJMLQUWeX2ZmiCPSiFhj8HIosIvLJRMW5
F5HjvnpQ1UKiRpIx9EUGVmtQuIrGoUztI3LF5s/QRnMIKlCCyX0ws3tnWruSWnkw
RWzdWav4mwPT5fNZbVo5/YidSNnErB4q2+qsn1dHV1o+FxJkCzwKWqaAlkYf
-----END CERTIFICATE-----
-----BEGIN CERTIFICATE-----
MIIF+jCCA+KgAwIBAgIUaClT21wVAAIT2KAibPdQIZYpWeowDQYJKoZIhvcNAQEL
BQAwbzELMAkGA1UEBhMCVVMxDjAMBgNVBAgMBVN0YXRlMQ0wCwYDVQQHDARDaXR5
MRIwEAYDVQQKDAlMYXNlckRhdGExETAPBgNVBAsMCFNlY3VyaXR5MRowGAYDVQQD
DBFMYXNlckRhdGEgUm9vdCBDQTAeFw0yNjAzMTEyMDE5NDVaFw0zMTAzMTAyMDE5
NDVaMIGWMQswCQYDVQQGEwJVUzETMBEGA1UECAwKQ2FsaWZvcm5pYTEWMBQGA1UE
BwwNU2FuIEZyYW5jaXNjbzESMBAGA1UECgwJTGFzZXJEYXRhMRcwFQYDVQQLDA5J
bmZyYXN0cnVjdHVyZTEtMCsGA1UEAwwkTGFzZXJEYXRhIGF3cyAzMjQwMzcyNzQ5
MDYgdXMtd2VzdC0xMIICIjANBgkqhkiG9w0BAQEFAAOCAg8AMIICCgKCAgEApCU7
LpYpj07uZmHH9F9g4RaYg3DgUvbQOYmINZJigFcQi/uIW31PRHHwIolC/HMwKwvX
yYeLUhXRSUU10+3N7wroCAUrKI57PEt98CeM1Fp69huI1I9ZKXNuu0w0Upu5JxZM
SXUctQFuvgBS67xowWRwnFj/Wjx7oKN0/AAfz0CwViGelT6HyILgiqf21bmM84VW
YTYk2Pt39wEIo2GYm/tv3pmdOSBz1cjHvW6M+EN6Ux56rwzrpHzTM3kCJmfsnCRm
UKDUSfz3/eojHSn3pw4B4/IlHfChr9SwSXBKnWSAsMX1X6ApEFQ4DEbRZgWg48Zg
V8h70XtOVb4Qa6r2wiuIc3LOSErD+rqRzXMVd7JTrIJE4GDUw4n+7c9O0PPEUD1V
WLXKVhs3TCXfEj4J4kxtneEVBSXMNi6dGE2vZLj5RPlLPC+Sx/ZT0s8phCL9srfW
x/mRY3DS6zRdP+yOqEFP11qogXQXij+FxAqPZob0YtN93m1p75XRGWrM21vzq5Rh
weschzwxUjP3S0jJ/4+CQu8Aq/uz3YCwhS4dXn4a9KYBwZU36ey1be0bBg+Jn2h+
kVxsHyJmX90bLV6mm/ifX73HuJ2R4FuEEK6ef2HLhBACorg6Kcr4vjtuhvQa6N64
Am03SBVNmpRnJidTr/TmHWgrJZ4vfDJBPwDL598CAwEAAaNmMGQwEgYDVR0TAQH/
BAgwBgEB/wIBADAOBgNVHQ8BAf8EBAMCAYYwHQYDVR0OBBYEFHCHdFhBtFsZgDxo
ZQgq5ixZe2JVMB8GA1UdIwQYMBaAFDR+pkStMpYLzJiRL7eYg+iGPmFzMA0GCSqG
SIb3DQEBCwUAA4ICAQBh77H2X+lgou7+mbH4PtuZBhK9By/Ikh23k30pa4jak+IT
SFPd7uHRQZRnrnPaXTm2HPf5EFnlLi1IRX2MOh9EnWX//y3Eby61ApCYmB1BMUIB
K7+lTTarJfXLnNOx5WltOHc6Q/GFJjS9MyYgIrWDLt7bdFKxrsEli3YPO09t7/RX
I28WRO3oXVk1Ab8NbCryWS/PB4tRaAu2wZ2PHDRMzO7CeJhFS3peeDN6H3JaC5yR
agdmeHXjykPxM0oyg0ZlbSPiaqbnnh7KbRsBg18BH4BXncyBKyxq8eGsQmiX/Q7P
/bDB9G7jpcydtmlrAPNYWVZvqSPC+eY9wbP9lVaiuix5kcWCKaiO7hNs3hfGiE9i
YpjTrADZiXJ6rau2jC/LGqpKawFxrM8arLD0NLtJqTFdvOBEbEBGvp8sU7NbZVNO
1glb8BU1xk+MNTot2Vs3+ckvtXVeCbqFStNU5c0u4I9ug1QpM28jCMbV22r36761
f9/WXiathgaMpV5LHaCqp9RpD9aEaK2a4ks9AyTf5uYQ2egbsKkUt78pzTSuOA1o
KpczCsMcZxgc3wzv/UZ1MhGb1svbR8jdBhfqIWnrt8oJiXklJJvLanLnSA8Md5Er
7nCec9lruWydT0No3t8ZmLP9LGcoptCSt10MsO4p5abIqPWZ/EHWtzrFECK10g==
-----END CERTIFICATE-----

-----BEGIN CERTIFICATE-----
MIIFvzCCA6egAwIBAgIUAv2XIgz76C5KWRQuMSUI9OlRit0wDQYJKoZIhvcNAQEL
BQAwbzELMAkGA1UEBhMCVVMxDjAMBgNVBAgMBVN0YXRlMQ0wCwYDVQQHDARDaXR5
MRIwEAYDVQQKDAlMYXNlckRhdGExETAPBgNVBAsMCFNlY3VyaXR5MRowGAYDVQQD
DBFMYXNlckRhdGEgUm9vdCBDQTAeFw0yNjAzMTEyMDE4NTNaFw0zNjAzMDgyMDE4
NTNaMG8xCzAJBgNVBAYTAlVTMQ4wDAYDVQQIDAVTdGF0ZTENMAsGA1UEBwwEQ2l0
eTESMBAGA1UECgwJTGFzZXJEYXRhMREwDwYDVQQLDAhTZWN1cml0eTEaMBgGA1UE
AwwRTGFzZXJEYXRhIFJvb3QgQ0EwggIiMA0GCSqGSIb3DQEBAQUAA4ICDwAwggIK
AoICAQDY9zXvan+EqDa9SgRlAd30G6+XxFc2CFWQsaW88yZxCqFFJCFrVryswTvY
zKZ+bbxknHCiOVByoTfa0oTh1pXxton9TTubTGNnqyCah/T2w1CnLH4LMR05yVzG
LE4m2f71l68Ej/37/G/zPdMBzMMtB41yruxdESTgMSDngqAvVgJ6e37CQh0634ox
X7VQ2jNwULLsiCwcVG9mcrL14eLqH5uVldZnUI/16HDPvBwsEJGamgDNEsmXGMc6
ulambztTWNUq6tHFRMXhOjdyWWro1ANMlmeeBoMg0kvUr48zRWwTUZ+egBrxgDm0
Z/xbD/uRlU7ZEKn0kUK6jmTwYOxvQc0LKrU6jYmdYeEn9mvPx4/kTizVM5Dn4mcd
wwtP+oaBqgXYUDPk1x0mbzZCqETb5pURmrXJKRT+88RcDmP4C2pOZCuCREzkFYrV
Jn3UiMmTypwoPuEEN1OHk8XSlA9JB1FhB8JZaA13Ad9ZP3iWwq2uIhnnqJqDfT4I
Z9siF7umzmlS0GTEotMClcNI/YhvCpNugNLr+mPWVMWWUpOHHzIjjCw+J3WTGLfC
PFMMAJlUmGzfoRSEhOf0TJ4Y2A7PpXmw2tK6Aj9zmK1DlGLKQD/cn3V0CmMtBdWc
prMujCU3t1CJpCW1TTgSzUBzFyK8FiunO8b82LIdpXy+z/bkbQIDAQABo1MwUTAd
BgNVHQ4EFgQUNH6mRK0ylgvMmJEvt5iD6IY+YXMwHwYDVR0jBBgwFoAUNH6mRK0y
lgvMmJEvt5iD6IY+YXMwDwYDVR0TAQH/BAUwAwEB/zANBgkqhkiG9w0BAQsFAAOC
AgEAv87aEbG/KFkCYvML+7UzlJ11rgGFetdX/XP8fxYmrK21R4KdXOThSYAcinRt
8dIOtdQjqN+0V9pLnzRbjHFY8O4sk652fo76cW4KTjUy3TZ+dGvwf3VrjszkdoBm
6Jcw4TuCN6TmNgsfzt3BftxXg+Y4JSRcstoQgGoi80myPVn/BGAqU1vkAW6ZSi7B
FGus74SPagwxJ/y57gt09YjUCsby7GUrCDqRpFoepioaThgmTcxEPGTqlFSJbxr9
TBwjjZVDSZieTPNBCpiH0aLxjJIlvf9YGldcimGrs4LBYYZFTq+Fzq0FITtH56w0
xbrNsmhcgVj/qdhTmsAJQ4AV9Ui4eOQA8cuijqHypSY+8t5VV1VAgrDvS7mlB4ZC
sZ/UdvskcmxwfTsoHm5nKY8/+8E9WGcWWNVd80LHmq7mmlsI5qs3o23UZZOsjJKM
581LS5oJd4x6hpXhdg9HLgoGoDyhiWGfT/5Sqo9EuLYQw7x9P+2rWeAYUaDna+nG
mLq1DMhsx1xjVbjgBZdb110A638USbIV/fTrMLYs0m7klmKwgP8+JZbdPWipqttm
POEWCedJ7JRM/duBW/hljXxjsPL6O1DHIveG5RIaVmDYiNgYt1MeR1bUIhHeToy2
JSx4EuBy76PvmzIGaZN8m/faOab5X5gDjQOSQzhe7lmt42s=
-----END CERTIFICATE-----
Let's Encrypt certificates (full details)
=== /etc/letsencrypt/live/warden/ ===
total 16
drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 16 12:50 .
drwxr-xr-x 3 ubuntu ubuntu 4096 Mar 16 11:43 ..
-rw-r--r-- 1 ubuntu ubuntu 2909 Mar 16 12:50 fullchain.pem
-rw------- 1 ubuntu ubuntu  241 Mar 16 12:50 privkey.pem

--- /etc/letsencrypt/live/warden/fullchain.pem ---
subject=CN = *.us-west-1.aws.dev.laserdata.cloud
issuer=C = US, O = Let's Encrypt, CN = E7
notBefore=Mar 11 19:27:26 2026 GMT
notAfter=Jun  9 19:27:25 2026 GMT
serial=064507980344871FFEA6DD3C94E1B214FB85
sha256 Fingerprint=4B:25:62:13:7C:45:69:ED:CA:0A:0C:90:90:6E:93:B8:0F:E9:24:61:FC:5F:B7:44:39:85:C0:7C:80:36:81:6B
Signature Algorithm: ecdsa-with-SHA384
Key: id-ecPublicKey Public-Key: (256 bit)
SANs:
  DNS:*.us-west-1.aws.dev.laserdata.cloud
Days until expiry: 85

Certificate chain validation
=== Let's Encrypt chain validation ===
CN = *.us-west-1.aws.dev.laserdata.cloud
error 20 at 0 depth lookup: unable to get local issuer certificate
error /etc/letsencrypt/live/warden/fullchain.pem: verification failed

Chain depth:
2

=== LaserData cert chain validation ===
--- /etc/laserdata/certs/laserdata.crt ---
C = US, ST = State, L = City, O = LaserData, OU = Security, CN = LaserData Root CA
error 18 at 0 depth lookup: self-signed certificate
error /etc/laserdata/certs/laserdata.crt: verification failed
--- /etc/laserdata/certs/server-fullchain.crt ---
CN = deployment-610918396816523869
error 20 at 0 depth lookup: unable to get local issuer certificate
error /etc/laserdata/certs/server-fullchain.crt: verification failed
Certbot / ACME renewal status
=== Certbot certificates ===
(certbot not installed or no certs)

=== Certbot renewal config ===
(no renewal configs)
=== Certbot timer/cron ===
(no certbot timer or cron found)

=== Certbot renewal log (last 50 lines) ===
(no certbot log)
TLS connectivity test (local services)
=== warden-https (port 443) ===
subject=CN = *.us-west-1.aws.dev.laserdata.cloud
issuer=C = US, O = Let's Encrypt, CN = E7
notBefore=Mar 11 19:27:26 2026 GMT
notAfter=Jun  9 19:27:25 2026 GMT
sha256 Fingerprint=4B:25:62:13:7C:45:69:ED:CA:0A:0C:90:90:6E:93:B8:0F:E9:24:61:FC:5F:B7:44:39:85:C0:7C:80:36:81:6B
Protocol: TLSv1.3
TLSv1.3
Cipher: TLS_AES_256_GCM_SHA384
TLS_AES_256_GCM_SHA384
Verify return code: 0 (ok)
    Verify return code: 0 (ok)
    Verify return code: 0 (ok)

CA trust store & OpenSSL info
=== System CA bundle ===
-rw-r--r-- 1 root root 219342 Mar 13 22:06 /etc/ssl/certs/ca-certificates.crt
CA count: 146
Last update: 2026-03-13 22:06:11.168231985 +0000

=== Custom CA certs ===
total 8
drwxr-xr-x 2 root root 4096 Mar 13 22:06 .
drwxr-xr-x 7 root root 4096 Mar 16 11:43 ..

=== OpenSSL version & default paths ===
OpenSSL 3.0.13 30 Jan 2024 (Library: OpenSSL 3.0.13 30 Jan 2024)
built on: Mon Jan 26 12:31:31 2026 UTC
platform: debian-amd64
options:  bn(64,64)
compiler: gcc -fPIC -pthread -m64 -Wa,--noexecstack -Wall -fzero-call-used-regs=used-gpr -DOPENSSL_TLS_SECURITY_LEVEL=2 -Wa,--noexecstack -g -O2 -fno-omit-frame-pointer -mno-omit-leaf-frame-pointer -ffile-prefix-map=/build/openssl-a6kkWc/openssl-3.0.13=. -fstack-protector-strong -fstack-clash-protection -Wformat -Werror=format-security -fcf-protection -fdebug-prefix-map=/build/openssl-a6kkWc/openssl-3.0.13=/usr/src/openssl-3.0.13-0ubuntu3.7 -DOPENSSL_USE_NODELETE -DL_ENDIAN -DOPENSSL_PIC -DOPENSSL_BUILDING_OPENSSL -DNDEBUG -Wdate-time -D_FORTIFY_SOURCE=3

Credentials & Config Status3 entries

Credential files (existence, permissions, age)
=== /etc/warden/ ===
  /etc/warden/credentials/connectors.pat  (-rw------- ubuntu:ubuntu 68 bytes, modified 2026-03-16 12:50:05.323832328 +0000)
  /etc/warden/credentials/prober.pat  (-rw------- ubuntu:ubuntu 68 bytes, modified 2026-03-16 12:50:05.483830035 +0000)
  /etc/warden/credentials/warden.pat  (-rw------- ubuntu:ubuntu 68 bytes, modified 2026-03-16 12:50:05.159834678 +0000)
  /etc/warden/credentials/prober.env  (-rw------- ubuntu:ubuntu 30 bytes, modified 2026-03-16 12:50:05.565828860 +0000)
  /etc/warden/task.toml  (-rw-r--r-- ubuntu:ubuntu 434 bytes, modified 2026-03-16 12:51:05.885957043 +0000)
  /etc/warden/warden.env  (-rw------- ubuntu:ubuntu 2540 bytes, modified 2026-03-16 12:50:01.759883399 +0000)

=== Warden env ===
LD_API=https://us.aws.supervisor.laserdata.cloud
LD_CERTIFICATES_LASERDATA_DIR=/etc/laserdata/certs
LD_CERTIFICATES_LETS_ENCRYPT_DIR=/etc/letsencrypt/live/warden
LD_CERTIFICATES_LETS_ENCRYPT_ENABLED=true
LD_CERTIFICATES_SIGNING_PUBKEY_PATH=/etc/laserdata/laserdata.pub
LD_CPU_TARGET=amd64-skylake
LD_CREDENTIALS_DIR=/etc/warden/credentials
LD_DIRECTORY=/opt/warden
LD_HEARTBEATS_INTERVAL=5s
LD_HTTP_CORS_ALLOWED_HEADERS=[content-type,authorization]
LD_HTTP_CORS_ALLOWED_METHODS=[GET,POST,PUT,DELETE]
LD_HTTP_CORS_ALLOWED_ORIGINS=[*]
LD_HTTP_CORS_ALLOW_CREDENTIALS=false
LD_HTTP_CORS_ALLOW_PRIVATE_NETWORK=false
LD_HTTP_CORS_ENABLED=false
LD_HTTP_CORS_EXPOSED_HEADERS=[]
LD_HTTP_INTERNAL_ADDRESS=127.0.0.1:5000
LD_HTTP_PUBLIC_ADDRESS=0.0.0.0:80
LD_HTTP_TLS_CERT_FILE=/etc/letsencrypt/live/warden/fullchain.pem
LD_HTTP_TLS_ENABLED=true
LD_HTTP_TLS_KEY_FILE=/etc/letsencrypt/live/warden/privkey.pem
LD_KEY_ID=laserdata_20260101
LD_KEY_VALUE=0xbaed9ef2e7a1dbff50799cc5e9a087b1b505991f674d2e74c6feb967c1311541
LD_METRICS_INTERVAL=5s
LD_RELEASES_URL=https://artifacts.laserdata.com
LD_RUNTIMES_CONNECTORS_DIRECTORY=/opt/connectors
LD_RUNTIMES_CONNECTORS_ENABLED=true
LD_RUNTIMES_IGGY_API_URL=http://localhost:3000
LD_RUNTIMES_IGGY_CLUSTER=standalone
LD_RUNTIMES_IGGY_DIRECTORY=/opt/iggy
LD_RUNTIMES_IGGY_ENABLED=true
LD_SECRET=eyJ***
LD_TASK_PATH=/etc/warden/task.toml
LD_TELEMETRY_BATCH_MAX_EXPORT_SIZE=1024
LD_TELEMETRY_BATCH_MAX_QUEUE_SIZE=4096
LD_TELEMETRY_BATCH_SCHEDULED_DELAY=5s
LD_TELEMETRY_LOGS_COMPRESSION=zstd
LD_TELEMETRY_LOGS_ENABLED=true
LD_TELEMETRY_LOGS_ENDPOINT=https://us.aws.supervisor.laserdata.cloud/warden/logs
LD_TELEMETRY_LOGS_RUNTIMES=[iggy,connectors]
LD_TELEMETRY_LOGS_TRANSPORT=http
LD_TELEMETRY_TRACES_COMPRESSION=zstd
LD_TELEMETRY_TRACES_ENABLED=false
LD_TELEMETRY_TRACES_ENDPOINT=
LD_TELEMETRY_TRACES_TRANSPORT=http
=== PAT files ===
  /etc/warden/credentials/connectors.pat (68 bytes, 0h ago)
  /etc/warden/credentials/prober.pat (68 bytes, 0h ago)
  /etc/warden/credentials/warden.pat (68 bytes, 0h ago)

--- stderr ---
Iggy & connectors env files
=== /opt/iggy/current/iggy.env ===
IGGY_CLUSTER_ENABLED=false
IGGY_CONSUMER_GROUP_REBALANCING_CHECK_INTERVAL=5 s
IGGY_CONSUMER_GROUP_REBALANCING_TIMEOUT=30 s
IGGY_DATA_MAINTENANCE_MESSAGES_CLEANER_ENABLED=true
IGGY_DATA_MAINTENANCE_MESSAGES_INTERVAL=1 m
IGGY_ENCRYPTION_ENABLED=false
IGGY_ENCRYPTION_KEY=IGG***
IGGY_HEARTBEAT_INTERVAL=5 s
IGGY_HTTP_ADDRESS=127.0.0.1:3000
IGGY_HTTP_CORS_ALLOWED_HEADERS=[content-type,authorization]
IGGY_HTTP_CORS_ALLOWED_METHODS=[GET,POST,PUT,DELETE]
IGGY_HTTP_CORS_ALLOWED_ORIGINS=[*]
IGGY_HTTP_CORS_ALLOW_CREDENTIALS=false
IGGY_HTTP_CORS_ALLOW_PRIVATE_NETWORK=false
IGGY_HTTP_CORS_ENABLED=true
IGGY_HTTP_CORS_EXPOSED_HEADERS=[]
IGGY_HTTP_ENABLED=true
IGGY_HTTP_JWT_ACCESS_TOKEN_EXPIRY=1 h
IGGY_HTTP_JWT_ALGORITHM=HS256
IGGY_HTTP_JWT_AUDIENCE=laserdata.cloud
IGGY_HTTP_JWT_CLOCK_SKEW=5 s
IGGY_HTTP_JWT_DECODING_SECRET=S3m***
IGGY_HTTP_JWT_ENCODING_SECRET=S3m***
IGGY_HTTP_JWT_ISSUER=laserdata.cloud
IGGY_HTTP_JWT_NOT_BEFORE=0 s
IGGY_HTTP_JWT_USE_BASE64_SECRET=***
IGGY_HTTP_JWT_VALID_AUDIENCES=[laserdata.cloud]
IGGY_HTTP_JWT_VALID_ISSUERS=[laserdata.cloud]
IGGY_HTTP_MAX_REQUEST_SIZE=2 MB
IGGY_HTTP_METRICS_ENABLED=true
IGGY_HTTP_METRICS_ENDPOINT=/metrics
IGGY_HTTP_TLS_CERT_FILE=
IGGY_HTTP_TLS_ENABLED=false
IGGY_HTTP_TLS_KEY_FILE=
IGGY_HTTP_WEB_UI=false
IGGY_MESSAGE_SAVER_ENABLED=true
IGGY_MESSAGE_SAVER_ENFORCE_FSYNC=true
IGGY_MESSAGE_SAVER_INTERVAL=30 s
IGGY_PERSONAL_ACCESS_TOKEN_CLEANER_ENABLED=true
IGGY_PERSONAL_ACCESS_TOKEN_CLEANER_INTERVAL=1 m
IGGY_PERSONAL_ACCESS_TOKEN_MAX_TOKENS_PER_USER=100
IGGY_QUIC_ADDRESS=0.0.0.0:8080
IGGY_QUIC_CERTIFICATE_CERT_FILE=
IGGY_QUIC_CERTIFICATE_KEY_FILE=
IGGY_QUIC_CERTIFICATE_SELF_SIGNED=true
IGGY_QUIC_DATAGRAM_SEND_BUFFER_SIZE=100 KB
IGGY_QUIC_ENABLED=false
IGGY_QUIC_INITIAL_MTU=8 KB
IGGY_QUIC_KEEP_ALIVE_INTERVAL=5 s
IGGY_QUIC_MAX_CONCURRENT_BIDI_STREAMS=10000
IGGY_QUIC_MAX_IDLE_TIMEOUT=10 s
IGGY_QUIC_RECEIVE_WINDOW=100 KB
IGGY_QUIC_SEND_WINDOW=100 KB
IGGY_QUIC_SOCKET_KEEPALIVE=false
IGGY_QUIC_SOCKET_OVERRIDE_DEFAULTS=false
IGGY_QUIC_SOCKET_RECV_BUFFER_SIZE=64 KB
IGGY_QUIC_SOCKET_SEND_BUFFER_SIZE=64 KB
IGGY_ROOT_PASSWORD=Fvq***
IGGY_ROOT_USERNAME=***
IGGY_SYSTEM_BACKUP_COMPATIBILITY_PATH=compatibility
IGGY_SYSTEM_BACKUP_PATH=backup
IGGY_SYSTEM_COMPRESSION_ALLOW_OVERRIDE=false
IGGY_SYSTEM_COMPRESSION_DEFAULT_ALGORITHM=none
IGGY_SYSTEM_LOGGING_FILE_ENABLED=true
IGGY_SYSTEM_LOGGING_LEVEL=info
IGGY_SYSTEM_LOGGING_MAX_FILE_SIZE=20 MB
IGGY_SYSTEM_LOGGING_MAX_TOTAL_SIZE=100 MB
IGGY_SYSTEM_LOGGING_PATH=logs
IGGY_SYSTEM_LOGGING_RETENTION=7 days
IGGY_SYSTEM_LOGGING_ROTATION_CHECK_INTERVAL=1 h
IGGY_SYSTEM_LOGGING_SYSINFO_PRINT_INTERVAL=10 s
IGGY_SYSTEM_MEMORY_POOL_BUCKET_CAPACITY=8192
IGGY_SYSTEM_MEMORY_POOL_ENABLED=true
IGGY_SYSTEM_MEMORY_POOL_SIZE=4 GiB
IGGY_SYSTEM_MESSAGE_DEDUPLICATION_ENABLED=false
IGGY_SYSTEM_MESSAGE_DEDUPLICATION_EXPIRY=1 m
IGGY_SYSTEM_MESSAGE_DEDUPLICATION_MAX_ENTRIES=10000
IGGY_SYSTEM_PARTITION_ENFORCE_FSYNC=true
IGGY_SYSTEM_PARTITION_MESSAGES_REQUIRED_TO_SAVE=1024
IGGY_SYSTEM_PARTITION_PATH=partitions
IGGY_SYSTEM_PARTITION_SIZE_OF_MESSAGES_REQUIRED_TO_SAVE=1 MiB
IGGY_SYSTEM_PARTITION_VALIDATE_CHECKSUM=false
IGGY_SYSTEM_PATH=local_data
IGGY_SYSTEM_RECOVERY_RECREATE_MISSING_STATE=false
IGGY_SYSTEM_RUNTIME_PATH=runtime
IGGY_SYSTEM_SEGMENT_ARCHIVE_EXPIRED=false
IGGY_SYSTEM_SEGMENT_CACHE_INDEXES=open_segment
IGGY_SYSTEM_SEGMENT_SIZE=1 GiB
IGGY_SYSTEM_SHARDING_CPU_ALLOCATION=numa:auto
IGGY_SYSTEM_STATE_ENFORCE_FSYNC=true
IGGY_SYSTEM_STATE_MAX_FILE_OPERATION_RETRIES=1
IGGY_SYSTEM_STATE_RETRY_DELAY=1 s
IGGY_SYSTEM_STREAM_PATH=streams
IGGY_SYSTEM_TOPIC_MAX_SIZE=unlimited
IGGY_SYSTEM_TOPIC_MESSAGE_EXPIRY=none
IGGY_SYSTEM_TOPIC_PATH=topics
IGGY_TCP_ADDRESS=0.0.0.0:8090
IGGY_TCP_ENABLED=true
IGGY_TCP_IPV6=false
IGGY_TCP_SOCKET_KEEPALIVE=false
IGGY_TCP_SOCKET_LINGER=0 s
IGGY_TCP_SOCKET_MIGRATION=true
IGGY_TCP_SOCKET_NODELAY=false
IGGY_TCP_SOCKET_OVERRIDE_DEFAULTS=false
IGGY_TCP_SOCKET_RECV_BUFFER_SIZE=100 KB
IGGY_TCP_SOCKET_SEND_BUFFER_SIZE=100 KB
IGGY_TCP_TLS_CERT_FILE=/etc/laserdata/certs/server-fullchain.crt
IGGY_TCP_TLS_ENABLED=true
IGGY_TCP_TLS_KEY_FILE=/etc/laserdata/certs/server.key
IGGY_TCP_TLS_SELF_SIGNED=false
IGGY_TELEMETRY_ENABLED=false
IGGY_TELEMETRY_LOGS_ENDPOINT=
IGGY_TELEMETRY_LOGS_TRANSPORT=grpc
IGGY_TELEMETRY_SERVICE_NAME=iggy
IGGY_TELEMETRY_TRACES_ENDPOINT=
IGGY_TELEMETRY_TRACES_TRANSPORT=grpc
IGGY_WEBSOCKET_ADDRESS=0.0.0.0:8070
IGGY_WEBSOCKET_ENABLED=true
IGGY_WEBSOCKET_TLS_CERT_FILE=/etc/laserdata/certs/server-fullchain.crt
IGGY_WEBSOCKET_TLS_ENABLED=true
IGGY_WEBSOCKET_TLS_KEY_FILE=/etc/laserdata/certs/server.key
IGGY_WEBSOCKET_TLS_SELF_SIGNED=false
=== /opt/connectors/current/connectors.env ===
IGGY_CONNECTORS_CONNECTORS_BASE_URL=http://127.0.0.1:5000/connectors
IGGY_CONNECTORS_CONNECTORS_CONFIG_TYPE=http
IGGY_CONNECTORS_CONNECTORS_RESPONSE_DATA_PATH=
IGGY_CONNECTORS_CONNECTORS_RESPONSE_ERROR_PATH=
IGGY_CONNECTORS_CONNECTORS_RETRY_BACKOFF_MULTIPLIER=2
IGGY_CONNECTORS_CONNECTORS_RETRY_ENABLED=true
IGGY_CONNECTORS_CONNECTORS_RETRY_INITIAL_BACKOFF=1s
IGGY_CONNECTORS_CONNECTORS_RETRY_MAX_ATTEMPTS=3
IGGY_CONNECTORS_CONNECTORS_RETRY_MAX_BACKOFF=30s
IGGY_CONNECTORS_CONNECTORS_TIMEOUT=10s
IGGY_CONNECTORS_HTTP_ADDRESS=127.0.0.1:8081
IGGY_CONNECTORS_HTTP_API_KEY=V2y***
IGGY_CONNECTORS_HTTP_CORS_ALLOWED_HEADERS=[content-type,authorization,api-key]
IGGY_CONNECTORS_HTTP_CORS_ALLOWED_METHODS=[GET,POST,PUT,DELETE]
IGGY_CONNECTORS_HTTP_CORS_ALLOWED_ORIGINS=[*]
IGGY_CONNECTORS_HTTP_CORS_ALLOW_CREDENTIALS=false
IGGY_CONNECTORS_HTTP_CORS_ALLOW_PRIVATE_NETWORK=false
IGGY_CONNECTORS_HTTP_CORS_ENABLED=false
IGGY_CONNECTORS_HTTP_CORS_EXPOSED_HEADERS=[]
IGGY_CONNECTORS_HTTP_ENABLED=true
IGGY_CONNECTORS_HTTP_TLS_CERT_FILE=
IGGY_CONNECTORS_HTTP_TLS_ENABLED=false
IGGY_CONNECTORS_HTTP_TLS_KEY_FILE=
IGGY_CONNECTORS_IGGY_ADDRESS=127.0.0.1:8090
IGGY_CONNECTORS_IGGY_TLS_CA_FILE=/etc/laserdata/certs/laserdata.crt
IGGY_CONNECTORS_IGGY_TLS_DOMAIN=
IGGY_CONNECTORS_IGGY_TLS_ENABLED=true
IGGY_CONNECTORS_IGGY_TOKEN=fil***
IGGY_CONNECTORS_STATE_PATH=/opt/connectors/state
Task config
state = "Processing"
successful = false
status_updated = false

[task]
id = 610918598612943366
task_id = 610918598612877830
node_id = 610918396883632646
type = "warden:snapshot"
status = "new"
created_at = "2026-03-16T12:51:00.570135Z"
signature = "qXQXaYImHpBH+wCMRzLFmSarycM3nXDreEBo1LP4aV+SnISNsZH3yCaRgrVvQBHvUAYJ/evyYKrWGTZEV9/hBA=="
signature_key_id = "laserdata_20260101"

[task.data]
include_iggy = true
redact_secrets = true

Sysctl & Kernel Tuning3 entries

LaserData sysctl config
# Network buffers
net.core.rmem_max = 134217728
net.core.wmem_max = 134217728
net.ipv4.tcp_rmem = 4096 87380 67108864
net.ipv4.tcp_wmem = 4096 65536 67108864

# Connection handling
net.core.somaxconn = 65535
net.core.netdev_max_backlog = 65535
net.ipv4.tcp_max_syn_backlog = 65535

# TCP keepalive
net.ipv4.tcp_keepalive_time = 60
net.ipv4.tcp_keepalive_intvl = 10
net.ipv4.tcp_keepalive_probes = 6

# VM memory
vm.swappiness = 10
vm.dirty_ratio = 30
vm.dirty_background_ratio = 10

# File descriptors
fs.file-max = 2097152
fs.nr_open = 2097152

Active sysctl values (LaserData relevant)
net.core.rmem_max                             = 134217728
net.core.wmem_max                             = 134217728
net.ipv4.tcp_rmem                             = 4096	87380	67108864
net.ipv4.tcp_wmem                             = 4096	65536	67108864
net.core.somaxconn                            = 65535
net.core.netdev_max_backlog                   = 65535
net.ipv4.tcp_max_syn_backlog                  = 65535
net.ipv4.tcp_keepalive_time                   = 60
net.ipv4.tcp_keepalive_intvl                  = 10
net.ipv4.tcp_keepalive_probes                 = 6
vm.swappiness                                 = 10
vm.dirty_ratio                                = 30
vm.dirty_background_ratio                     = 10
fs.file-max                                   = 2097152
fs.nr_open                                    = 2097152
vm.nr_hugepages                               = 0
Mimalloc environment
=== Systemd mimalloc overrides ===
[Service]
Environment="MIMALLOC_ALLOW_LARGE_OS_PAGES=1"

[Service]
Environment="MIMALLOC_ALLOW_LARGE_OS_PAGES=1"

=== Hugepages service ===
● configure-hugepages.service - Configure huge pages based on instance memory
     Loaded: loaded (/etc/systemd/system/configure-hugepages.service; enabled; preset: enabled)
     Active: active (exited) since Mon 2026-03-16 12:49:50 UTC; 1min 16s ago
   Main PID: 613 (code=exited, status=0/SUCCESS)
        CPU: 25ms

Mar 16 12:49:49 ip-10-0-0-116 systemd[1]: Starting configure-hugepages.service - Configure huge pages based on instance memory...
Mar 16 12:49:49 ip-10-0-0-116 configure-hugepages.sh[613]: Configuring 0 huge pages (instance RAM: 911MB)
Mar 16 12:49:49 ip-10-0-0-116 configure-hugepages.sh[660]: vm.nr_hugepages = 0
Mar 16 12:49:50 ip-10-0-0-116 systemd[1]: Finished configure-hugepages.service - Configure huge pages based on instance memory.

Systemd Services8 entries

LaserData service status overview
SERVICE                             LOADED       ACTIVE       SUB       
-------                             ------       ------       ---       
warden.service                      loaded       active       running   
iggy-server.service                 loaded       active       running   
iggy-connectors.service             loaded       active       running   
laser-prober.service                loaded       active       running   
configure-hugepages.service         loaded       active       exited    
Failed systemd units
  UNIT                LOAD   ACTIVE SUB    DESCRIPTION
● cloud-final.service loaded failed failed Cloud-init: Final Stage

Legend: LOAD   → Reflects whether the unit definition was properly loaded.
        ACTIVE → The high-level unit activation state, i.e. generalization of SUB.
        SUB    → The low-level unit activation state, values depend on unit type.

1 loaded units listed.
systemctl status warden.service
● warden.service - LaserData Warden
     Loaded: loaded (/etc/systemd/system/warden.service; enabled; preset: enabled)
     Active: active (running) since Mon 2026-03-16 12:50:02 UTC; 1min 3s ago
   Main PID: 1409 (laser-warden)
      Tasks: 135 (limit: 1013)
     Memory: 45.3M (peak: 46.0M)
        CPU: 786ms
     CGroup: /system.slice/warden.service
             ├─1409 /opt/warden/current/laser-warden
             ├─1549 bash -c "mpstat -P ALL 1 1 2>/dev/null || echo '(mpstat not available - install sysstat)'"
             ├─1554 mpstat -P ALL 1 1
             ├─1585 bash -c "echo '=== TCP connection state summary ==='; ss -tan 2>/dev/null | awk 'NR>1 {print \$1}' | sort | uniq -c | sort -rn; echo ''; echo '=== LaserData process connections ==='; for name in laser-warden iggy-server iggy-connectors laser-prober; do   CONNS=\$(ss -tnp 2>/dev/null | grep \"\$name\" || true);   if [ -n \"\$CONNS\" ]; then     echo \"--- \$name ---\";     echo \"\$CONNS\" | awk '{print \$1}' | sort | uniq -c | sort -rn;     TOTAL=\$(echo \"\$CONNS\" | wc -l);     echo \"Total connections: \$TOTAL\";     echo '';   fi; done; echo '=== TIME_WAIT count ==='; TW=\$(ss -tan state time-wait 2>/dev/null | wc -l); echo \"TIME_WAIT: \$TW\"; [ \"\$TW\" -gt 1000 ] 2>/dev/null && echo '*** WARNING: High TIME_WAIT count ***' || true; echo ''; echo '=== CLOSE_WAIT count ==='; CW=\$(ss -tan state close-wait 2>/dev/null | wc -l); echo \"CLOSE_WAIT: \$CW\"; [ \"\$CW\" -gt 50 ] 2>/dev/null && echo '*** WARNING: CLOSE_WAIT connections indicate possible leak ***' || true"
             ├─1588 bash -c "top -bn1 | head -30"
             ├─1589 bash -c "for name in laser-warden iggy-server iggy-connectors laser-prober; do   pid=\$(pgrep -x \"\$name\" 2>/dev/null | head -1);   if [ -n \"\$pid\" ]; then     echo \"=== \$name (PID \$pid) ===\";     echo \"RSS: \$(awk '/VmRSS/{print \$2\" \"\$3}' /proc/\$pid/status 2>/dev/null || echo N/A)\";     echo \"VSZ: \$(awk '/VmSize/{print \$2\" \"\$3}' /proc/\$pid/status 2>/dev/null || echo N/A)\";     echo \"Threads: \$(awk '/Threads/{print \$2}' /proc/\$pid/status 2>/dev/null || echo N/A)\";     echo \"FDs: \$(ls /proc/\$pid/fd 2>/dev/null | wc -l)\";     echo \"Uptime: \$(ps -o etime= -p \$pid 2>/dev/null | tr -d ' ')\";     echo \"CPU: \$(ps -o %cpu= -p \$pid 2>/dev/null | tr -d ' ')%\";     echo '';   else     echo \"=== \$name: NOT RUNNING ===\"; echo '';   fi; done"
             ├─1591 bash -c "for pid in /proc/[0-9]*/fd; do echo \"\$(ls -1 \$pid 2>/dev/null | wc -l) \$(cat \${pid%/fd}/cmdline 2>/dev/null | tr '\\0' ' ' | head -c 80)\"; done 2>/dev/null | sort -rn | head -20"
             ├─1601 bash -c "echo '=== Deployment Symlinks ==='; for d in /opt/warden/current /opt/iggy/current /opt/connectors/current /opt/prober/current; do   if [ -L \"\$d\" ]; then     echo \"\$d -> \$(readlink \$d)\";   elif [ -d \"\$d\" ]; then     echo \"\$d (directory, not symlink)\";   else     echo \"\$d (MISSING)\";   fi; done; echo ''; echo '=== Binary --version Output ==='; for bin in /opt/warden/current/laser-warden /opt/iggy/current/iggy-server /opt/connectors/current/iggy-connectors /opt/prober/current/laser-prober; do   if [ -x \"\$bin\" ]; then     echo \"--- \$(basename \$bin) ---\";     timeout 5 \$bin --version 2>&1 || echo '(no --version output)';   else     echo \"--- \$(basename \$bin): NOT FOUND ---\";   fi;   echo ''; done; echo '=== All deployed versions ==='; for d in /opt/warden /opt/iggy /opt/connectors /opt/prober; do   [ -d \"\$d\" ] && ls -1d \$d/*/ 2>/dev/null | grep -v current || true; done"
             ├─1602 bash -c "for bin in /opt/warden/current/laser-warden /opt/iggy/current/iggy-server /opt/connectors/current/iggy-connectors /opt/prober/current/laser-prober; do   if [ -f \"\$bin\" ]; then     echo \"--- \$(basename \$bin) ---\";     file \$bin 2>/dev/null;     getcap \$bin 2>/dev/null || true;     ls -lh \$bin;     echo '';   fi; done"
             ├─1606 bash -c "echo 'minisign:' && which minisign 2>/dev/null && minisign -v 2>&1 || echo '(not installed)'; echo ''; echo '=== Signing pubkey (/etc/laserdata/laserdata.pub) ==='; if [ -f /etc/laserdata/laserdata.pub ]; then   ls -la /etc/laserdata/laserdata.pub;   echo '--- content ---';   cat /etc/laserdata/laserdata.pub; else   echo '(not found)'; fi"
             ├─1608 bash -c "echo '=== /etc/laserdata/certs/ ==='; ls -la /etc/laserdata/certs/ 2>/dev/null || echo '(directory not found)'; echo ''; for cert in /etc/laserdata/certs/*.crt /etc/laserdata/certs/*.pem; do   [ -f \"\$cert\" ] || continue;   echo \"--- \$cert ---\";   openssl x509 -in \"\$cert\" -noout -subject -issuer -dates -serial -fingerprint -sha256 2>/dev/null || { echo '(cannot parse)'; continue; };   echo \"Signature Algorithm: \$(openssl x509 -in \"\$cert\" -noout -text 2>/dev/null | grep 'Signature Algorithm' | head -1 | sed 's/.*: //')\";   echo \"Key: \$(openssl x509 -in \"\$cert\" -noout -text 2>/dev/null | grep -A1 'Public Key Algorithm' | tr -d '\\n' | sed 's/.*Algorithm: //;s/  */ /g')\";   SANS=\$(openssl x509 -in \"\$cert\" -noout -ext subjectAltName 2>/dev/null | grep -v 'Subject Alternative' | tr -d ' ' | tr ',' '\\n' || true);   if [ -n \"\$SANS\" ]; then echo \"SANs:\"; echo \"\$SANS\" | sed 's/^/  /'; else echo 'SANs: none'; fi;   EXPIRY=\$(openssl x509 -in \"\$cert\" -noout -enddate 2>/dev/null | cut -d= -f2);   if [ -n \"\$EXPIRY\" ]; then     EXPIRY_EPOCH=\$(date -d \"\$EXPIRY\" +%s 2>/dev/null);     NOW_EPOCH=\$(date +%s);     DAYS_LEFT=\$(( (EXPIRY_EPOCH - NOW_EPOCH) / 86400 ));     echo \"Days until expiry: \$DAYS_LEFT\";     [ \$DAYS_LEFT -lt 14 ] && echo '*** WARNING: Certificate expires soon! ***';     [ \$DAYS_LEFT -lt 0 ] && echo '*** CRITICAL: Certificate has EXPIRED! ***';   fi;   echo ''; done"
             ├─1609 bash -c "for name in laser-warden iggy-server iggy-connectors laser-prober; do   pid=\$(pgrep -x \"\$name\" 2>/dev/null | head -1);   if [ -n \"\$pid\" ]; then     echo \"=== \$name (PID \$pid) ===\";     echo \"RSS: \$(awk '/VmRSS/{print \$2\" \"\$3}' /proc/\$pid/status 2>/dev/null || echo N/A)\";     echo \"VSZ: \$(awk '/VmSize/{print \$2\" \"\$3}' /proc/\$pid/status 2>/dev/null || echo N/A)\";     echo \"Threads: \$(awk '/Threads/{print \$2}' /proc/\$pid/status 2>/dev/null || echo N/A)\";     echo \"FDs: \$(ls /proc/\$pid/fd 2>/dev/null | wc -l)\";     echo \"Uptime: \$(ps -o etime= -p \$pid 2>/dev/null | tr -d ' ')\";     echo \"CPU: \$(ps -o %cpu= -p \$pid 2>/dev/null | tr -d ' ')%\";     echo '';   else     echo \"=== \$name: NOT RUNNING ===\"; echo '';   fi; done"
             ├─1610 top -bn1
             ├─1611 head -30
             ├─1612 pgrep -x laser-warden
             ├─1613 head -1
             ├─1615 bash -c "for pid in /proc/[0-9]*/fd; do echo \"\$(ls -1 \$pid 2>/dev/null | wc -l) \$(cat \${pid%/fd}/cmdline 2>/dev/null | tr '\\0' ' ' | head -c 80)\"; done 2>/dev/null | sort -rn | head -20"
             ├─1616 sort -rn
             ├─1617 head -20
             ├─1619 bash -c "echo '=== /etc/letsencrypt/live/warden/ ==='; ls -la /etc/letsencrypt/live/warden/ 2>/dev/null || echo '(directory not found)'; echo ''; for cert in /etc/letsencrypt/live/warden/fullchain.pem /etc/letsencrypt/live/warden/cert.pem; do   [ -f \"\$cert\" ] || continue;   echo \"--- \$cert ---\";   openssl x509 -in \"\$cert\" -noout -subject -issuer -dates -serial -fingerprint -sha256 2>/dev/null || { echo '(cannot parse)'; continue; };   echo \"Signature Algorithm: \$(openssl x509 -in \"\$cert\" -noout -text 2>/dev/null | grep 'Signature Algorithm' | head -1 | sed 's/.*: //')\";   echo \"Key: \$(openssl x509 -in \"\$cert\" -noout -text 2>/dev/null | grep -A1 'Public Key Algorithm' | tr -d '\\n' | sed 's/.*Algorithm: //;s/  */ /g')\";   SANS=\$(openssl x509 -in \"\$cert\" -noout -ext subjectAltName 2>/dev/null | grep -v 'Subject Alternative' | tr -d ' ' | tr ',' '\\n' || true);   if [ -n \"\$SANS\" ]; then echo \"SANs:\"; echo \"\$SANS\" | sed 's/^/  /'; else echo 'SANs: none'; fi;   EXPIRY=\$(openssl x509 -in \"\$cert\" -noout -enddate 2>/dev/null | cut -d= -f2);   if [ -n \"\$EXPIRY\" ]; then     EXPIRY_EPOCH=\$(date -d \"\$EXPIRY\" +%s 2>/dev/null);     NOW_EPOCH=\$(date +%s);     DAYS_LEFT=\$(( (EXPIRY_EPOCH - NOW_EPOCH) / 86400 ));     echo \"Days until expiry: \$DAYS_LEFT\";     [ \$DAYS_LEFT -lt 14 ] && echo '*** WARNING: Certificate expires soon! ***';     [ \$DAYS_LEFT -lt 0 ] && echo '*** CRITICAL: Certificate has EXPIRED! ***';   fi;   echo ''; done"
             ├─1620 bash -c "echo '=== Let'\\''s Encrypt chain validation ==='; if [ -f /etc/letsencrypt/live/warden/fullchain.pem ]; then   openssl verify -verbose /etc/letsencrypt/live/warden/fullchain.pem 2>&1 || true;   echo '';   echo 'Chain depth:';   grep -c 'BEGIN CERTIFICATE' /etc/letsencrypt/live/warden/fullchain.pem 2>/dev/null || echo '(cannot determine)'; else   echo '(fullchain.pem not found)'; fi; echo ''; echo '=== LaserData cert chain validation ==='; for cert in /etc/laserdata/certs/*.crt /etc/laserdata/certs/*.pem; do   [ -f \"\$cert\" ] || continue;   echo \"--- \$cert ---\";   openssl verify -verbose \"\$cert\" 2>&1 || true; done"
             ├─1624 bash -c "echo '=== Certbot certificates ==='; certbot certificates 2>/dev/null || echo '(certbot not installed or no certs)'; echo ''; echo '=== Certbot renewal config ==='; ls -la /etc/letsencrypt/renewal/ 2>/dev/null || echo '(no renewal configs)'; for conf in /etc/letsencrypt/renewal/*.conf; do   [ -f \"\$conf\" ] || continue;   echo \"--- \$conf ---\";   cat \"\$conf\" 2>/dev/null;   echo ''; done; echo '=== Certbot timer/cron ==='; systemctl list-timers 2>/dev/null | grep -iE 'certbot|letsencrypt|acme' ||   ls -la /etc/cron.d/certbot 2>/dev/null ||   echo '(no certbot timer or cron found)'; echo ''; echo '=== Certbot renewal log (last 50 lines) ==='; tail -50 /var/log/letsencrypt/letsencrypt.log 2>/dev/null || echo '(no certbot log)'"
             ├─1627 bash -c "for port_label in '443:warden-https'; do   PORT=\$(echo \"\$port_label\" | cut -d: -f1);   LABEL=\$(echo \"\$port_label\" | cut -d: -f2);   echo \"=== \$LABEL (port \$PORT) ===\";   RESULT=\$(timeout 5 bash -c \"echo | openssl s_client -connect localhost:\$PORT -servername localhost 2>/dev/null\" 2>/dev/null || true);   if [ -n \"\$RESULT\" ]; then     echo \"\$RESULT\" | openssl x509 -noout -subject -issuer -dates -fingerprint -sha256 2>/dev/null || echo '(no valid certificate)';     echo \"Protocol: \$(echo \"\$RESULT\" | grep 'Protocol  :' | sed 's/.*: //')\";     echo \"Cipher: \$(echo \"\$RESULT\" | grep 'Cipher    :' | sed 's/.*: //')\";     echo \"\$RESULT\" | grep 'Verify return code:' || true;   else     echo '(no TLS or not reachable)';   fi;   echo ''; done"
             ├─1629 bash -c "echo '=== System CA bundle ==='; ls -la /etc/ssl/certs/ca-certificates.crt 2>/dev/null || echo '(not found)'; echo \"CA count: \$(grep -c 'BEGIN CERTIFICATE' /etc/ssl/certs/ca-certificates.crt 2>/dev/null || echo 'N/A')\"; echo \"Last update: \$(stat -c '%y' /etc/ssl/certs/ca-certificates.crt 2>/dev/null || echo 'N/A')\"; echo ''; echo '=== Custom CA certs ==='; ls -la /usr/local/share/ca-certificates/ 2>/dev/null || echo '(no custom CAs)'; echo ''; echo '=== OpenSSL version & default paths ==='; openssl version -a 2>/dev/null | head -5 || echo '(openssl not found)'"
             ├─1640 bash -c "echo '=== /etc/warden/ ==='; find /etc/warden -type f 2>/dev/null | while read f; do   PERMS=\$(stat -c '%A %U:%G %s bytes, modified %y' \"\$f\" 2>/dev/null);   echo \"  \$f  (\$PERMS)\"; done; echo ''; echo '=== Warden env ==='; if [ -f /etc/warden/warden.env ]; then   cat /etc/warden/warden.env; else   echo '(not found)'; fi; echo ''; echo '=== PAT files ==='; for pat in /etc/warden/credentials/*.pat; do   [ -f \"\$pat\" ] || continue;   SIZE=\$(stat -c %s \"\$pat\" 2>/dev/null || echo 0);   AGE=\$(stat -c %Y \"\$pat\" 2>/dev/null || echo 0);   NOW=\$(date +%s);   HOURS=\$(( (NOW - AGE) / 3600 ));   echo \"  \$pat (\$SIZE bytes, \${HOURS}h ago)\"; done; [ ! -d /etc/warden/credentials ] && echo '(credentials dir not found)'"
             ├─1648 bash -c "for k in net.core.rmem_max net.core.wmem_max net.ipv4.tcp_rmem net.ipv4.tcp_wmem net.core.somaxconn net.core.netdev_max_backlog net.ipv4.tcp_max_syn_backlog net.ipv4.tcp_keepalive_time net.ipv4.tcp_keepalive_intvl net.ipv4.tcp_keepalive_probes vm.swappiness vm.dirty_ratio vm.dirty_background_ratio fs.file-max fs.nr_open vm.nr_hugepages; do   VAL=\$(sysctl -n \$k 2>/dev/null || echo 'N/A');   printf '%-45s = %s\\n' \"\$k\" \"\$VAL\"; done"
             ├─1649 bash -c "echo '=== Systemd mimalloc overrides ==='; cat /etc/systemd/system/iggy-server.service.d/mimalloc.conf 2>/dev/null || echo '(no iggy mimalloc override)'; echo ''; cat /etc/systemd/system/iggy-connectors.service.d/mimalloc.conf 2>/dev/null || echo '(no connectors mimalloc override)'; echo ''; echo '=== Hugepages service ==='; systemctl status configure-hugepages.service --no-pager 2>/dev/null || echo '(hugepages service not found)'"
             ├─1650 bash -c "printf '%-35s %-12s %-12s %-10s\\n' 'SERVICE' 'LOADED' 'ACTIVE' 'SUB'; printf '%-35s %-12s %-12s %-10s\\n' '-------' '------' '------' '---'; for svc in warden.service laser-warden.service iggy-server.service laser-iggy.service iggy-connectors.service prober.service laser-prober.service configure-hugepages.service drbd-prepare.service; do   INFO=\$(systemctl show \"\$svc\" --property=LoadState,ActiveState,SubState 2>/dev/null);   LOADED=\$(echo \"\$INFO\" | grep LoadState | cut -d= -f2);   ACTIVE=\$(echo \"\$INFO\" | grep ActiveState | cut -d= -f2);   SUB=\$(echo \"\$INFO\" | grep SubState | cut -d= -f2);   [ \"\$LOADED\" = 'not-found' ] && continue;   printf '%-35s %-12s %-12s %-10s\\n' \"\$svc\" \"\$LOADED\" \"\$ACTIVE\" \"\$SUB\"; done"
             ├─1651 bash -c "echo '=== TCP connection state summary ==='; ss -tan 2>/dev/null | awk 'NR>1 {print \$1}' | sort | uniq -c | sort -rn; echo ''; echo '=== LaserData process connections ==='; for name in laser-warden iggy-server iggy-connectors laser-prober; do   CONNS=\$(ss -tnp 2>/dev/null | grep \"\$name\" || true);   if [ -n \"\$CONNS\" ]; then     echo \"--- \$name ---\";     echo \"\$CONNS\" | awk '{print \$1}' | sort | uniq -c | sort -rn;     TOTAL=\$(echo \"\$CONNS\" | wc -l);     echo \"Total connections: \$TOTAL\";     echo '';   fi; done; echo '=== TIME_WAIT count ==='; TW=\$(ss -tan state time-wait 2>/dev/null | wc -l); echo \"TIME_WAIT: \$TW\"; [ \"\$TW\" -gt 1000 ] 2>/dev/null && echo '*** WARNING: High TIME_WAIT count ***' || true; echo ''; echo '=== CLOSE_WAIT count ==='; CW=\$(ss -tan state close-wait 2>/dev/null | wc -l); echo \"CLOSE_WAIT: \$CW\"; [ \"\$CW\" -gt 50 ] 2>/dev/null && echo '*** WARNING: CLOSE_WAIT connections indicate possible leak ***' || true"
             ├─1652 ss -tnp
             ├─1657 openssl verify -verbose /etc/letsencrypt/live/warden/fullchain.pem
             ├─1659 bash -c "echo '=== /etc/warden/ ==='; find /etc/warden -type f 2>/dev/null | while read f; do   PERMS=\$(stat -c '%A %U:%G %s bytes, modified %y' \"\$f\" 2>/dev/null);   echo \"  \$f  (\$PERMS)\"; done; echo ''; echo '=== Warden env ==='; if [ -f /etc/warden/warden.env ]; then   cat /etc/warden/warden.env; else   echo '(not found)'; fi; echo ''; echo '=== PAT files ==='; for pat in /etc/warden/credentials/*.pat; do   [ -f \"\$pat\" ] || continue;   SIZE=\$(stat -c %s \"\$pat\" 2>/dev/null || echo 0);   AGE=\$(stat -c %Y \"\$pat\" 2>/dev/null || echo 0);   NOW=\$(date +%s);   HOURS=\$(( (NOW - AGE) / 3600 ));   echo \"  \$pat (\$SIZE bytes, \${HOURS}h ago)\"; done; [ ! -d /etc/warden/credentials ] && echo '(credentials dir not found)'"
             ├─1660 grep laser-warden
             ├─1661 file /opt/warden/current/laser-warden
             ├─1664 bash -c "systemctl status warden.service --no-pager 2>/dev/null; systemctl status laser-warden.service --no-pager 2>/dev/null; true"
             ├─1667 bash -c "systemctl status iggy-server.service --no-pager 2>/dev/null; systemctl status laser-iggy.service --no-pager 2>/dev/null; true"
             ├─1672 bash -c "systemctl status iggy-connectors.service --no-pager 2>/dev/null; true"
             ├─1674 bash -c "systemctl status prober.service --no-pager 2>/dev/null; systemctl status laser-prober.service --no-pager 2>/dev/null; true"
             ├─1680 openssl x509 -in /etc/laserdata/certs/laserdata.crt -noout -subject -issuer -dates -serial -fingerprint -sha256
             ├─1681 bash -c "for svc in warden laser-warden iggy-server laser-iggy iggy-connectors prober laser-prober; do   COUNT=\$(journalctl -u \${svc}.service --since '24 hours ago' --no-pager 2>/dev/null | grep -c 'Started\\|Stopped\\|Deactivated' || echo 0);   [ \"\$COUNT\" -gt 0 ] && echo \"\$svc.service: \$COUNT start/stop events in last 24h\"; done; echo ''; echo '=== Recent service state changes ==='; journalctl -u 'warden*' -u 'laser-warden*' -u 'iggy*' -u 'laser-iggy*' -u 'laser-prober*' -u 'prober*' --since '24 hours ago' --no-pager 2>/dev/null | grep -E 'Started|Stopped|Failed|Deactivated|Main process exited' | tail -30 || echo '(no recent events)'"
             ├─1682 bash -c "printf '%-35s %-12s %-12s %-10s\\n' 'SERVICE' 'LOADED' 'ACTIVE' 'SUB'; printf '%-35s %-12s %-12s %-10s\\n' '-------' '------' '------' '---'; for svc in warden.service laser-warden.service iggy-server.service laser-iggy.service iggy-connectors.service prober.service laser-prober.service configure-hugepages.service drbd-prepare.service; do   INFO=\$(systemctl show \"\$svc\" --property=LoadState,ActiveState,SubState 2>/dev/null);   LOADED=\$(echo \"\$INFO\" | grep LoadState | cut -d= -f2);   ACTIVE=\$(echo \"\$INFO\" | grep ActiveState | cut -d= -f2);   SUB=\$(echo \"\$INFO\" | grep SubState | cut -d= -f2);   [ \"\$LOADED\" = 'not-found' ] && continue;   printf '%-35s %-12s %-12s %-10s\\n' \"\$svc\" \"\$LOADED\" \"\$ACTIVE\" \"\$SUB\"; done"
             ├─1687 systemctl list-timers --all --no-pager
             ├─1691 bash -c "journalctl -u warden.service -u laser-warden.service --no-pager -n 2000 2>/dev/null || echo '(no warden logs)'"
             ├─1693 bash -c "journalctl -u warden.service -u laser-warden.service --no-pager --since '24 hours ago' -p err 2>/dev/null | tail -500 || echo '(no warden error logs)'"
             ├─1696 systemctl status iggy-server.service --no-pager
             ├─1698 systemctl status warden.service --no-pager
             ├─1699 bash -c "journalctl -u iggy-server.service -u laser-iggy.service --no-pager -n 2000 2>/dev/null || echo '(no iggy logs)'"
             ├─1700 bash -c "journalctl -u iggy-server.service -u laser-iggy.service --no-pager --since '24 hours ago' -p err 2>/dev/null | tail -500 || echo '(no iggy error logs)'"
             ├─1701 bash -c "journalctl -u iggy-connectors.service --no-pager -n 2000 2>/dev/null || echo '(no connectors logs)'"
             ├─1702 openssl x509 -in /etc/letsencrypt/live/warden/fullchain.pem -noout -subject -issuer -dates -serial -fingerprint -sha256
             ├─1703 systemctl status iggy-connectors.service --no-pager
             ├─1707 bash -c "journalctl -u iggy-connectors.service --no-pager --since '24 hours ago' -p err 2>/dev/null | tail -500 || echo '(no connectors error logs)'"
             ├─1708 bash -c "journalctl -u prober.service -u laser-prober.service --no-pager -n 2000 2>/dev/null || echo '(no prober logs)'"
             ├─1709 bash -c "journalctl -u prober.service -u laser-prober.service --no-pager --since '24 hours ago' -p err 2>/dev/null | tail -500 || echo '(no prober error logs)'"
             ├─1710 bash -c "echo '=== System CA bundle ==='; ls -la /etc/ssl/certs/ca-certificates.crt 2>/dev/null || echo '(not found)'; echo \"CA count: \$(grep -c 'BEGIN CERTIFICATE' /etc/ssl/certs/ca-certificates.crt 2>/dev/null || echo 'N/A')\"; echo \"Last update: \$(stat -c '%y' /etc/ssl/certs/ca-certificates.crt 2>/dev/null || echo 'N/A')\"; echo ''; echo '=== Custom CA certs ==='; ls -la /usr/local/share/ca-certificates/ 2>/dev/null || echo '(no custom CAs)'; echo ''; echo '=== OpenSSL version & default paths ==='; openssl version -a 2>/dev/null | head -5 || echo '(openssl not found)'"
             ├─1712 journalctl -p err --no-pager -n 500
             ├─1713 bash -c "for svc in warden laser-warden iggy-server laser-iggy iggy-connectors prober laser-prober; do   COUNT=\$(journalctl -u \${svc}.service --since '24 hours ago' --no-pager 2>/dev/null | grep -c 'Started\\|Stopped\\|Deactivated' || echo 0);   [ \"\$COUNT\" -gt 0 ] && echo \"\$svc.service: \$COUNT start/stop events in last 24h\"; done; echo ''; echo '=== Recent service state changes ==='; journalctl -u 'warden*' -u 'laser-warden*' -u 'iggy*' -u 'laser-iggy*' -u 'laser-prober*' -u 'prober*' --since '24 hours ago' --no-pager 2>/dev/null | grep -E 'Started|Stopped|Failed|Deactivated|Main process exited' | tail -30 || echo '(no recent events)'"
             ├─1714 journalctl -u warden.service --since "24 hours ago" --no-pager
             ├─1715 grep -c "Started\\|Stopped\\|Deactivated"
             ├─1716 bash -c "journalctl -u 'warden*' -u 'laser-warden*' -u 'iggy*' -u 'laser-iggy*' -u 'iggy-connectors*' -u 'prober*' -u 'laser-prober*' -p warning --since '24 hours ago' --no-pager 2>/dev/null | tail -500 || echo '(no warnings)'"
             ├─1718 journalctl -u warden.service -u laser-warden.service --no-pager --since "24 hours ago" -p err
             ├─1719 tail -500
             ├─1720 bash -c "for port_label in '443:warden-https'; do   PORT=\$(echo \"\$port_label\" | cut -d: -f1);   LABEL=\$(echo \"\$port_label\" | cut -d: -f2);   echo \"=== \$LABEL (port \$PORT) ===\";   RESULT=\$(timeout 5 bash -c \"echo | openssl s_client -connect localhost:\$PORT -servername localhost 2>/dev/null\" 2>/dev/null || true);   if [ -n \"\$RESULT\" ]; then     echo \"\$RESULT\" | openssl x509 -noout -subject -issuer -dates -fingerprint -sha256 2>/dev/null || echo '(no valid certificate)';     echo \"Protocol: \$(echo \"\$RESULT\" | grep 'Protocol  :' | sed 's/.*: //')\";     echo \"Cipher: \$(echo \"\$RESULT\" | grep 'Cipher    :' | sed 's/.*: //')\";     echo \"\$RESULT\" | grep 'Verify return code:' || true;   else     echo '(no TLS or not reachable)';   fi;   echo ''; done"
             ├─1721 bash -c "journalctl -b -p err --no-pager 2>/dev/null | tail -200 || echo '(cannot read boot log)'"
             ├─1725 journalctl -u warden.service -u laser-warden.service --no-pager -n 2000
             ├─1726 bash -c "for k in net.core.rmem_max net.core.wmem_max net.ipv4.tcp_rmem net.ipv4.tcp_wmem net.core.somaxconn net.core.netdev_max_backlog net.ipv4.tcp_max_syn_backlog net.ipv4.tcp_keepalive_time net.ipv4.tcp_keepalive_intvl net.ipv4.tcp_keepalive_probes vm.swappiness vm.dirty_ratio vm.dirty_background_ratio fs.file-max fs.nr_open vm.nr_hugepages; do   VAL=\$(sysctl -n \$k 2>/dev/null || echo 'N/A');   printf '%-45s = %s\\n' \"\$k\" \"\$VAL\"; done"
             ├─1727 "[ls]"
             ├─1728 journalctl -u iggy-connectors.service --no-pager -n 2000
             ├─1729 sysctl -n net.core.wmem_max
             ├─1730 bash -c "dmesg --time-format iso 2>/dev/null | tail -300 || dmesg 2>/dev/null | tail -300 || echo '(cannot read dmesg)'"
             ├─1731 bash -c "dmesg --level=err,warn --time-format iso 2>/dev/null | tail -100 || echo '(cannot filter dmesg)'"
             ├─1733 journalctl -u iggy-server.service -u laser-iggy.service --no-pager --since "24 hours ago" -p err
             ├─1735 tail -500
             ├─1736 journalctl --disk-usage
             ├─1737 journalctl -u iggy-server.service -u laser-iggy.service --no-pager -n 2000
             ├─1738 journalctl -u iggy-connectors.service --no-pager --since "24 hours ago" -p err
             ├─1739 tail -500
             ├─1740 journalctl -u prober.service -u laser-prober.service --no-pager --since "24 hours ago" -p err
             ├─1741 tail -500
             ├─1742 journalctl -u prober.service -u laser-prober.service --no-pager -n 2000
             ├─1743 bash -c "for pid in /proc/[0-9]*/fd; do echo \"\$(ls -1 \$pid 2>/dev/null | wc -l) \$(cat \${pid%/fd}/cmdline 2>/dev/null | tr '\\0' ' ' | head -c 80)\"; done 2>/dev/null | sort -rn | head -20"
             ├─1744 bash -c "CONTENT=\$(cat /etc/systemd/journald.conf 2>/dev/null | grep -v '^#' | grep -v '^\$' | grep -v '^\\['); if [ -z \"\$CONTENT\" ]; then echo '(default configuration, no overrides)'; else echo \"\$CONTENT\"; fi"
             ├─1745 systemctl status configure-hugepages.service --no-pager
             ├─1746 journalctl -u "warden*" -u "laser-warden*" -u "iggy*" -u "laser-iggy*" -u "iggy-connectors*" -u "prober*" -u "laser-prober*" -p warning --since "24 hours ago" --no-pager
             ├─1747 tail -500
             ├─1748 ls -1 /proc/10/fd
             ├─1749 bash -c "echo '=== Current time ==='; date -u '+%Y-%m-%d %H:%M:%S UTC'; date '+%Y-%m-%d %H:%M:%S %Z (local)'; echo ''; echo '=== chrony status ==='; chronyc tracking 2>/dev/null || echo '(chrony not available)'; echo ''; chronyc sources -v 2>/dev/null || echo '(chrony sources not available)'; echo ''; echo '=== NTP status ==='; ntpq -p 2>/dev/null || echo '(ntpq not available)'; echo ''; echo '=== systemd-timesyncd ==='; systemctl status systemd-timesyncd --no-pager 2>/dev/null || echo '(timesyncd not active)'; echo ''; timedatectl timesync-status 2>/dev/null || echo '(timesync-status not available)'"
             ├─1750 readlink /opt/prober/current
             ├─1751 bash -c "echo '=== acme-v02.api.letsencrypt.org ==='; HTTP_CODE=\$(curl -s -o /dev/null -w '%{http_code}' --connect-timeout 5 --max-time 10 'https://acme-v02.api.letsencrypt.org/directory' 2>/dev/null || echo 'FAILED'); echo \"  HTTP status: \$HTTP_CODE\"; if [ \"\$HTTP_CODE\" = '200' ]; then   echo '  ACME directory reachable'; elif [ \"\$HTTP_CODE\" = 'FAILED' ]; then   echo '  *** WARNING: Cannot reach Let'\\''s Encrypt ACME endpoint ***'; fi; echo ''; echo '=== Outbound port 80/443 test ==='; timeout 3 bash -c 'echo > /dev/tcp/acme-v02.api.letsencrypt.org/443' 2>/dev/null && echo 'Port 443 outbound: OK' || echo 'Port 443 outbound: BLOCKED or timeout'; timeout 3 bash -c 'echo > /dev/tcp/acme-v02.api.letsencrypt.org/80' 2>/dev/null && echo 'Port 80 outbound: OK' || echo 'Port 80 outbound: BLOCKED or timeout'"
             └─1752 systemctl status laser-prober.service --no-pager

Mar 16 12:51:06 ip-10-0-0-116 systemd[1]: warden.service: Got notification message from PID 1535, but reception only permitted for main PID 1409
Mar 16 12:51:06 ip-10-0-0-116 systemd[1]: warden.service: Got notification message from PID 1634, but reception only permitted for main PID 1409
Mar 16 12:51:06 ip-10-0-0-116 systemd[1]: warden.service: Got notification message from PID 1656, but reception only permitted for main PID 1409
Mar 16 12:51:06 ip-10-0-0-116 systemd[1]: warden.service: Got notification message from PID 1695, but reception only permitted for main PID 1409
Mar 16 12:51:06 ip-10-0-0-116 systemd[1]: warden.service: Got notification message from PID 1686, but reception only permitted for main PID 1409
Mar 16 12:51:06 ip-10-0-0-116 systemd[1]: warden.service: Got notification message from PID 1736, but reception only permitted for main PID 1409
Mar 16 12:51:06 ip-10-0-0-116 systemd[1]: warden.service: Got notification message from PID 1738, but reception only permitted for main PID 1409
Mar 16 12:51:06 ip-10-0-0-116 systemd[1]: warden.service: Got notification message from PID 1712, but reception only permitted for main PID 1409
Mar 16 12:51:06 ip-10-0-0-116 systemd[1]: warden.service: Got notification message from PID 1696, but reception only permitted for main PID 1409
Mar 16 12:51:06 ip-10-0-0-116 systemd[1]: warden.service: Got notification message from PID 1703, but reception only permitted for main PID 1409
systemctl status iggy-server.service
● iggy-server.service - Iggy Server
     Loaded: loaded (/etc/systemd/system/iggy-server.service; disabled; preset: enabled)
    Drop-In: /etc/systemd/system/iggy-server.service.d
             └─mimalloc.conf
     Active: active (running) since Mon 2026-03-16 12:50:02 UTC; 1min 3s ago
   Main PID: 1482 (iggy-server)
      Tasks: 8 (limit: 1013)
     Memory: 99.8M (peak: 100.3M)
        CPU: 788ms
     CGroup: /system.slice/iggy-server.service
             └─1482 /opt/iggy/current/iggy-server

Mar 16 12:50:35 ip-10-0-0-116 iggy-server[1482]: 2026-03-16T12:50:35.213911Z  INFO shard-0 server::tcp::tcp_tls_listener: Added tcp client with session: client ID: 218821652, IP address: 109.243.3.168:15649 for IP address: 109.243.3.168:15649
Mar 16 12:50:35 ip-10-0-0-116 iggy-server[1482]: 2026-03-16T12:50:35.213919Z  INFO shard-0 server::tcp::tcp_tls_listener: Created new session: client ID: 218821652, IP address: 109.243.3.168:15649
Mar 16 12:50:35 ip-10-0-0-116 iggy-server[1482]: 2026-03-16T12:50:35.214699Z  INFO shard-0 trace_login_user{iggy_user_id=4294967295 iggy_client_id=218821652}: server::binary::handlers::users::login_user_handler: Logging in user: root ...
Mar 16 12:50:35 ip-10-0-0-116 iggy-server[1482]: 2026-03-16T12:50:35.253980Z  INFO shard-0 trace_login_user{iggy_user_id=4294967295 iggy_client_id=218821652}: server::binary::handlers::users::login_user_handler: Logged in user: root with ID: 0.
Mar 16 12:50:42 ip-10-0-0-116 iggy-server[1482]: 2026-03-16T12:50:42.675764Z  INFO shard-0 server::shard::system::clients: Deleted tcp client with ID: 218821652 for IP address: 109.243.3.168:15649
Mar 16 12:50:42 ip-10-0-0-116 iggy-server[1482]: 2026-03-16T12:50:42.675859Z  INFO shard-0 server::tcp::tcp_tls_listener: Successfully closed TCP TLS stream for client: 218821652, address: 109.243.3.168:15649.
Mar 16 12:50:44 ip-10-0-0-116 iggy-server[1482]: 2026-03-16T12:50:44.075878Z  INFO shard-0 server::shard::tasks::periodic::sysinfo_printer: CPU: 0.00%/0.46% (IggyUsage/Total), Mem: 46.92%/116.66 MB/507.27 MB/955.73 MB (Free/IggyUsage/TotalUsed/Total), Clients: 3, Messages: 1k, Read: 3.23 MB, Written: 614.40 KB, OpenFDs: 196
Mar 16 12:50:54 ip-10-0-0-116 iggy-server[1482]: 2026-03-16T12:50:54.076597Z  INFO shard-0 server::shard::tasks::periodic::sysinfo_printer: CPU: 0.00%/0.33% (IggyUsage/Total), Mem: 46.92%/116.66 MB/507.27 MB/955.73 MB (Free/IggyUsage/TotalUsed/Total), Clients: 3, Messages: 1k, Read: 3.23 MB, Written: 618.50 KB, OpenFDs: 196
Mar 16 12:51:04 ip-10-0-0-116 iggy-server[1482]: 2026-03-16T12:51:04.077149Z  INFO shard-0 server::shard::tasks::periodic::sysinfo_printer: CPU: 0.00%/0.84% (IggyUsage/Total), Mem: 46.92%/116.66 MB/507.27 MB/955.73 MB (Free/IggyUsage/TotalUsed/Total), Clients: 3, Messages: 1k, Read: 3.23 MB, Written: 618.50 KB, OpenFDs: 196
Mar 16 12:51:04 ip-10-0-0-116 iggy-server[1482]: 2026-03-16T12:51:04.093861Z  INFO shard-0 server::shard::tasks::periodic::message_saver: Flushed 1 partitions.
systemctl status iggy-connectors.service
● iggy-connectors.service - Iggy Connectors Runtime
     Loaded: loaded (/etc/systemd/system/iggy-connectors.service; disabled; preset: enabled)
    Drop-In: /etc/systemd/system/iggy-connectors.service.d
             └─mimalloc.conf
     Active: active (running) since Mon 2026-03-16 12:50:05 UTC; 1min 0s ago
   Main PID: 1513 (iggy-connectors)
      Tasks: 3 (limit: 1013)
     Memory: 16.2M (peak: 16.9M)
        CPU: 281ms
     CGroup: /system.slice/iggy-connectors.service
             └─1513 /opt/connectors/current/iggy-connectors

Mar 16 12:50:05 ip-10-0-0-116 iggy-connectors[1513]: 2026-03-16T12:50:05.691033Z  INFO iggy::tcp::tcp_client: Iggy client: 127.0.0.1:46654 is signing in...
Mar 16 12:50:05 ip-10-0-0-116 iggy-connectors[1513]: 2026-03-16T12:50:05.772718Z  INFO iggy::tcp::tcp_client: Iggy client: 127.0.0.1:46654 has signed in with a personal access token.
Mar 16 12:50:05 ip-10-0-0-116 iggy-connectors[1513]: 2026-03-16T12:50:05.813802Z  INFO iggy_connectors::stream: Using token=PcD*** for Iggy authentication
Mar 16 12:50:05 ip-10-0-0-116 iggy-connectors[1513]: 2026-03-16T12:50:05.813846Z  INFO iggy::tcp::tcp_client: Iggy client is connecting to server: 127.0.0.1:8090...
Mar 16 12:50:05 ip-10-0-0-116 iggy-connectors[1513]: 2026-03-16T12:50:05.819797Z  INFO iggy::tcp::tcp_client: Iggy client: 127.0.0.1:46658 has connected to server: 127.0.0.1:8090 at: 2026-03-16 12:50:05
Mar 16 12:50:05 ip-10-0-0-116 iggy-connectors[1513]: 2026-03-16T12:50:05.819827Z  INFO iggy::tcp::tcp_client: Iggy client: 127.0.0.1:46658 is signing in...
Mar 16 12:50:05 ip-10-0-0-116 iggy-connectors[1513]: 2026-03-16T12:50:05.900642Z  INFO iggy::tcp::tcp_client: Iggy client: 127.0.0.1:46658 has signed in with a personal access token.
Mar 16 12:50:05 ip-10-0-0-116 iggy-connectors[1513]: 2026-03-16T12:50:05.949301Z  INFO iggy_connectors: Found 0 source and 0 sink configurations.
Mar 16 12:50:05 ip-10-0-0-116 iggy-connectors[1513]: 2026-03-16T12:50:05.949397Z  INFO iggy_connectors: All sources and sinks spawned.
Mar 16 12:50:05 ip-10-0-0-116 iggy-connectors[1513]: 2026-03-16T12:50:05.949595Z  INFO iggy_connectors::api: Started iggy-connectors HTTP API on: 127.0.0.1:8081
systemctl status prober.service
● laser-prober.service - LaserData Prober
     Loaded: loaded (/etc/systemd/system/laser-prober.service; enabled; preset: enabled)
     Active: active (running) since Mon 2026-03-16 12:50:15 UTC; 50s ago
    Process: 1516 ExecStartPre=/bin/bash -c for i in $(seq 1 60); do [ -s /etc/warden/credentials/prober.pat ] && [ -s /etc/warden/credentials/prober.env ] && exit 0; echo "Waiting for prober credentials ($i/60)..."; sleep 5; done; echo "FATAL: prober credentials not provisioned after 5 minutes"; exit 1 (code=exited, status=0/SUCCESS)
   Main PID: 1519 (laser-prober)
      Tasks: 3 (limit: 1013)
     Memory: 996.0K (peak: 1.6M)
        CPU: 22ms
     CGroup: /system.slice/laser-prober.service
             └─1519 /opt/prober/current/laser-prober

Mar 16 12:50:05 ip-10-0-0-116 systemd[1]: Failed to start laser-prober.service - LaserData Prober.
Mar 16 12:50:15 ip-10-0-0-116 systemd[1]: laser-prober.service: Scheduled restart job, restart counter is at 1.
Mar 16 12:50:15 ip-10-0-0-116 systemd[1]: Starting laser-prober.service - LaserData Prober...
Mar 16 12:50:15 ip-10-0-0-116 systemd[1]: Started laser-prober.service - LaserData Prober.
Service restart history (last 24h)
warden.service: 6 start/stop events in last 24h
iggy-server.service: 2 start/stop events in last 24h
iggy-connectors.service: 2 start/stop events in last 24h
laser-prober.service: 2 start/stop events in last 24h

=== Recent service state changes ===
Mar 16 12:50:02 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:02.537212Z  INFO laser_warden::api: Started Warden internal API on: 127.0.0.1:5000
Mar 16 12:50:02 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:02.537527Z  INFO laser_warden::api: Started Warden HTTPS API on: 0.0.0.0:443
Mar 16 12:50:02 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:02.537529Z  INFO laser_warden::api: Started HTTP->HTTPS redirect server on: 0.0.0.0:80
Mar 16 12:50:02 ip-10-0-0-116 systemd[1]: Started warden.service - LaserData Warden.
Mar 16 12:50:02 ip-10-0-0-116 systemd[1]: laser-prober.service: Failed to load environment files: No such file or directory
Mar 16 12:50:02 ip-10-0-0-116 systemd[1]: laser-prober.service: Failed to spawn 'start-pre' task: No such file or directory
Mar 16 12:50:02 ip-10-0-0-116 systemd[1]: laser-prober.service: Failed with result 'resources'.
Mar 16 12:50:02 ip-10-0-0-116 systemd[1]: Failed to start laser-prober.service - LaserData Prober.
Mar 16 12:50:02 ip-10-0-0-116 systemd[1]: Started iggy-server.service - Iggy Server.
Mar 16 12:50:04 ip-10-0-0-116 iggy-server[1482]: 2026-03-16T12:50:04.074687Z  INFO shard-0 server::http::http_server: Started HTTP API on: 127.0.0.1:3000
Mar 16 12:50:04 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:04.572173Z  INFO laser_warden::journal: Started HTTP API on: 127.0.0.1:3000 runtime_type="iggy" runtime_version="0.7.2-edge.1" runtime_log_level="INFO" runtime_log_module="server::http::http_server" runtime_log_thread=0 runtime_log_timestamp=1773665404074687
Mar 16 12:50:05 ip-10-0-0-116 systemd[1]: Stopped laser-prober.service - LaserData Prober.
Mar 16 12:50:05 ip-10-0-0-116 systemd[1]: laser-prober.service: Failed to load environment files: No such file or directory
Mar 16 12:50:05 ip-10-0-0-116 systemd[1]: laser-prober.service: Failed to spawn 'start-pre' task: No such file or directory
Mar 16 12:50:05 ip-10-0-0-116 systemd[1]: laser-prober.service: Failed with result 'resources'.
Mar 16 12:50:05 ip-10-0-0-116 systemd[1]: Failed to start laser-prober.service - LaserData Prober.
Mar 16 12:50:05 ip-10-0-0-116 systemd[1]: Started iggy-connectors.service - Iggy Connectors Runtime.
Mar 16 12:50:05 ip-10-0-0-116 iggy-connectors[1513]: 2026-03-16T12:50:05.949595Z  INFO iggy_connectors::api: Started iggy-connectors HTTP API on: 127.0.0.1:8081
Mar 16 12:50:06 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:06.273592Z  INFO laser_warden::journal: Started iggy-connectors HTTP API on: 127.0.0.1:8081 runtime_type="connectors" runtime_version="0.3.2-edge.1" runtime_log_level="INFO" runtime_log_module="iggy_connectors::api" runtime_log_thread=0 runtime_log_timestamp=1773665405949595
Mar 16 12:50:15 ip-10-0-0-116 systemd[1]: Started laser-prober.service - LaserData Prober.
Systemd timers
NEXT                                 LEFT LAST                             PASSED UNIT                           ACTIVATES
Mon 2026-03-16 12:54:21 UTC      3min 15s -                                     - update-notifier-download.timer update-notifier-download.service
Mon 2026-03-16 13:00:00 UTC          8min Mon 2026-03-16 12:50:00 UTC 1min 6s ago sysstat-collect.timer          sysstat-collect.service
Mon 2026-03-16 13:04:16 UTC         13min -                                     - systemd-tmpfiles-clean.timer   systemd-tmpfiles-clean.service
Mon 2026-03-16 13:19:58 UTC         28min Mon 2026-03-16 11:42:23 UTC           - fwupd-refresh.timer            fwupd-refresh.service
Mon 2026-03-16 18:17:29 UTC      5h 26min Mon 2026-03-16 11:42:23 UTC           - motd-news.timer                motd-news.service
Tue 2026-03-17 00:00:00 UTC           11h Mon 2026-03-16 11:42:23 UTC           - dpkg-db-backup.timer           dpkg-db-backup.service
Tue 2026-03-17 00:00:00 UTC           11h Mon 2026-03-16 11:42:23 UTC           - logrotate.timer                logrotate.service
Tue 2026-03-17 00:07:00 UTC           11h -                                     - sysstat-summary.timer          sysstat-summary.service
Tue 2026-03-17 00:39:49 UTC           11h Mon 2026-03-16 11:42:23 UTC           - man-db.timer                   man-db.service
Tue 2026-03-17 05:32:24 UTC           16h Mon 2026-03-16 11:42:23 UTC           - apt-daily.timer                apt-daily.service
Tue 2026-03-17 06:12:32 UTC           17h Mon 2026-03-16 11:42:23 UTC           - apt-daily-upgrade.timer        apt-daily-upgrade.service
Sun 2026-03-22 03:10:45 UTC        5 days Mon 2026-03-16 11:42:23 UTC           - e2scrub_all.timer              e2scrub_all.service
Mon 2026-03-23 00:11:24 UTC        6 days Mon 2026-03-16 11:42:23 UTC           - fstrim.timer                   fstrim.service
Mon 2026-03-23 22:22:26 UTC 1 week 0 days Mon 2026-03-16 11:42:23 UTC           - update-notifier-motd.timer     update-notifier-motd.service
-                                       - -                                     - apport-autoreport.timer        apport-autoreport.service
-                                       - -                                     - snapd.snap-repair.timer        snapd.snap-repair.service
-                                       - -                                     - ua-timer.timer                 ua-timer.service

17 timers listed.

Warden Logs2 entries

journalctl -u warden (last 2000 lines)
Mar 16 12:50:01 ip-10-0-0-116 systemd[1]: Starting warden.service - LaserData Warden...
Mar 16 12:50:01 ip-10-0-0-116 laser-warden[1409]: Loaded environment variables from path: /etc/warden/warden.env
Mar 16 12:50:01 ip-10-0-0-116 laser-warden[1409]: Bootstrap env detected at /etc/warden/warden.env, fetching full config from backend...
Mar 16 12:50:01 ip-10-0-0-116 laser-warden[1409]: Fetching the primary config for node ID: 610918396883632646, kind: warden:610918396883632646...
Mar 16 12:50:01 ip-10-0-0-116 laser-warden[1409]: Fetched primary config for node ID: 610918396883632646, kind: warden:610918396883632646.
Mar 16 12:50:01 ip-10-0-0-116 laser-warden[1409]: Saved full config to: /etc/warden/warden.env
Mar 16 12:50:01 ip-10-0-0-116 laser-warden[1409]: Loading config for: 'warden' from defaults with env overrides...
Mar 16 12:50:01 ip-10-0-0-116 laser-warden[1409]: LD_API value changed to: https://us.aws.supervisor.laserdata.cloud from env
Mar 16 12:50:01 ip-10-0-0-116 laser-warden[1409]: LD_SECRET value changed to: eyJ*** from env
Mar 16 12:50:01 ip-10-0-0-116 laser-warden[1409]: LD_CPU_TARGET value changed to: amd64-skylake from env
Mar 16 12:50:01 ip-10-0-0-116 laser-warden[1409]: LD_CERTIFICATES_LASERDATA_DIR value changed to: /etc/laserdata/certs from env
Mar 16 12:50:01 ip-10-0-0-116 laser-warden[1409]: LD_CERTIFICATES_LETS_ENCRYPT_DIR value changed to: /etc/letsencrypt/live/warden from env
Mar 16 12:50:01 ip-10-0-0-116 laser-warden[1409]: LD_CERTIFICATES_LETS_ENCRYPT_ENABLED value changed to: true from env
Mar 16 12:50:01 ip-10-0-0-116 laser-warden[1409]: LD_CERTIFICATES_SIGNING_PUBKEY_PATH value changed to: /etc/laserdata/laserdata.pub from env
Mar 16 12:50:01 ip-10-0-0-116 laser-warden[1409]: LD_CREDENTIALS_DIR value changed to: /et*** from env
Mar 16 12:50:01 ip-10-0-0-116 laser-warden[1409]: LD_DIRECTORY value changed to: /opt/warden from env
Mar 16 12:50:01 ip-10-0-0-116 laser-warden[1409]: LD_HEARTBEATS_INTERVAL value changed to: 5s from env
Mar 16 12:50:01 ip-10-0-0-116 laser-warden[1409]: LD_HTTP_CORS_ALLOWED_HEADERS value changed to: [content-type,authorization] from env
Mar 16 12:50:01 ip-10-0-0-116 laser-warden[1409]: LD_HTTP_CORS_ALLOWED_METHODS value changed to: [GET,POST,PUT,DELETE] from env
Mar 16 12:50:01 ip-10-0-0-116 laser-warden[1409]: LD_HTTP_CORS_ALLOWED_ORIGINS value changed to: [*] from env
Mar 16 12:50:01 ip-10-0-0-116 laser-warden[1409]: LD_HTTP_CORS_ALLOW_CREDENTIALS value changed to: *** from env
Mar 16 12:50:01 ip-10-0-0-116 laser-warden[1409]: LD_HTTP_CORS_ALLOW_PRIVATE_NETWORK value changed to: false from env
Mar 16 12:50:01 ip-10-0-0-116 laser-warden[1409]: LD_HTTP_CORS_ENABLED value changed to: false from env
Mar 16 12:50:01 ip-10-0-0-116 laser-warden[1409]: LD_HTTP_CORS_EXPOSED_HEADERS value changed to: [] from env
Mar 16 12:50:01 ip-10-0-0-116 laser-warden[1409]: LD_HTTP_INTERNAL_ADDRESS value changed to: 127.0.0.1:5000 from env
Mar 16 12:50:01 ip-10-0-0-116 laser-warden[1409]: LD_HTTP_PUBLIC_ADDRESS value changed to: 0.0.0.0:80 from env
Mar 16 12:50:01 ip-10-0-0-116 laser-warden[1409]: LD_HTTP_TLS_CERT_FILE value changed to: /etc/letsencrypt/live/warden/fullchain.pem from env
Mar 16 12:50:01 ip-10-0-0-116 laser-warden[1409]: LD_HTTP_TLS_ENABLED value changed to: true from env
Mar 16 12:50:01 ip-10-0-0-116 laser-warden[1409]: LD_HTTP_TLS_KEY_FILE value changed to: /etc/letsencrypt/live/warden/privkey.pem from env
Mar 16 12:50:01 ip-10-0-0-116 laser-warden[1409]: LD_KEY_ID value changed to: las*** from env
Mar 16 12:50:01 ip-10-0-0-116 laser-warden[1409]: LD_KEY_VALUE value changed to: 0xbaed9ef2e7a1dbff50799cc5e9a087b1b505991f674d2e74c6feb967c1311541 from env
Mar 16 12:50:01 ip-10-0-0-116 laser-warden[1409]: LD_METRICS_INTERVAL value changed to: 5s from env
Mar 16 12:50:01 ip-10-0-0-116 laser-warden[1409]: LD_RELEASES_URL value changed to: https://artifacts.laserdata.com from env
Mar 16 12:50:01 ip-10-0-0-116 laser-warden[1409]: LD_RUNTIMES_CONNECTORS_DIRECTORY value changed to: /opt/connectors from env
Mar 16 12:50:01 ip-10-0-0-116 laser-warden[1409]: LD_RUNTIMES_CONNECTORS_ENABLED value changed to: true from env
Mar 16 12:50:01 ip-10-0-0-116 laser-warden[1409]: LD_RUNTIMES_IGGY_API_URL value changed to: http://localhost:3000 from env
Mar 16 12:50:01 ip-10-0-0-116 laser-warden[1409]: LD_RUNTIMES_IGGY_CLUSTER value changed to: standalone from env
Mar 16 12:50:01 ip-10-0-0-116 laser-warden[1409]: LD_RUNTIMES_IGGY_DIRECTORY value changed to: /opt/iggy from env
Mar 16 12:50:01 ip-10-0-0-116 laser-warden[1409]: LD_RUNTIMES_IGGY_ENABLED value changed to: true from env
Mar 16 12:50:01 ip-10-0-0-116 laser-warden[1409]: LD_TASK_PATH value changed to: /etc/warden/task.toml from env
Mar 16 12:50:01 ip-10-0-0-116 laser-warden[1409]: LD_TELEMETRY_BATCH_MAX_EXPORT_SIZE value changed to: 1024 from env
Mar 16 12:50:01 ip-10-0-0-116 laser-warden[1409]: LD_TELEMETRY_BATCH_MAX_QUEUE_SIZE value changed to: 4096 from env
Mar 16 12:50:01 ip-10-0-0-116 laser-warden[1409]: LD_TELEMETRY_BATCH_SCHEDULED_DELAY value changed to: 5s from env
Mar 16 12:50:01 ip-10-0-0-116 laser-warden[1409]: LD_TELEMETRY_LOGS_COMPRESSION value changed to: zstd from env
Mar 16 12:50:01 ip-10-0-0-116 laser-warden[1409]: LD_TELEMETRY_LOGS_ENABLED value changed to: true from env
Mar 16 12:50:01 ip-10-0-0-116 laser-warden[1409]: LD_TELEMETRY_LOGS_ENDPOINT value changed to: https://us.aws.supervisor.laserdata.cloud/warden/logs from env
Mar 16 12:50:01 ip-10-0-0-116 laser-warden[1409]: LD_TELEMETRY_LOGS_RUNTIMES value changed to: [iggy,connectors] from env
Mar 16 12:50:01 ip-10-0-0-116 laser-warden[1409]: LD_TELEMETRY_LOGS_TRANSPORT value changed to: http from env
Mar 16 12:50:01 ip-10-0-0-116 laser-warden[1409]: LD_TELEMETRY_TRACES_COMPRESSION value changed to: zstd from env
Mar 16 12:50:01 ip-10-0-0-116 laser-warden[1409]: LD_TELEMETRY_TRACES_ENABLED value changed to: false from env
Mar 16 12:50:01 ip-10-0-0-116 laser-warden[1409]: LD_TELEMETRY_TRACES_ENDPOINT value changed to:  from env
Mar 16 12:50:01 ip-10-0-0-116 laser-warden[1409]: LD_TELEMETRY_TRACES_TRANSPORT value changed to: http from env
Mar 16 12:50:01 ip-10-0-0-116 laser-warden[1409]: Config loaded for: 'warden'
Mar 16 12:50:01 ip-10-0-0-116 laser-warden[1409]: Initializing telemetry (logs: true, traces: false)
Mar 16 12:50:01 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:01.769465Z  INFO laser_warden: Warden for node ID: 610918396883632646, is starting using API: https://us.aws.supervisor.laserdata.cloud, secret=eyJ*** telemetry: logs=true, traces=false
Mar 16 12:50:01 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:01.769535Z  INFO laser_warden::certs: Force bootstrap enabled, refreshing all certificates
Mar 16 12:50:01 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:01.769542Z  INFO laser_warden::certs: Fetching laserdata certificates
Mar 16 12:50:01 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:01.769550Z  INFO laser_warden::certs: Fetching certificate: /warden/certs/laserdata/key
Mar 16 12:50:01 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:01.832256Z  INFO laser_warden::certs: Fetching certificate: /warden/certs/laserdata/fullchain
Mar 16 12:50:01 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:01.903598Z  INFO laser_warden::certs: Written certificates to: /etc/laserdata/certs/server.key, /etc/laserdata/certs/server-fullchain.crt
Mar 16 12:50:01 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:01.903673Z  INFO laser_warden::certs: laserdata certificates written to /etc/laserdata/certs
Mar 16 12:50:01 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:01.903688Z  INFO laser_warden::certs: Fetching root CA certificate from https://artifacts.laserdata.com/keys/laserdata.crt
Mar 16 12:50:02 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:02.224468Z  INFO laser_warden::certs: Root CA certificate is unchanged, skipping write
Mar 16 12:50:02 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:02.224539Z  INFO laser_warden::certs: Fetching lets_encrypt certificates
Mar 16 12:50:02 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:02.224549Z  INFO laser_warden::certs: Fetching certificate: /warden/certs/lets_encrypt/key
Mar 16 12:50:02 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:02.362583Z  INFO laser_warden::certs: Fetching certificate: /warden/certs/lets_encrypt/fullchain
Mar 16 12:50:02 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:02.453459Z  INFO laser_warden::certs: Written certificates to: /etc/letsencrypt/live/warden/privkey.pem, /etc/letsencrypt/live/warden/fullchain.pem
Mar 16 12:50:02 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:02.453514Z  INFO laser_warden::certs: lets_encrypt certificates written to /etc/letsencrypt/live/warden
Mar 16 12:50:02 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:02.453525Z  INFO laser_warden::certs: Certificate bootstrap completed
Mar 16 12:50:02 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:02.453705Z  INFO laser_warden::signature: Loaded signing public key from /etc/laserdata/laserdata.pub, key ID: 9871894D32566207
Mar 16 12:50:02 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:02.453782Z  INFO laser_warden::context: Initializing task verifier - config.key.value empty: false, config.api: https://us.aws.supervisor.laserdata.cloud, config.key.id: laserdata_20260101
Mar 16 12:50:02 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:02.453831Z  INFO laser_warden::context: Initialized task verifier from config with key ID: laserdata_20260101
Mar 16 12:50:02 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:02.453911Z  INFO laser_warden::config: Fetching all connector configs for node ID: 610918396883632646...
Mar 16 12:50:02 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:02.536661Z  INFO laser_warden::config: Fetched all connector configs for node ID: 610918396883632646.
Mar 16 12:50:02 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:02.536732Z  INFO laser_warden::connectors::store: Successfully loaded connector configs: 0 sinks, 0 sources
Mar 16 12:50:02 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:02.536929Z  INFO laser_warden::context: Detected Iggy version: 0.7.2-edge.1 from symlink
Mar 16 12:50:02 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:02.536980Z  INFO laser_warden::context: Detected Connectors runtime version: 0.3.2-edge.1 from symlink
Mar 16 12:50:02 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:02.537212Z  INFO laser_warden::api: Started Warden internal API on: 127.0.0.1:5000
Mar 16 12:50:02 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:02.537527Z  INFO laser_warden::api: Started Warden HTTPS API on: 0.0.0.0:443
Mar 16 12:50:02 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:02.537529Z  INFO laser_warden::api: Started HTTP->HTTPS redirect server on: 0.0.0.0:80
Mar 16 12:50:02 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:02.539747Z  INFO laser_warden: Iggy runtime is enabled (cluster: standalone, version: 0.7.2-edge.1)
Mar 16 12:50:02 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:02.539773Z  INFO laser_warden: Connectors runtime is enabled (version: 0.3.2-edge.1)
Mar 16 12:50:02 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:02.539818Z  INFO laser_warden: Starting 2 runtime(s)
Mar 16 12:50:02 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:02.540124Z  INFO laser_warden::runtime::runner: Initializing ServiceRunner (policy=standalone, unit=iggy-server.service)
Mar 16 12:50:02 ip-10-0-0-116 systemd[1]: Started warden.service - LaserData Warden.
Mar 16 12:50:02 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:02.552986Z  INFO laser_warden::runtime::runner: Starting iggy-server.service...
Mar 16 12:50:02 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:02.553507Z  INFO laser_warden::config: Fetching the Iggy config file...
Mar 16 12:50:02 ip-10-0-0-116 laser-warden[1409]: Fetching the primary config for node ID: 610918396883632646, kind: iggy...
Mar 16 12:50:02 ip-10-0-0-116 laser-warden[1409]: Fetched primary config for node ID: 610918396883632646, kind: iggy.
Mar 16 12:50:02 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:02.624503Z  INFO laser_warden::config: Created Iggy config file: /opt/iggy/server-0.7.2-edge.1/iggy.env
Mar 16 12:50:02 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:02.801445Z  INFO laser_warden::runtime::runner: Journal reader started for: iggy
Mar 16 12:50:02 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:02.801558Z  INFO laser_warden::journal: Journal reader started for unit: iggy-server.service
Mar 16 12:50:02 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:02.801683Z  INFO laser_warden::systemd: Starting systemd unit: iggy-server.service
Mar 16 12:50:02 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:02.866223Z  INFO laser_warden::runtime::runner: ServiceRunner initialized (policy=standalone)
Mar 16 12:50:02 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:02.866628Z  INFO laser_warden::runtime::runner: Initializing ServiceRunner (policy=standalone, unit=iggy-connectors.service)
Mar 16 12:50:02 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:02.882306Z  INFO laser_warden::runtime::runner: ServiceRunner initialized (policy=standalone)
Mar 16 12:50:02 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:02.882691Z  INFO laser_warden::tasks: No existing task found on disk for node ID: 610918396883632646
Mar 16 12:50:02 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:02.882816Z  INFO laser_warden::tasks: Fetching tasks for node ID: 610918396883632646...
Mar 16 12:50:02 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:02.914433Z  INFO laser_warden::tasks: Fetched tasks for node ID: 610918396883632646.
Mar 16 12:50:02 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:02.943584Z  INFO laser_warden::runtime::runner: iggy-server.service is now active
Mar 16 12:50:02 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:02.944133Z  INFO laser_warden::iggy::service: Iggy on_active starting - will provision users
Mar 16 12:50:02 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:02.944409Z  INFO laser_warden::config: Config file already exists: /opt/iggy/server-0.7.2-edge.1/iggy.env
Mar 16 12:50:03 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:03.110234Z  INFO laser_warden::journal:   ___                             ____ runtime_type="iggy" runtime_version="0.7.2-edge.1" runtime_log_level="INFO" runtime_log_module="" runtime_log_thread=0
Mar 16 12:50:03 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:03.110310Z  INFO laser_warden::journal:  |_ _|   __ _    __ _   _   _    / ___|    ___   _ __  __   __   ___   _ __ runtime_type="iggy" runtime_version="0.7.2-edge.1" runtime_log_level="INFO" runtime_log_module="" runtime_log_thread=0
Mar 16 12:50:03 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:03.110355Z  INFO laser_warden::journal:   | |   / _` |  / _` | | | | |   \___ \   / _ \ | '__| \ \ / /  / _ \ | '__| runtime_type="iggy" runtime_version="0.7.2-edge.1" runtime_log_level="INFO" runtime_log_module="" runtime_log_thread=0
Mar 16 12:50:03 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:03.110388Z  INFO laser_warden::journal:   | |  | (_| | | (_| | | |_| |    ___) | |  __/ | |     \ V /  |  __/ | | runtime_type="iggy" runtime_version="0.7.2-edge.1" runtime_log_level="INFO" runtime_log_module="" runtime_log_thread=0
Mar 16 12:50:03 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:03.110419Z  INFO laser_warden::journal:  |___|  \__, |  \__, |  \__, |   |____/   \___| |_|      \_/    \___| |_| runtime_type="iggy" runtime_version="0.7.2-edge.1" runtime_log_level="INFO" runtime_log_module="" runtime_log_thread=0
Mar 16 12:50:03 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:03.110453Z  INFO laser_warden::journal:         |___/   |___/   |___/ runtime_type="iggy" runtime_version="0.7.2-edge.1" runtime_log_level="INFO" runtime_log_module="" runtime_log_thread=0
Mar 16 12:50:03 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:03.111566Z  INFO laser_warden::journal: It seems that you are a developer. Environment variable IGGY_CI_BUILD is not set to 'true', skipping build info print. runtime_type="iggy" runtime_version="0.7.2-edge.1" runtime_log_level="INFO" runtime_log_module="server::log::logger" runtime_log_thread=0 runtime_log_timestamp=1773665402886270
Mar 16 12:50:03 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:03.111636Z  INFO laser_warden::journal: Loading config from path: 'core/server/config.toml'... runtime_type="iggy" runtime_version="0.7.2-edge.1" runtime_log_level="INFO" runtime_log_module="configs::configs_impl::file_provider" runtime_log_thread=0 runtime_log_timestamp=1773665402886464
Mar 16 12:50:03 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:03.111687Z  INFO laser_warden::journal: Configuration file not found at path: 'core/server/config.toml'. runtime_type="iggy" runtime_version="0.7.2-edge.1" runtime_log_level="WARN" runtime_log_module="configs::configs_impl::file_provider" runtime_log_thread=0 runtime_log_timestamp=1773665402886853
Mar 16 12:50:03 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:03.111735Z  INFO laser_warden::journal: Using default configuration embedded into server, as no config file was found. runtime_type="iggy" runtime_version="0.7.2-edge.1" runtime_log_level="INFO" runtime_log_module="configs::configs_impl::file_provider" runtime_log_thread=0 runtime_log_timestamp=1773665402886860
Mar 16 12:50:03 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:03.111786Z  INFO laser_warden::journal: Unknown environment variable 'IGGY_ENCRYPTION_ENABLED' will be ignored. Similar variables: IGGY_SYSTEM_ENCRYPTION_ENABLED? runtime_type="iggy" runtime_version="0.7.2-edge.1" runtime_log_level="WARN" runtime_log_module="configs::configs_impl::typed_env_provider" runtime_log_thread=0 runtime_log_timestamp=1773665402888524
Mar 16 12:50:03 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:03.111834Z  INFO laser_warden::journal: Unknown environment variable 'IGGY_ENCRYPTION_KEY' will be ignored. Similar variables: IGGY_SYSTEM_ENCRYPTION_KEY? runtime_type="iggy" runtime_version="0.7.2-edge.1" runtime_log_level="WARN" runtime_log_module="configs::configs_impl::typed_env_provider" runtime_log_thread=0 runtime_log_timestamp=1773665402889459
Mar 16 12:50:03 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:03.111881Z  INFO laser_warden::journal: IGGY_CONSUMER_GROUP_REBALANCING_TIMEOUT value changed to: 30 s from environment variable runtime_type="iggy" runtime_version="0.7.2-edge.1" runtime_log_level="INFO" runtime_log_module="configs::configs_impl::typed_env_provider" runtime_log_thread=0 runtime_log_timestamp=1773665402889511
Mar 16 12:50:03 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:03.111937Z  INFO laser_warden::journal: IGGY_CONSUMER_GROUP_REBALANCING_CHECK_INTERVAL value changed to: 5 s from environment variable runtime_type="iggy" runtime_version="0.7.2-edge.1" runtime_log_level="INFO" runtime_log_module="configs::configs_impl::typed_env_provider" runtime_log_thread=0 runtime_log_timestamp=1773665402889528
Mar 16 12:50:03 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:03.111985Z  INFO laser_warden::journal: IGGY_DATA_MAINTENANCE_MESSAGES_CLEANER_ENABLED value changed to: true from environment variable runtime_type="iggy" runtime_version="0.7.2-edge.1" runtime_log_level="INFO" runtime_log_module="configs::configs_impl::typed_env_provider" runtime_log_thread=0 runtime_log_timestamp=1773665402889537
Mar 16 12:50:03 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:03.112033Z  INFO laser_warden::journal: IGGY_DATA_MAINTENANCE_MESSAGES_INTERVAL value changed to: 1 m from environment variable runtime_type="iggy" runtime_version="0.7.2-edge.1" runtime_log_level="INFO" runtime_log_module="configs::configs_impl::typed_env_provider" runtime_log_thread=0 runtime_log_timestamp=1773665402889544
Mar 16 12:50:03 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:03.112080Z  INFO laser_warden::journal: IGGY_MESSAGE_SAVER_ENABLED value changed to: true from environment variable runtime_type="iggy" runtime_version="0.7.2-edge.1" runtime_log_level="INFO" runtime_log_module="configs::configs_impl::typed_env_provider" runtime_log_thread=0 runtime_log_timestamp=1773665402889550
Mar 16 12:50:03 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:03.112132Z  INFO laser_warden::journal: IGGY_MESSAGE_SAVER_ENFORCE_FSYNC value changed to: true from environment variable runtime_type="iggy" runtime_version="0.7.2-edge.1" runtime_log_level="INFO" runtime_log_module="configs::configs_impl::typed_env_provider" runtime_log_thread=0 runtime_log_timestamp=1773665402889557
Mar 16 12:50:03 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:03.112178Z  INFO laser_warden::journal: IGGY_MESSAGE_SAVER_INTERVAL value changed to: 30 s from environment variable runtime_type="iggy" runtime_version="0.7.2-edge.1" runtime_log_level="INFO" runtime_log_module="configs::configs_impl::typed_env_provider" runtime_log_thread=0 runtime_log_timestamp=1773665402889564
Mar 16 12:50:03 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:03.112224Z  INFO laser_warden::journal: IGGY_PERSONAL_ACCESS_TOKEN_MAX_TOKENS_PER_USER value changed to: 100 from environment variable runtime_type="iggy" runtime_version="0.7.2-edge.1" runtime_log_level="INFO" runtime_log_module="configs::configs_impl::typed_env_provider" runtime_log_thread=0 runtime_log_timestamp=1773665402889571
Mar 16 12:50:03 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:03.112290Z  INFO laser_warden::journal: IGGY_PERSONAL_ACCESS_TOKEN_CLEANER_ENABLED value changed to: true from environment variable runtime_type="iggy" runtime_version="0.7.2-edge.1" runtime_log_level="INFO" runtime_log_module="configs::configs_impl::typed_env_provider" runtime_log_thread=0 runtime_log_timestamp=1773665402889579
Mar 16 12:50:03 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:03.112338Z  INFO laser_warden::journal: IGGY_PERSONAL_ACCESS_TOKEN_CLEANER_INTERVAL value changed to: 1 m from environment variable runtime_type="iggy" runtime_version="0.7.2-edge.1" runtime_log_level="INFO" runtime_log_module="configs::configs_impl::typed_env_provider" runtime_log_thread=0 runtime_log_timestamp=1773665402889586
Mar 16 12:50:03 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:03.112386Z  INFO laser_warden::journal: IGGY_HEARTBEAT_ENABLED value changed to: false from environment variable runtime_type="iggy" runtime_version="0.7.2-edge.1" runtime_log_level="INFO" runtime_log_module="configs::configs_impl::typed_env_provider" runtime_log_thread=0 runtime_log_timestamp=1773665402889592
Mar 16 12:50:03 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:03.112417Z  INFO laser_warden::journal: IGGY_HEARTBEAT_INTERVAL value changed to: 5 s from environment variable runtime_type="iggy" runtime_version="0.7.2-edge.1" runtime_log_level="INFO" runtime_log_module="configs::configs_impl::typed_env_provider" runtime_log_thread=0 runtime_log_timestamp=1773665402889599
Mar 16 12:50:03 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:03.112447Z  INFO laser_warden::journal: IGGY_SYSTEM_PATH value changed to: local_data from environment variable runtime_type="iggy" runtime_version="0.7.2-edge.1" runtime_log_level="INFO" runtime_log_module="configs::configs_impl::typed_env_provider" runtime_log_thread=0 runtime_log_timestamp=1773665402889606
Mar 16 12:50:03 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:03.112476Z  INFO laser_warden::journal: IGGY_SYSTEM_BACKUP_PATH value changed to: backup from environment variable runtime_type="iggy" runtime_version="0.7.2-edge.1" runtime_log_level="INFO" runtime_log_module="configs::configs_impl::typed_env_provider" runtime_log_thread=0 runtime_log_timestamp=1773665402889613
Mar 16 12:50:03 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:03.112540Z  INFO laser_warden::journal: IGGY_SYSTEM_BACKUP_COMPATIBILITY_PATH value changed to: compatibility from environment variable runtime_type="iggy" runtime_version="0.7.2-edge.1" runtime_log_level="INFO" runtime_log_module="configs::configs_impl::typed_env_provider" runtime_log_thread=0 runtime_log_timestamp=1773665402889621
Mar 16 12:50:03 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:03.112588Z  INFO laser_warden::journal: IGGY_SYSTEM_STATE_ENFORCE_FSYNC value changed to: true from environment variable runtime_type="iggy" runtime_version="0.7.2-edge.1" runtime_log_level="INFO" runtime_log_module="configs::configs_impl::typed_env_provider" runtime_log_thread=0 runtime_log_timestamp=1773665402889630
Mar 16 12:50:03 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:03.112638Z  INFO laser_warden::journal: IGGY_SYSTEM_STATE_MAX_FILE_OPERATION_RETRIES value changed to: 1 from environment variable runtime_type="iggy" runtime_version="0.7.2-edge.1" runtime_log_level="INFO" runtime_log_module="configs::configs_impl::typed_env_provider" runtime_log_thread=0 runtime_log_timestamp=1773665402889638
Mar 16 12:50:03 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:03.112689Z  INFO laser_warden::journal: IGGY_SYSTEM_STATE_RETRY_DELAY value changed to: 1 s from environment variable runtime_type="iggy" runtime_version="0.7.2-edge.1" runtime_log_level="INFO" runtime_log_module="configs::configs_impl::typed_env_provider" runtime_log_thread=0 runtime_log_timestamp=1773665402889645
Mar 16 12:50:03 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:03.112736Z  INFO laser_warden::journal: IGGY_SYSTEM_RUNTIME_PATH value changed to: runtime from environment variable runtime_type="iggy" runtime_version="0.7.2-edge.1" runtime_log_level="INFO" runtime_log_module="configs::configs_impl::typed_env_provider" runtime_log_thread=0 runtime_log_timestamp=1773665402889652
Mar 16 12:50:03 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:03.112784Z  INFO laser_warden::journal: IGGY_SYSTEM_LOGGING_PATH value changed to: logs from environment variable runtime_type="iggy" runtime_version="0.7.2-edge.1" runtime_log_level="INFO" runtime_log_module="configs::configs_impl::typed_env_provider" runtime_log_thread=0 runtime_log_timestamp=1773665402889659
Mar 16 12:50:03 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:03.112831Z  INFO laser_warden::journal: IGGY_SYSTEM_LOGGING_LEVEL value changed to: info from environment variable runtime_type="iggy" runtime_version="0.7.2-edge.1" runtime_log_level="INFO" runtime_log_module="configs::configs_impl::typed_env_provider" runtime_log_thread=0 runtime_log_timestamp=1773665402889666
Mar 16 12:50:03 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:03.112876Z  INFO laser_warden::journal: IGGY_SYSTEM_LOGGING_FILE_ENABLED value changed to: true from environment variable runtime_type="iggy" runtime_version="0.7.2-edge.1" runtime_log_level="INFO" runtime_log_module="configs::configs_impl::typed_env_provider" runtime_log_thread=0 runtime_log_timestamp=1773665402889673
Mar 16 12:50:03 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:03.112924Z  INFO laser_warden::journal: IGGY_SYSTEM_LOGGING_MAX_FILE_SIZE value changed to: 20 MB from environment variable runtime_type="iggy" runtime_version="0.7.2-edge.1" runtime_log_level="INFO" runtime_log_module="configs::configs_impl::typed_env_provider" runtime_log_thread=0 runtime_log_timestamp=1773665402889681
Mar 16 12:50:03 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:03.112974Z  INFO laser_warden::journal: IGGY_SYSTEM_LOGGING_MAX_TOTAL_SIZE value changed to: 100 MB from environment variable runtime_type="iggy" runtime_version="0.7.2-edge.1" runtime_log_level="INFO" runtime_log_module="configs::configs_impl::typed_env_provider" runtime_log_thread=0 runtime_log_timestamp=1773665402889688
Mar 16 12:50:03 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:03.113028Z  INFO laser_warden::journal: IGGY_SYSTEM_LOGGING_ROTATION_CHECK_INTERVAL value changed to: 1 h from environment variable runtime_type="iggy" runtime_version="0.7.2-edge.1" runtime_log_level="INFO" runtime_log_module="configs::configs_impl::typed_env_provider" runtime_log_thread=0 runtime_log_timestamp=1773665402889696
Mar 16 12:50:03 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:03.113080Z  INFO laser_warden::journal: IGGY_SYSTEM_LOGGING_RETENTION value changed to: 7 days from environment variable runtime_type="iggy" runtime_version="0.7.2-edge.1" runtime_log_level="INFO" runtime_log_module="configs::configs_impl::typed_env_provider" runtime_log_thread=0 runtime_log_timestamp=1773665402889704
Mar 16 12:50:03 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:03.113128Z  INFO laser_warden::journal: IGGY_SYSTEM_LOGGING_SYSINFO_PRINT_INTERVAL value changed to: 10 s from environment variable runtime_type="iggy" runtime_version="0.7.2-edge.1" runtime_log_level="INFO" runtime_log_module="configs::configs_impl::typed_env_provider" runtime_log_thread=0 runtime_log_timestamp=1773665402889711
Mar 16 12:50:03 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:03.113185Z  INFO laser_warden::journal: IGGY_SYSTEM_STREAM_PATH value changed to: streams from environment variable runtime_type="iggy" runtime_version="0.7.2-edge.1" runtime_log_level="INFO" runtime_log_module="configs::configs_impl::typed_env_provider" runtime_log_thread=0 runtime_log_timestamp=1773665402889719
Mar 16 12:50:03 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:03.113238Z  INFO laser_warden::journal: IGGY_SYSTEM_TOPIC_PATH value changed to: topics from environment variable runtime_type="iggy" runtime_version="0.7.2-edge.1" runtime_log_level="INFO" runtime_log_module="configs::configs_impl::typed_env_provider" runtime_log_thread=0 runtime_log_timestamp=1773665402889726
Mar 16 12:50:03 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:03.113296Z  INFO laser_warden::journal: IGGY_SYSTEM_TOPIC_MAX_SIZE value changed to: unlimited from environment variable runtime_type="iggy" runtime_version="0.7.2-edge.1" runtime_log_level="INFO" runtime_log_module="configs::configs_impl::typed_env_provider" runtime_log_thread=0 runtime_log_timestamp=1773665402889734
Mar 16 12:50:03 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:03.113345Z  INFO laser_warden::journal: IGGY_SYSTEM_TOPIC_MESSAGE_EXPIRY value changed to: none from environment variable runtime_type="iggy" runtime_version="0.7.2-edge.1" runtime_log_level="INFO" runtime_log_module="configs::configs_impl::typed_env_provider" runtime_log_thread=0 runtime_log_timestamp=1773665402889741
Mar 16 12:50:03 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:03.113399Z  INFO laser_warden::journal: IGGY_SYSTEM_PARTITION_PATH value changed to: partitions from environment variable runtime_type="iggy" runtime_version="0.7.2-edge.1" runtime_log_level="INFO" runtime_log_module="configs::configs_impl::typed_env_provider" runtime_log_thread=0 runtime_log_timestamp=1773665402889748
Mar 16 12:50:03 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:03.113452Z  INFO laser_warden::journal: IGGY_SYSTEM_PARTITION_MESSAGES_REQUIRED_TO_SAVE value changed to: 1024 from environment variable runtime_type="iggy" runtime_version="0.7.2-edge.1" runtime_log_level="INFO" runtime_log_module="configs::configs_impl::typed_env_provider" runtime_log_thread=0 runtime_log_timestamp=1773665402889756
Mar 16 12:50:03 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:03.113537Z  INFO laser_warden::journal: IGGY_SYSTEM_PARTITION_SIZE_OF_MESSAGES_REQUIRED_TO_SAVE value changed to: 1 MiB from environment variable runtime_type="iggy" runtime_version="0.7.2-edge.1" runtime_log_level="INFO" runtime_log_module="configs::configs_impl::typed_env_provider" runtime_log_thread=0 runtime_log_timestamp=1773665402889764
Mar 16 12:50:03 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:03.113589Z  INFO laser_warden::journal: IGGY_SYSTEM_PARTITION_ENFORCE_FSYNC value changed to: true from environment variable runtime_type="iggy" runtime_version="0.7.2-edge.1" runtime_log_level="INFO" runtime_log_module="configs::configs_impl::typed_env_provider" runtime_log_thread=0 runtime_log_timestamp=1773665402889772
Mar 16 12:50:03 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:03.113642Z  INFO laser_warden::journal: IGGY_SYSTEM_PARTITION_VALIDATE_CHECKSUM value changed to: false from environment variable runtime_type="iggy" runtime_version="0.7.2-edge.1" runtime_log_level="INFO" runtime_log_module="configs::configs_impl::typed_env_provider" runtime_log_thread=0 runtime_log_timestamp=1773665402889779
Mar 16 12:50:03 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:03.113697Z  INFO laser_warden::journal: IGGY_SYSTEM_SEGMENT_SIZE value changed to: 1 GiB from environment variable runtime_type="iggy" runtime_version="0.7.2-edge.1" runtime_log_level="INFO" runtime_log_module="configs::configs_impl::typed_env_provider" runtime_log_thread=0 runtime_log_timestamp=1773665402889787
Mar 16 12:50:03 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:03.113753Z  INFO laser_warden::journal: IGGY_SYSTEM_SEGMENT_CACHE_INDEXES value changed to: open_segment from environment variable runtime_type="iggy" runtime_version="0.7.2-edge.1" runtime_log_level="INFO" runtime_log_module="configs::configs_impl::typed_env_provider" runtime_log_thread=0 runtime_log_timestamp=1773665402889794
Mar 16 12:50:03 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:03.113808Z  INFO laser_warden::journal: IGGY_SYSTEM_SEGMENT_ARCHIVE_EXPIRED value changed to: false from environment variable runtime_type="iggy" runtime_version="0.7.2-edge.1" runtime_log_level="INFO" runtime_log_module="configs::configs_impl::typed_env_provider" runtime_log_thread=0 runtime_log_timestamp=1773665402889802
Mar 16 12:50:03 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:03.113868Z  INFO laser_warden::journal: IGGY_SYSTEM_COMPRESSION_ALLOW_OVERRIDE value changed to: false from environment variable runtime_type="iggy" runtime_version="0.7.2-edge.1" runtime_log_level="INFO" runtime_log_module="configs::configs_impl::typed_env_provider" runtime_log_thread=0 runtime_log_timestamp=1773665402889813
Mar 16 12:50:03 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:03.113923Z  INFO laser_warden::journal: IGGY_SYSTEM_COMPRESSION_DEFAULT_ALGORITHM value changed to: none from environment variable runtime_type="iggy" runtime_version="0.7.2-edge.1" runtime_log_level="INFO" runtime_log_module="configs::configs_impl::typed_env_provider" runtime_log_thread=0 runtime_log_timestamp=1773665402889820
Mar 16 12:50:03 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:03.113992Z  INFO laser_warden::journal: IGGY_SYSTEM_MESSAGE_DEDUPLICATION_ENABLED value changed to: false from environment variable runtime_type="iggy" runtime_version="0.7.2-edge.1" runtime_log_level="INFO" runtime_log_module="configs::configs_impl::typed_env_provider" runtime_log_thread=0 runtime_log_timestamp=1773665402889828
Mar 16 12:50:03 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:03.114047Z  INFO laser_warden::journal: IGGY_SYSTEM_MESSAGE_DEDUPLICATION_MAX_ENTRIES value changed to: 10000 from environment variable runtime_type="iggy" runtime_version="0.7.2-edge.1" runtime_log_level="INFO" runtime_log_module="configs::configs_impl::typed_env_provider" runtime_log_thread=0 runtime_log_timestamp=1773665402889836
Mar 16 12:50:03 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:03.114099Z  INFO laser_warden::journal: IGGY_SYSTEM_MESSAGE_DEDUPLICATION_EXPIRY value changed to: 1 m from environment variable runtime_type="iggy" runtime_version="0.7.2-edge.1" runtime_log_level="INFO" runtime_log_module="configs::configs_impl::typed_env_provider" runtime_log_thread=0 runtime_log_timestamp=1773665402889844
Mar 16 12:50:03 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:03.114155Z  INFO laser_warden::journal: IGGY_SYSTEM_RECOVERY_RECREATE_MISSING_STATE value changed to: false from environment variable runtime_type="iggy" runtime_version="0.7.2-edge.1" runtime_log_level="INFO" runtime_log_module="configs::configs_impl::typed_env_provider" runtime_log_thread=0 runtime_log_timestamp=1773665402889851
Mar 16 12:50:03 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:03.114208Z  INFO laser_warden::journal: IGGY_SYSTEM_MEMORY_POOL_ENABLED value changed to: true from environment variable runtime_type="iggy" runtime_version="0.7.2-edge.1" runtime_log_level="INFO" runtime_log_module="configs::configs_impl::typed_env_provider" runtime_log_thread=0 runtime_log_timestamp=1773665402889860
Mar 16 12:50:03 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:03.114260Z  INFO laser_warden::journal: IGGY_SYSTEM_MEMORY_POOL_SIZE value changed to: 4 GiB from environment variable runtime_type="iggy" runtime_version="0.7.2-edge.1" runtime_log_level="INFO" runtime_log_module="configs::configs_impl::typed_env_provider" runtime_log_thread=0 runtime_log_timestamp=1773665402889868
Mar 16 12:50:03 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:03.114308Z  INFO laser_warden::journal: IGGY_SYSTEM_MEMORY_POOL_BUCKET_CAPACITY value changed to: 8192 from environment variable runtime_type="iggy" runtime_version="0.7.2-edge.1" runtime_log_level="INFO" runtime_log_module="configs::configs_impl::typed_env_provider" runtime_log_thread=0 runtime_log_timestamp=1773665402889876
Mar 16 12:50:03 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:03.114344Z  INFO laser_warden::journal: IGGY_SYSTEM_SHARDING_CPU_ALLOCATION value changed to: numa:auto from environment variable runtime_type="iggy" runtime_version="0.7.2-edge.1" runtime_log_level="INFO" runtime_log_module="configs::configs_impl::typed_env_provider" runtime_log_thread=0 runtime_log_timestamp=1773665402889882
Mar 16 12:50:03 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:03.114378Z  INFO laser_warden::journal: IGGY_QUIC_ENABLED value changed to: false from environment variable runtime_type="iggy" runtime_version="0.7.2-edge.1" runtime_log_level="INFO" runtime_log_module="configs::configs_impl::typed_env_provider" runtime_log_thread=0 runtime_log_timestamp=1773665402889890
Mar 16 12:50:03 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:03.114412Z  INFO laser_warden::journal: IGGY_QUIC_ADDRESS value changed to: 0.0.0.0:8080 from environment variable runtime_type="iggy" runtime_version="0.7.2-edge.1" runtime_log_level="INFO" runtime_log_module="configs::configs_impl::typed_env_provider" runtime_log_thread=0 runtime_log_timestamp=1773665402889896
Mar 16 12:50:03 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:03.114447Z  INFO laser_warden::journal: IGGY_QUIC_MAX_CONCURRENT_BIDI_STREAMS value changed to: 10000 from environment variable runtime_type="iggy" runtime_version="0.7.2-edge.1" runtime_log_level="INFO" runtime_log_module="configs::configs_impl::typed_env_provider" runtime_log_thread=0 runtime_log_timestamp=1773665402889903
Mar 16 12:50:03 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:03.114519Z  INFO laser_warden::journal: IGGY_QUIC_DATAGRAM_SEND_BUFFER_SIZE value changed to: 100 KB from environment variable runtime_type="iggy" runtime_version="0.7.2-edge.1" runtime_log_level="INFO" runtime_log_module="configs::configs_impl::typed_env_provider" runtime_log_thread=0 runtime_log_timestamp=1773665402889910
Mar 16 12:50:03 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:03.114576Z  INFO laser_warden::journal: IGGY_QUIC_INITIAL_MTU value changed to: 8 KB from environment variable runtime_type="iggy" runtime_version="0.7.2-edge.1" runtime_log_level="INFO" runtime_log_module="configs::configs_impl::typed_env_provider" runtime_log_thread=0 runtime_log_timestamp=1773665402889917
Mar 16 12:50:03 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:03.114630Z  INFO laser_warden::journal: IGGY_QUIC_SEND_WINDOW value changed to: 100 KB from environment variable runtime_type="iggy" runtime_version="0.7.2-edge.1" runtime_log_level="INFO" runtime_log_module="configs::configs_impl::typed_env_provider" runtime_log_thread=0 runtime_log_timestamp=1773665402889923
Mar 16 12:50:03 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:03.114689Z  INFO laser_warden::journal: IGGY_QUIC_RECEIVE_WINDOW value changed to: 100 KB from environment variable runtime_type="iggy" runtime_version="0.7.2-edge.1" runtime_log_level="INFO" runtime_log_module="configs::configs_impl::typed_env_provider" runtime_log_thread=0 runtime_log_timestamp=1773665402889930
Mar 16 12:50:03 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:03.114745Z  INFO laser_warden::journal: IGGY_QUIC_KEEP_ALIVE_INTERVAL value changed to: 5 s from environment variable runtime_type="iggy" runtime_version="0.7.2-edge.1" runtime_log_level="INFO" runtime_log_module="configs::configs_impl::typed_env_provider" runtime_log_thread=0 runtime_log_timestamp=1773665402889937
Mar 16 12:50:03 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:03.114800Z  INFO laser_warden::journal: IGGY_QUIC_MAX_IDLE_TIMEOUT value changed to: 10 s from environment variable runtime_type="iggy" runtime_version="0.7.2-edge.1" runtime_log_level="INFO" runtime_log_module="configs::configs_impl::typed_env_provider" runtime_log_thread=0 runtime_log_timestamp=1773665402889944
Mar 16 12:50:03 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:03.114855Z  INFO laser_warden::journal: IGGY_QUIC_CERTIFICATE_SELF_SIGNED value changed to: true from environment variable runtime_type="iggy" runtime_version="0.7.2-edge.1" runtime_log_level="INFO" runtime_log_module="configs::configs_impl::typed_env_provider" runtime_log_thread=0 runtime_log_timestamp=1773665402889951
Mar 16 12:50:03 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:03.114910Z  INFO laser_warden::journal: IGGY_QUIC_SOCKET_OVERRIDE_DEFAULTS value changed to: false from environment variable runtime_type="iggy" runtime_version="0.7.2-edge.1" runtime_log_level="INFO" runtime_log_module="configs::configs_impl::typed_env_provider" runtime_log_thread=0 runtime_log_timestamp=1773665402889963
Mar 16 12:50:03 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:03.114964Z  INFO laser_warden::journal: IGGY_QUIC_SOCKET_RECV_BUFFER_SIZE value changed to: 64 KB from environment variable runtime_type="iggy" runtime_version="0.7.2-edge.1" runtime_log_level="INFO" runtime_log_module="configs::configs_impl::typed_env_provider" runtime_log_thread=0 runtime_log_timestamp=1773665402889970
Mar 16 12:50:03 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:03.115020Z  INFO laser_warden::journal: IGGY_QUIC_SOCKET_SEND_BUFFER_SIZE value changed to: 64 KB from environment variable runtime_type="iggy" runtime_version="0.7.2-edge.1" runtime_log_level="INFO" runtime_log_module="configs::configs_impl::typed_env_provider" runtime_log_thread=0 runtime_log_timestamp=1773665402889978
Mar 16 12:50:03 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:03.115078Z  INFO laser_warden::journal: IGGY_QUIC_SOCKET_KEEPALIVE value changed to: false from environment variable runtime_type="iggy" runtime_version="0.7.2-edge.1" runtime_log_level="INFO" runtime_log_module="configs::configs_impl::typed_env_provider" runtime_log_thread=0 runtime_log_timestamp=1773665402889985
Mar 16 12:50:03 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:03.115133Z  INFO laser_warden::journal: IGGY_TCP_ENABLED value changed to: true from environment variable runtime_type="iggy" runtime_version="0.7.2-edge.1" runtime_log_level="INFO" runtime_log_module="configs::configs_impl::typed_env_provider" runtime_log_thread=0 runtime_log_timestamp=1773665402889991
Mar 16 12:50:03 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:03.115187Z  INFO laser_warden::journal: IGGY_TCP_ADDRESS value changed to: 0.0.0.0:8090 from environment variable runtime_type="iggy" runtime_version="0.7.2-edge.1" runtime_log_level="INFO" runtime_log_module="configs::configs_impl::typed_env_provider" runtime_log_thread=0 runtime_log_timestamp=1773665402889998
Mar 16 12:50:03 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:03.115245Z  INFO laser_warden::journal: IGGY_TCP_IPV6 value changed to: false from environment variable runtime_type="iggy" runtime_version="0.7.2-edge.1" runtime_log_level="INFO" runtime_log_module="configs::configs_impl::typed_env_provider" runtime_log_thread=0 runtime_log_timestamp=1773665402890005
Mar 16 12:50:03 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:03.115299Z  INFO laser_warden::journal: IGGY_TCP_SOCKET_MIGRATION value changed to: true from environment variable runtime_type="iggy" runtime_version="0.7.2-edge.1" runtime_log_level="INFO" runtime_log_module="configs::configs_impl::typed_env_provider" runtime_log_thread=0 runtime_log_timestamp=1773665402890012
Mar 16 12:50:03 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:03.115352Z  INFO laser_warden::journal: IGGY_TCP_TLS_ENABLED value changed to: true from environment variable runtime_type="iggy" runtime_version="0.7.2-edge.1" runtime_log_level="INFO" runtime_log_module="configs::configs_impl::typed_env_provider" runtime_log_thread=0 runtime_log_timestamp=1773665402890019
Mar 16 12:50:03 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:03.115407Z  INFO laser_warden::journal: IGGY_TCP_TLS_SELF_SIGNED value changed to: false from environment variable runtime_type="iggy" runtime_version="0.7.2-edge.1" runtime_log_level="INFO" runtime_log_module="configs::configs_impl::typed_env_provider" runtime_log_thread=0 runtime_log_timestamp=1773665402890026
Mar 16 12:50:03 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:03.115461Z  INFO laser_warden::journal: IGGY_TCP_TLS_CERT_FILE value changed to: /etc/laserdata/certs/server-fullchain.crt from environment variable runtime_type="iggy" runtime_version="0.7.2-edge.1" runtime_log_level="INFO" runtime_log_module="configs::configs_impl::typed_env_provider" runtime_log_thread=0 runtime_log_timestamp=1773665402890033
Mar 16 12:50:03 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:03.115542Z  INFO laser_warden::journal: IGGY_TCP_TLS_KEY_FILE value changed to: /etc/laserdata/certs/server.key from environment variable runtime_type="iggy" runtime_version="0.7.2-edge.1" runtime_log_level="INFO" runtime_log_module="configs::configs_impl::typed_env_provider" runtime_log_thread=0 runtime_log_timestamp=1773665402890042
Mar 16 12:50:03 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:03.115598Z  INFO laser_warden::journal: IGGY_TCP_SOCKET_OVERRIDE_DEFAULTS value changed to: false from environment variable runtime_type="iggy" runtime_version="0.7.2-edge.1" runtime_log_level="INFO" runtime_log_module="configs::configs_impl::typed_env_provider" runtime_log_thread=0 runtime_log_timestamp=1773665402890050
Mar 16 12:50:03 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:03.115648Z  INFO laser_warden::journal: IGGY_TCP_SOCKET_RECV_BUFFER_SIZE value changed to: 100 KB from environment variable runtime_type="iggy" runtime_version="0.7.2-edge.1" runtime_log_level="INFO" runtime_log_module="configs::configs_impl::typed_env_provider" runtime_log_thread=0 runtime_log_timestamp=1773665402890058
Mar 16 12:50:03 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:03.115689Z  INFO laser_warden::journal: IGGY_TCP_SOCKET_SEND_BUFFER_SIZE value changed to: 100 KB from environment variable runtime_type="iggy" runtime_version="0.7.2-edge.1" runtime_log_level="INFO" runtime_log_module="configs::configs_impl::typed_env_provider" runtime_log_thread=0 runtime_log_timestamp=1773665402890066
Mar 16 12:50:03 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:03.115724Z  INFO laser_warden::journal: IGGY_TCP_SOCKET_KEEPALIVE value changed to: false from environment variable runtime_type="iggy" runtime_version="0.7.2-edge.1" runtime_log_level="INFO" runtime_log_module="configs::configs_impl::typed_env_provider" runtime_log_thread=0 runtime_log_timestamp=1773665402890074
Mar 16 12:50:03 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:03.115758Z  INFO laser_warden::journal: IGGY_TCP_SOCKET_NODELAY value changed to: false from environment variable runtime_type="iggy" runtime_version="0.7.2-edge.1" runtime_log_level="INFO" runtime_log_module="configs::configs_impl::typed_env_provider" runtime_log_thread=0 runtime_log_timestamp=1773665402890081
Mar 16 12:50:03 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:03.115794Z  INFO laser_warden::journal: IGGY_TCP_SOCKET_LINGER value changed to: 0 s from environment variable runtime_type="iggy" runtime_version="0.7.2-edge.1" runtime_log_level="INFO" runtime_log_module="configs::configs_impl::typed_env_provider" runtime_log_thread=0 runtime_log_timestamp=1773665402890088
Mar 16 12:50:03 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:03.115828Z  INFO laser_warden::journal: IGGY_HTTP_ENABLED value changed to: true from environment variable runtime_type="iggy" runtime_version="0.7.2-edge.1" runtime_log_level="INFO" runtime_log_module="configs::configs_impl::typed_env_provider" runtime_log_thread=0 runtime_log_timestamp=1773665402890094
Mar 16 12:50:03 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:03.115863Z  INFO laser_warden::journal: IGGY_HTTP_ADDRESS value changed to: 127.0.0.1:3000 from environment variable runtime_type="iggy" runtime_version="0.7.2-edge.1" runtime_log_level="INFO" runtime_log_module="configs::configs_impl::typed_env_provider" runtime_log_thread=0 runtime_log_timestamp=1773665402890100
Mar 16 12:50:03 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:03.115898Z  INFO laser_warden::journal: IGGY_HTTP_MAX_REQUEST_SIZE value changed to: 2 MB from environment variable runtime_type="iggy" runtime_version="0.7.2-edge.1" runtime_log_level="INFO" runtime_log_module="configs::configs_impl::typed_env_provider" runtime_log_thread=0 runtime_log_timestamp=1773665402890107
Mar 16 12:50:03 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:03.115942Z  INFO laser_warden::journal: IGGY_HTTP_WEB_UI value changed to: false from environment variable runtime_type="iggy" runtime_version="0.7.2-edge.1" runtime_log_level="INFO" runtime_log_module="configs::configs_impl::typed_env_provider" runtime_log_thread=0 runtime_log_timestamp=1773665402890114
Mar 16 12:50:03 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:03.115977Z  INFO laser_warden::journal: IGGY_HTTP_CORS_ENABLED value changed to: true from environment variable runtime_type="iggy" runtime_version="0.7.2-edge.1" runtime_log_level="INFO" runtime_log_module="configs::configs_impl::typed_env_provider" runtime_log_thread=0 runtime_log_timestamp=1773665402890120
Mar 16 12:50:03 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:03.116012Z  INFO laser_warden::journal: IGGY_HTTP_CORS_ALLOWED_METHODS value changed to: [GET,POST,PUT,DELETE] from environment variable runtime_type="iggy" runtime_version="0.7.2-edge.1" runtime_log_level="INFO" runtime_log_module="configs::configs_impl::typed_env_provider" runtime_log_thread=0 runtime_log_timestamp=1773665402890127
Mar 16 12:50:03 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:03.116047Z  INFO laser_warden::journal: IGGY_HTTP_CORS_ALLOWED_ORIGINS value changed to: [*] from environment variable runtime_type="iggy" runtime_version="0.7.2-edge.1" runtime_log_level="INFO" runtime_log_module="configs::configs_impl::typed_env_provider" runtime_log_thread=0 runtime_log_timestamp=1773665402890136
Mar 16 12:50:03 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:03.116082Z  INFO laser_warden::journal: IGGY_HTTP_CORS_ALLOWED_HEADERS value changed to: [content-type,authorization] from environment variable runtime_type="iggy" runtime_version="0.7.2-edge.1" runtime_log_level="INFO" runtime_log_module="configs::configs_impl::typed_env_provider" runtime_log_thread=0 runtime_log_timestamp=1773665402890143
Mar 16 12:50:03 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:03.116118Z  INFO laser_warden::journal: IGGY_HTTP_CORS_EXPOSED_HEADERS value changed to: [] from environment variable runtime_type="iggy" runtime_version="0.7.2-edge.1" runtime_log_level="INFO" runtime_log_module="configs::configs_impl::typed_env_provider" runtime_log_thread=0 runtime_log_timestamp=1773665402890151
Mar 16 12:50:03 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:03.116155Z  INFO laser_warden::journal: IGGY_HTTP_CORS_ALLOW_CREDENTIALS value changed to: false from environment variable runtime_type="iggy" runtime_version="0.7.2-edge.1" runtime_log_level="INFO" runtime_log_module="configs::configs_impl::typed_env_provider" runtime_log_thread=0 runtime_log_timestamp=1773665402890156
Mar 16 12:50:03 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:03.116190Z  INFO laser_warden::journal: IGGY_HTTP_CORS_ALLOW_PRIVATE_NETWORK value changed to: false from environment variable runtime_type="iggy" runtime_version="0.7.2-edge.1" runtime_log_level="INFO" runtime_log_module="configs::configs_impl::typed_env_provider" runtime_log_thread=0 runtime_log_timestamp=1773665402890162
Mar 16 12:50:03 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:03.116225Z  INFO laser_warden::journal: IGGY_HTTP_JWT_ALGORITHM value changed to: HS256 from environment variable runtime_type="iggy" runtime_version="0.7.2-edge.1" runtime_log_level="INFO" runtime_log_module="configs::configs_impl::typed_env_provider" runtime_log_thread=0 runtime_log_timestamp=1773665402890168
Mar 16 12:50:03 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:03.116263Z  INFO laser_warden::journal: IGGY_HTTP_JWT_ISSUER value changed to: laserdata.cloud from environment variable runtime_type="iggy" runtime_version="0.7.2-edge.1" runtime_log_level="INFO" runtime_log_module="configs::configs_impl::typed_env_provider" runtime_log_thread=0 runtime_log_timestamp=1773665402890175
Mar 16 12:50:03 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:03.116297Z  INFO laser_warden::journal: IGGY_HTTP_JWT_AUDIENCE value changed to: laserdata.cloud from environment variable runtime_type="iggy" runtime_version="0.7.2-edge.1" runtime_log_level="INFO" runtime_log_module="configs::configs_impl::typed_env_provider" runtime_log_thread=0 runtime_log_timestamp=1773665402890181
Mar 16 12:50:03 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:03.116337Z  INFO laser_warden::journal: IGGY_HTTP_JWT_VALID_ISSUERS value changed to: [laserdata.cloud] from environment variable runtime_type="iggy" runtime_version="0.7.2-edge.1" runtime_log_level="INFO" runtime_log_module="configs::configs_impl::typed_env_provider" runtime_log_thread=0 runtime_log_timestamp=1773665402890188
Mar 16 12:50:03 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:03.116372Z  INFO laser_warden::journal: IGGY_HTTP_JWT_VALID_AUDIENCES value changed to: [laserdata.cloud] from environment variable runtime_type="iggy" runtime_version="0.7.2-edge.1" runtime_log_level="INFO" runtime_log_module="configs::configs_impl::typed_env_provider" runtime_log_thread=0 runtime_log_timestamp=1773665402890196
Mar 16 12:50:03 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:03.116408Z  INFO laser_warden::journal: IGGY_HTTP_JWT_ACCESS_TOKEN_EXPIRY value changed to: 1 h from environment variable runtime_type="iggy" runtime_version="0.7.2-edge.1" runtime_log_level="INFO" runtime_log_module="configs::configs_impl::typed_env_provider" runtime_log_thread=0 runtime_log_timestamp=1773665402890203
Mar 16 12:50:03 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:03.116443Z  INFO laser_warden::journal: IGGY_HTTP_JWT_CLOCK_SKEW value changed to: 5 s from environment variable runtime_type="iggy" runtime_version="0.7.2-edge.1" runtime_log_level="INFO" runtime_log_module="configs::configs_impl::typed_env_provider" runtime_log_thread=0 runtime_log_timestamp=1773665402890210
Mar 16 12:50:03 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:03.116642Z  INFO laser_warden::journal: IGGY_HTTP_JWT_NOT_BEFORE value changed to: 0 s from environment variable runtime_type="iggy" runtime_version="0.7.2-edge.1" runtime_log_level="INFO" runtime_log_module="configs::configs_impl::typed_env_provider" runtime_log_thread=0 runtime_log_timestamp=1773665402890216
Mar 16 12:50:03 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:03.116705Z  INFO laser_warden::journal: IGGY_HTTP_JWT_ENCODING_SECRET value changed to: ****** from environment variable runtime_type="iggy" runtime_version="0.7.2-edge.1" runtime_log_level="INFO" runtime_log_module="configs::configs_impl::typed_env_provider" runtime_log_thread=0 runtime_log_timestamp=1773665402890223
Mar 16 12:50:03 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:03.116759Z  INFO laser_warden::journal: IGGY_HTTP_JWT_DECODING_SECRET value changed to: ****** from environment variable runtime_type="iggy" runtime_version="0.7.2-edge.1" runtime_log_level="INFO" runtime_log_module="configs::configs_impl::typed_env_provider" runtime_log_thread=0 runtime_log_timestamp=1773665402890230
Mar 16 12:50:03 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:03.116811Z  INFO laser_warden::journal: IGGY_HTTP_JWT_USE_BASE64_SECRET value changed to: true from environment variable runtime_type="iggy" runtime_version="0.7.2-edge.1" runtime_log_level="INFO" runtime_log_module="configs::configs_impl::typed_env_provider" runtime_log_thread=0 runtime_log_timestamp=1773665402890237
Mar 16 12:50:03 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:03.116866Z  INFO laser_warden::journal: IGGY_HTTP_METRICS_ENABLED value changed to: true from environment variable runtime_type="iggy" runtime_version="0.7.2-edge.1" runtime_log_level="INFO" runtime_log_module="configs::configs_impl::typed_env_provider" runtime_log_thread=0 runtime_log_timestamp=1773665402890243
Mar 16 12:50:03 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:03.116916Z  INFO laser_warden::journal: IGGY_HTTP_METRICS_ENDPOINT value changed to: /metrics from environment variable runtime_type="iggy" runtime_version="0.7.2-edge.1" runtime_log_level="INFO" runtime_log_module="configs::configs_impl::typed_env_provider" runtime_log_thread=0 runtime_log_timestamp=1773665402890250
Mar 16 12:50:03 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:03.116969Z  INFO laser_warden::journal: IGGY_HTTP_TLS_ENABLED value changed to: false from environment variable runtime_type="iggy" runtime_version="0.7.2-edge.1" runtime_log_level="INFO" runtime_log_module="configs::configs_impl::typed_env_provider" runtime_log_thread=0 runtime_log_timestamp=1773665402890257
Mar 16 12:50:03 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:03.117023Z  INFO laser_warden::journal: IGGY_WEBSOCKET_ENABLED value changed to: true from environment variable runtime_type="iggy" runtime_version="0.7.2-edge.1" runtime_log_level="INFO" runtime_log_module="configs::configs_impl::typed_env_provider" runtime_log_thread=0 runtime_log_timestamp=1773665402890265
Mar 16 12:50:03 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:03.117077Z  INFO laser_warden::journal: IGGY_WEBSOCKET_ADDRESS value changed to: 0.0.0.0:8070 from environment variable runtime_type="iggy" runtime_version="0.7.2-edge.1" runtime_log_level="INFO" runtime_log_module="configs::configs_impl::typed_env_provider" runtime_log_thread=0 runtime_log_timestamp=1773665402890273
Mar 16 12:50:03 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:03.117136Z  INFO laser_warden::journal: IGGY_WEBSOCKET_TLS_ENABLED value changed to: true from environment variable runtime_type="iggy" runtime_version="0.7.2-edge.1" runtime_log_level="INFO" runtime_log_module="configs::configs_impl::typed_env_provider" runtime_log_thread=0 runtime_log_timestamp=1773665402890287
Mar 16 12:50:03 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:03.117193Z  INFO laser_warden::journal: IGGY_WEBSOCKET_TLS_SELF_SIGNED value changed to: false from environment variable runtime_type="iggy" runtime_version="0.7.2-edge.1" runtime_log_level="INFO" runtime_log_module="configs::configs_impl::typed_env_provider" runtime_log_thread=0 runtime_log_timestamp=1773665402890295
Mar 16 12:50:03 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:03.117252Z  INFO laser_warden::journal: IGGY_WEBSOCKET_TLS_CERT_FILE value changed to: /etc/laserdata/certs/server-fullchain.crt from environment variable runtime_type="iggy" runtime_version="0.7.2-edge.1" runtime_log_level="INFO" runtime_log_module="configs::configs_impl::typed_env_provider" runtime_log_thread=0 runtime_log_timestamp=1773665402890304
Mar 16 12:50:03 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:03.117308Z  INFO laser_warden::journal: IGGY_WEBSOCKET_TLS_KEY_FILE value changed to: /etc/laserdata/certs/server.key from environment variable runtime_type="iggy" runtime_version="0.7.2-edge.1" runtime_log_level="INFO" runtime_log_module="configs::configs_impl::typed_env_provider" runtime_log_thread=0 runtime_log_timestamp=1773665402890312
Mar 16 12:50:03 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:03.117363Z  INFO laser_warden::journal: IGGY_TELEMETRY_ENABLED value changed to: false from environment variable runtime_type="iggy" runtime_version="0.7.2-edge.1" runtime_log_level="INFO" runtime_log_module="configs::configs_impl::typed_env_provider" runtime_log_thread=0 runtime_log_timestamp=1773665402890320
Mar 16 12:50:03 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:03.117419Z  INFO laser_warden::journal: IGGY_TELEMETRY_SERVICE_NAME value changed to: iggy from environment variable runtime_type="iggy" runtime_version="0.7.2-edge.1" runtime_log_level="INFO" runtime_log_module="configs::configs_impl::typed_env_provider" runtime_log_thread=0 runtime_log_timestamp=1773665402890328
Mar 16 12:50:03 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:03.117473Z  INFO laser_warden::journal: IGGY_TELEMETRY_LOGS_TRANSPORT value changed to: grpc from environment variable runtime_type="iggy" runtime_version="0.7.2-edge.1" runtime_log_level="INFO" runtime_log_module="configs::configs_impl::typed_env_provider" runtime_log_thread=0 runtime_log_timestamp=1773665402890336
Mar 16 12:50:03 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:03.117555Z  INFO laser_warden::journal: IGGY_TELEMETRY_TRACES_TRANSPORT value changed to: grpc from environment variable runtime_type="iggy" runtime_version="0.7.2-edge.1" runtime_log_level="INFO" runtime_log_module="configs::configs_impl::typed_env_provider" runtime_log_thread=0 runtime_log_timestamp=1773665402890345
Mar 16 12:50:03 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:03.117610Z  INFO laser_warden::journal: IGGY_CLUSTER_ENABLED value changed to: false from environment variable runtime_type="iggy" runtime_version="0.7.2-edge.1" runtime_log_level="INFO" runtime_log_module="configs::configs_impl::typed_env_provider" runtime_log_thread=0 runtime_log_timestamp=1773665402890353
Mar 16 12:50:03 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:03.117665Z  INFO laser_warden::journal: Config loaded successfully. runtime_type="iggy" runtime_version="0.7.2-edge.1" runtime_log_level="INFO" runtime_log_module="configs::configs_impl::file_provider" runtime_log_thread=0 runtime_log_timestamp=1773665402890722
Mar 16 12:50:03 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:03.117872Z  INFO laser_warden::journal: Using Config: { consumer_group: { rebalancing_timeout: 30s, rebalancing_check_interval: 5s }, data_maintenance: { messages: { cleaner_enabled: true, interval: 1m } }, message_saver: { enabled: true, enforce_fsync: true, interval: 30s }, heartbeat: { enabled: false, interval: 5s }, system: { path: local_data, logging: { path: logs, level: info, file_enabled: true, max_file_size: 20.00 MB, max_total_size: 100.00 MB, rotation_check_interval: 1h, retention: 7days }, stream: { path: streams }, topic: { path: topics, max_size: unlimited, message_expiry: never_expire }, partition: { path: partitions, messages_required_to_save: 1024, size_of_messages_required_to_save: 1.05 MB, enforce_fsync: true, validate_checksum: false }, segment: { size_bytes: 1.07 GB, cache_indexes: OpenSegment, archive_expired: false }, encryption: { enabled: false }, state: { enforce_fsync: true, max_file_operation_retries: 1, retry_delay: 1s } }, quic: { enabled: false, address: 0.0.0.0:8080, max_concurrent_bidi_streams: 10000, datagram_send_buffer_size: 100.00 KB, initial_mtu: 8.00 KB, send_window: 100.00 KB, receive_window: 100.00 KB, keep_alive_interval: 5s, max_idle_timeout: 10s, certificate: { self_signed: true, cert_file: core/certs/iggy_cert.pem, key_file: core/certs/iggy_key.pem } }, tcp: { enabled: true, address: 0.0.0.0:8090, ipv6: false, tls: { enabled: true, self_signed: false, cert_file: /etc/laserdata/certs/server-fullchain.crt, key_file: /etc/laserdata/certs/server.key }, socket: { override defaults: false, recv buffer size: 100.00 KB, send buffer size 100.00 KB, keepalive: false, nodelay: false, linger: 0s }, socket_migration: true }, http: { enabled: true, address: 127.0.0.1:3000, max_request_size: 2.00 MB, web_ui: false, cors: { enabled: true, allowed_methods: ["GET", "POST", "PUT", "DELETE"], allowed_origins: ["*"], allowed_headers: ["content-type", "authorization"], exposed_headers: [], allow_credentials: false, allow_private_network: false }, jwt: { algorithm: HS256, audience: laserdata.cloud, access_token_expiry: 1h, use_base64_secret=*** }, metrics: { enabled: true, endpoint: /metrics }, tls: { enabled: false, cert_file: core/certs/iggy_cert.pem, key_file: core/certs/iggy_key.pem } }, telemetry: { enabled: false, service_name: iggy, logs: { transport: grpc, endpoint: http://localhost:7281/v1/logs }, traces: { transport: grpc, endpoint: http://localhost:7281/v1/traces } } } runtime_type="iggy" runtime_version="0.7.2-edge.1" runtime_log_level="INFO" runtime_log_module="configs::configs_impl::file_provider" runtime_log_thread=0 runtime_log_timestamp=1773665402890798
Mar 16 12:50:03 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:03.117974Z  INFO laser_warden::journal: Initializing system, data will be stored at: local_data runtime_type="iggy" runtime_version="0.7.2-edge.1" runtime_log_level="INFO" runtime_log_module="server::bootstrap" runtime_log_thread=0 runtime_log_timestamp=1773665402891353
Mar 16 12:50:03 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:03.118039Z  INFO laser_warden::journal: Logging initialized, logs will be stored at: "local_data/logs". Logs will be rotated based on size. Log filter: info. runtime_type="iggy" runtime_version="0.7.2-edge.1" runtime_log_level="INFO" runtime_log_module="server::log::logger" runtime_log_thread=0 runtime_log_timestamp=1773665402894670
Mar 16 12:50:03 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:03.118101Z  INFO laser_warden::journal: Initializing MemoryPool with 32 buckets, each will have capacity: 8192. runtime_type="iggy" runtime_version="0.7.2-edge.1" runtime_log_level="INFO" runtime_log_module="iggy_common::alloc::memory_pool" runtime_log_thread=0 runtime_log_timestamp=1773665402899391
Mar 16 12:50:03 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:03.118160Z  INFO laser_warden::journal: Current semantic version: SemanticVersion { major: 0, minor: 7, patch: 2, prerelease: Some("edge.1") } runtime_type="iggy" runtime_version="0.7.2-edge.1" runtime_log_level="INFO" runtime_log_module="iggy_server" runtime_log_thread=0 runtime_log_timestamp=1773665402899464
Mar 16 12:50:03 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:03.118219Z  INFO laser_warden::journal: System info not found, creating... runtime_type="iggy" runtime_version="0.7.2-edge.1" runtime_log_level="INFO" runtime_log_module="iggy_server" runtime_log_thread=0 runtime_log_timestamp=1773665402899563
Mar 16 12:50:03 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:03.118276Z  INFO laser_warden::journal: Saved system info, system info, version: 0.7.2-edge.1 runtime_type="iggy" runtime_version="0.7.2-edge.1" runtime_log_level="INFO" runtime_log_module="server::shard::system::storage" runtime_log_thread=0 runtime_log_timestamp=1773665402901740
Mar 16 12:50:03 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:03.118336Z  INFO laser_warden::journal: Loaded system info, version: 0.7.2-edge.1. runtime_type="iggy" runtime_version="0.7.2-edge.1" runtime_log_level="INFO" runtime_log_module="iggy_server" runtime_log_thread=0 runtime_log_timestamp=1773665402901809
Mar 16 12:50:03 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:03.118397Z  INFO laser_warden::journal: System version 0.7.2-edge.1 is up to date. runtime_type="iggy" runtime_version="0.7.2-edge.1" runtime_log_level="INFO" runtime_log_module="iggy_server" runtime_log_thread=0 runtime_log_timestamp=1773665402901862
Mar 16 12:50:03 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:03.118453Z  INFO laser_warden::journal: Server-side encryption is disabled. runtime_type="iggy" runtime_version="0.7.2-edge.1" runtime_log_level="INFO" runtime_log_module="iggy_server" runtime_log_thread=0 runtime_log_timestamp=1773665402901902
Mar 16 12:50:03 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:03.118533Z  INFO laser_warden::journal: State file is empty runtime_type="iggy" runtime_version="0.7.2-edge.1" runtime_log_level="INFO" runtime_log_module="server::state::file" runtime_log_thread=0 runtime_log_timestamp=1773665402902006
Mar 16 12:50:03 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:03.118591Z  INFO laser_warden::journal: No users found, creating the root user... runtime_type="iggy" runtime_version="0.7.2-edge.1" runtime_log_level="INFO" runtime_log_module="server::state::system" runtime_log_thread=0 runtime_log_timestamp=1773665402902047
Mar 16 12:50:03 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:03.118647Z  INFO laser_warden::journal: Using the custom root user credentials. runtime_type="iggy" runtime_version="0.7.2-edge.1" runtime_log_level="INFO" runtime_log_module="server::bootstrap" runtime_log_thread=0 runtime_log_timestamp=1773665402902089
Mar 16 12:50:03 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:03.118704Z  INFO laser_warden::journal: Loading state, file size: 192 B runtime_type="iggy" runtime_version="0.7.2-edge.1" runtime_log_level="INFO" runtime_log_module="server::state::file" runtime_log_thread=0 runtime_log_timestamp=1773665402957174
Mar 16 12:50:03 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:03.118759Z  INFO laser_warden::journal: Loaded 1 state entries, current index: 0 runtime_type="iggy" runtime_version="0.7.2-edge.1" runtime_log_level="INFO" runtime_log_module="server::state::file" runtime_log_thread=0 runtime_log_timestamp=1773665402957311
Mar 16 12:50:03 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:03.118818Z  INFO laser_warden::journal: Building metadata: 1 users, 0 personal access tokens runtime_type="iggy" runtime_version="0.7.2-edge.1" runtime_log_level="INFO" runtime_log_module="server::bootstrap" runtime_log_thread=0 runtime_log_timestamp=1773665402957390
Mar 16 12:50:03 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:03.118879Z  INFO laser_warden::journal: Built metadata: 0 streams, 0 topics, 0 partitions, 0 consumer groups runtime_type="iggy" runtime_version="0.7.2-edge.1" runtime_log_level="INFO" runtime_log_module="server::bootstrap" runtime_log_thread=0 runtime_log_timestamp=1773665402957436
Mar 16 12:50:04 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:04.570898Z  INFO laser_warden::journal: Using 1 shards with 1 NUMA node, 1 cores per node, and avoid hyperthread true runtime_type="iggy" runtime_version="0.7.2-edge.1" runtime_log_level="INFO" runtime_log_module="server::shard_allocator" runtime_log_thread=0 runtime_log_timestamp=1773665404070508
Mar 16 12:50:04 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:04.571016Z  INFO laser_warden::journal: Using mimalloc allocator runtime_type="iggy" runtime_version="0.7.2-edge.1" runtime_log_level="INFO" runtime_log_module="iggy_server" runtime_log_thread=0 runtime_log_timestamp=1773665404070542
Mar 16 12:50:04 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:04.571085Z  INFO laser_warden::journal: Enable TCP socket migration across shards: true. runtime_type="iggy" runtime_version="0.7.2-edge.1" runtime_log_level="INFO" runtime_log_module="iggy_server" runtime_log_thread=0 runtime_log_timestamp=1773665404070551
Mar 16 12:50:04 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:04.571137Z  INFO laser_warden::journal: Starting 1 shard(s) runtime_type="iggy" runtime_version="0.7.2-edge.1" runtime_log_level="INFO" runtime_log_module="iggy_server" runtime_log_thread=0 runtime_log_timestamp=1773665404070556
Mar 16 12:50:04 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:04.571191Z  INFO laser_warden::journal: Thread bound to CPUs: {0} runtime_type="iggy" runtime_version="0.7.2-edge.1" runtime_log_level="INFO" runtime_log_module="server::shard_allocator" runtime_log_thread=0 runtime_log_timestamp=1773665404071334
Mar 16 12:50:04 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:04.571244Z  INFO laser_warden::journal: Iggy server is running. Press Ctrl+C or send SIGTERM to shutdown. runtime_type="iggy" runtime_version="0.7.2-edge.1" runtime_log_level="INFO" runtime_log_module="iggy_server" runtime_log_thread=0 runtime_log_timestamp=1773665404071437
Mar 16 12:50:04 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:04.571305Z  INFO laser_warden::journal: Memory bound to NUMA node 0 runtime_type="iggy" runtime_version="0.7.2-edge.1" runtime_log_level="INFO" runtime_log_module="server::shard_allocator" runtime_log_thread=0 runtime_log_timestamp=1773665404072607
Mar 16 12:50:04 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:04.571340Z  INFO laser_warden::journal: Starting... runtime_type="iggy" runtime_version="0.7.2-edge.1" runtime_log_level="INFO" runtime_log_module="server::shard" runtime_log_thread=0 runtime_log_timestamp=1773665404072883
Mar 16 12:50:04 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:04.571372Z  INFO laser_warden::journal: Initialized 1 user(s). runtime_type="iggy" runtime_version="0.7.2-edge.1" runtime_log_level="INFO" runtime_log_module="server::shard" runtime_log_thread=0 runtime_log_timestamp=1773665404072904
Mar 16 12:50:04 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:04.571406Z  INFO laser_warden::journal: Message saver is enabled, buffered messages will be automatically saved every: 30s, enforce fsync: true. runtime_type="iggy" runtime_version="0.7.2-edge.1" runtime_log_level="INFO" runtime_log_module="server::shard::tasks::periodic::message_saver" runtime_log_thread=0 runtime_log_timestamp=1773665404072961
Mar 16 12:50:04 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:04.571444Z  INFO laser_warden::journal: Message cleaner is enabled, expired segments will be automatically deleted every: 60s runtime_type="iggy" runtime_version="0.7.2-edge.1" runtime_log_level="INFO" runtime_log_module="server::shard::tasks::periodic::message_cleaner" runtime_log_thread=0 runtime_log_timestamp=1773665404072979
Mar 16 12:50:04 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:04.571505Z  INFO laser_warden::journal: Personal access token cleaner is enabled, expired tokens will be deleted every: 60s. runtime_type="iggy" runtime_version="0.7.2-edge.1" runtime_log_level="INFO" runtime_log_module="server::shard::tasks::periodic::personal_access_token_cleaner" runtime_log_thread=0 runtime_log_timestamp=1773665404072988
Mar 16 12:50:04 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:04.571543Z  INFO laser_warden::journal: Pending partition revocations will be checked every: 5s. Timeout: 30s. runtime_type="iggy" runtime_version="0.7.2-edge.1" runtime_log_level="INFO" runtime_log_module="server::shard::tasks::periodic::revocation_timeout" runtime_log_thread=0 runtime_log_timestamp=1773665404072995
Mar 16 12:50:04 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:04.571596Z  INFO laser_warden::journal: System info logger is enabled, OS info will be printed every: 10s runtime_type="iggy" runtime_version="0.7.2-edge.1" runtime_log_level="INFO" runtime_log_module="server::shard::tasks::periodic::sysinfo_printer" runtime_log_thread=0 runtime_log_timestamp=1773665404073004
Mar 16 12:50:04 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:04.571634Z  INFO laser_warden::journal: Initialized in 0 ms. runtime_type="iggy" runtime_version="0.7.2-edge.1" runtime_log_level="INFO" runtime_log_module="server::shard" runtime_log_thread=0 runtime_log_timestamp=1773665404073012
Mar 16 12:50:04 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:04.571670Z  INFO laser_warden::journal: Starting message passing task runtime_type="iggy" runtime_version="0.7.2-edge.1" runtime_log_level="INFO" runtime_log_module="server::shard::tasks::continuous::message_pump" runtime_log_thread=0 runtime_log_timestamp=1773665404073024
Mar 16 12:50:04 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:04.571708Z  INFO laser_warden::journal: Initializing Iggy TCP TLS server... runtime_type="iggy" runtime_version="0.7.2-edge.1" runtime_log_level="INFO" runtime_log_module="server::tcp::tcp_server" runtime_log_thread=0 runtime_log_timestamp=1773665404073082
Mar 16 12:50:04 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:04.571743Z  INFO laser_warden::journal: Starting HTTP server on shard: 0 runtime_type="iggy" runtime_version="0.7.2-edge.1" runtime_log_level="INFO" runtime_log_module="server::shard::tasks::continuous::http_server" runtime_log_thread=0 runtime_log_timestamp=1773665404073158
Mar 16 12:50:04 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:04.571781Z  INFO laser_warden::journal: Starting WebSocket TLS server on: 0.0.0.0:8070 for shard: 0... runtime_type="iggy" runtime_version="0.7.2-edge.1" runtime_log_level="INFO" runtime_log_module="server::websocket::websocket_server" runtime_log_thread=0 runtime_log_timestamp=1773665404073206
Mar 16 12:50:04 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:04.571818Z  INFO laser_warden::journal: Loading certificates from cert_file: /etc/laserdata/certs/server-fullchain.crt, key_file: /etc/laserdata/certs/server.key runtime_type="iggy" runtime_version="0.7.2-edge.1" runtime_log_level="INFO" runtime_log_module="server::tcp::tcp_tls_listener" runtime_log_thread=0 runtime_log_timestamp=1773665404073379
Mar 16 12:50:04 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:04.571856Z  INFO laser_warden::journal: Iggy TCP TLS server has started on: 0.0.0.0:8090 runtime_type="iggy" runtime_version="0.7.2-edge.1" runtime_log_level="INFO" runtime_log_module="server::tcp::tcp_tls_listener" runtime_log_thread=0 runtime_log_timestamp=1773665404073740
Mar 16 12:50:04 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:04.571956Z  INFO laser_warden::journal: Loading certificates from cert_file: /etc/laserdata/certs/server-fullchain.crt, key_file: /etc/laserdata/certs/server.key runtime_type="iggy" runtime_version="0.7.2-edge.1" runtime_log_level="INFO" runtime_log_module="server::websocket::websocket_tls_listener" runtime_log_thread=0 runtime_log_timestamp=1773665404073769
Mar 16 12:50:04 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:04.571995Z  INFO laser_warden::journal: WebSocket TLS Server has started on: wss://0.0.0.0:8070 runtime_type="iggy" runtime_version="0.7.2-edge.1" runtime_log_level="INFO" runtime_log_module="server::websocket::websocket_tls_listener" runtime_log_thread=0 runtime_log_timestamp=1773665404074039
Mar 16 12:50:04 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:04.572028Z  INFO laser_warden::journal: WebSocket TLS config: max_message_size: None, max_frame_size: None, accept_unmasked_frames: false runtime_type="iggy" runtime_version="0.7.2-edge.1" runtime_log_level="INFO" runtime_log_module="server::websocket::websocket_tls_listener" runtime_log_thread=0 runtime_log_timestamp=1773665404074057
Mar 16 12:50:04 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:04.572062Z  INFO laser_warden::journal: WebSocket TLS accept loop started, waiting for connections... runtime_type="iggy" runtime_version="0.7.2-edge.1" runtime_log_level="INFO" runtime_log_module="server::websocket::websocket_tls_listener" runtime_log_thread=0 runtime_log_timestamp=1773665404074064
Mar 16 12:50:04 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:04.572098Z  INFO laser_warden::journal: No revoked access tokens found to load. runtime_type="iggy" runtime_version="0.7.2-edge.1" runtime_log_level="INFO" runtime_log_module="server::http::jwt::storage" runtime_log_thread=0 runtime_log_timestamp=1773665404074127
Mar 16 12:50:04 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:04.572135Z  INFO laser_warden::journal: JWT token cleaner is enabled, expired revoked tokens will be deleted every: 300 seconds. runtime_type="iggy" runtime_version="0.7.2-edge.1" runtime_log_level="INFO" runtime_log_module="server::shard::tasks::periodic::jwt_token_cleaner" runtime_log_thread=0 runtime_log_timestamp=1773665404074601
Mar 16 12:50:04 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:04.572173Z  INFO laser_warden::journal: Started HTTP API on: 127.0.0.1:3000 runtime_type="iggy" runtime_version="0.7.2-edge.1" runtime_log_level="INFO" runtime_log_module="server::http::http_server" runtime_log_thread=0 runtime_log_timestamp=1773665404074687
Mar 16 12:50:04 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:04.572209Z  INFO laser_warden::journal: Received AddressBound event for Http with address: 127.0.0.1:3000 runtime_type="iggy" runtime_version="0.7.2-edge.1" runtime_log_level="INFO" runtime_log_module="server::shard::handlers" runtime_log_thread=0 runtime_log_timestamp=1773665404074705
Mar 16 12:50:04 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:04.572246Z  INFO laser_warden::journal: Config writer: TCP addr = Some(0.0.0.0:8090), QUIC addr = None, HTTP addr = Some(127.0.0.1:3000), WebSocket addr = Some(0.0.0.0:8070) runtime_type="iggy" runtime_version="0.7.2-edge.1" runtime_log_level="INFO" runtime_log_module="server::shard::tasks::oneshot::config_writer" runtime_log_thread=0 runtime_log_timestamp=1773665404074737
Mar 16 12:50:04 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:04.572281Z  INFO laser_warden::journal: Current config written and synced to: local_data/runtime/current_config.toml with all bound addresses runtime_type="iggy" runtime_version="0.7.2-edge.1" runtime_log_level="INFO" runtime_log_module="server::shard::tasks::oneshot::config_writer" runtime_log_thread=0 runtime_log_timestamp=1773665404079616
Mar 16 12:50:04 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:04.949737Z  INFO laser_warden::iggy::service: Iggy HTTP endpoint is ready at http://localhost:3000 (after 3 attempt(s))
Mar 16 12:50:04 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:04.949788Z  INFO laser_warden::iggy::service: Provisioning iggy users via http://localhost:3000
Mar 16 12:50:04 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:04.999291Z  INFO laser_warden::iggy::credentials: Logged in as root user for provisioning
Mar 16 12:50:05 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:05.078017Z  INFO laser_warden::iggy::credentials: Created Iggy user warden
Mar 16 12:50:05 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:05.119243Z  INFO laser_warden::iggy::credentials: Created PAT warden for user warden
Mar 16 12:50:05 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:05.164405Z  INFO laser_warden::iggy::credentials: Warden PAT saved to /etc/warden/credentials/warden.pat
Mar 16 12:50:05 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:05.242438Z  INFO laser_warden::iggy::credentials: Created Iggy user connectors
Mar 16 12:50:05 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:05.242653Z  INFO laser_warden::journal: Created personal access token=war*** for user with ID: 1. runtime_type="iggy" runtime_version="0.7.2-edge.1" runtime_log_level="INFO" runtime_log_module="server::shard::system::personal_access_tokens" runtime_log_thread=0 runtime_log_timestamp=1773665405115576
Mar 16 12:50:05 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:05.242715Z  INFO laser_warden::journal: No revoked access tokens found to load. runtime_type="iggy" runtime_version="0.7.2-edge.1" runtime_log_level="INFO" runtime_log_module="server::http::jwt::storage" runtime_log_thread=0 runtime_log_timestamp=1773665405119559
Mar 16 12:50:05 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:05.242756Z  INFO laser_warden::journal: Revoked access token with ID: 019cf6b2-48bb-7992-8ca5-eab0cc90cacc runtime_type="iggy" runtime_version="0.7.2-edge.1" runtime_log_level="INFO" runtime_log_module="server::http::jwt::jwt_manager" runtime_log_thread=0 runtime_log_timestamp=1773665405123003
Mar 16 12:50:05 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:05.283730Z  INFO laser_warden::iggy::credentials: Created PAT connectors for user connectors
Mar 16 12:50:05 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:05.328109Z  INFO laser_warden::iggy::credentials: Connectors PAT saved to /etc/warden/credentials/connectors.pat
Mar 16 12:50:05 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:05.404877Z  INFO laser_warden::iggy::credentials: Created Iggy user prober
Mar 16 12:50:05 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:05.445151Z  INFO laser_warden::iggy::credentials: Created PAT prober for user prober
Mar 16 12:50:05 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:05.486405Z  INFO laser_warden::iggy::credentials: Prober PAT saved to /etc/warden/credentials/prober.pat
Mar 16 12:50:05 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:05.489064Z  INFO laser_warden::iggy::service: Successfully provisioned iggy users
Mar 16 12:50:05 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:05.490021Z  INFO laser_warden::internal: Restarting prober after credential re-provisioning
Mar 16 12:50:05 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:05.490157Z  INFO laser_warden::systemd: Restarting systemd unit: laser-prober.service
Mar 16 12:50:05 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:05.494423Z  INFO laser_warden::journal: Created personal access token=con*** for user with ID: 2. runtime_type="iggy" runtime_version="0.7.2-edge.1" runtime_log_level="INFO" runtime_log_module="server::shard::system::personal_access_tokens" runtime_log_thread=0 runtime_log_timestamp=1773665405280169
Mar 16 12:50:05 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:05.495001Z  INFO laser_warden::journal: Loading revoked access tokens from: local_data/state/tokens runtime_type="iggy" runtime_version="0.7.2-edge.1" runtime_log_level="INFO" runtime_log_module="server::http::jwt::storage" runtime_log_thread=0 runtime_log_timestamp=1773665405284124
Mar 16 12:50:05 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:05.495053Z  INFO laser_warden::journal: Loaded 1 revoked access tokens runtime_type="iggy" runtime_version="0.7.2-edge.1" runtime_log_level="INFO" runtime_log_module="server::http::jwt::storage" runtime_log_thread=0 runtime_log_timestamp=1773665405284195
Mar 16 12:50:05 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:05.495094Z  INFO laser_warden::journal: Revoked access token with ID: 019cf6b2-495f-7a21-8240-80edc9121333 runtime_type="iggy" runtime_version="0.7.2-edge.1" runtime_log_level="INFO" runtime_log_module="server::http::jwt::jwt_manager" runtime_log_thread=0 runtime_log_timestamp=1773665405287288
Mar 16 12:50:05 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:05.495133Z  INFO laser_warden::journal: Created personal access token=pro*** for user with ID: 3. runtime_type="iggy" runtime_version="0.7.2-edge.1" runtime_log_level="INFO" runtime_log_module="server::shard::system::personal_access_tokens" runtime_log_thread=0 runtime_log_timestamp=1773665405442215
Mar 16 12:50:05 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:05.495172Z  INFO laser_warden::journal: Loading revoked access tokens from: local_data/state/tokens runtime_type="iggy" runtime_version="0.7.2-edge.1" runtime_log_level="INFO" runtime_log_module="server::http::jwt::storage" runtime_log_thread=0 runtime_log_timestamp=1773665405445416
Mar 16 12:50:05 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:05.495212Z  INFO laser_warden::journal: Loaded 2 revoked access tokens runtime_type="iggy" runtime_version="0.7.2-edge.1" runtime_log_level="INFO" runtime_log_module="server::http::jwt::storage" runtime_log_thread=0 runtime_log_timestamp=1773665405445539
Mar 16 12:50:05 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:05.495250Z  INFO laser_warden::journal: Revoked access token with ID: 019cf6b2-4a01-7a53-9378-a6fce70f0ff6 runtime_type="iggy" runtime_version="0.7.2-edge.1" runtime_log_level="INFO" runtime_log_module="server::http::jwt::jwt_manager" runtime_log_thread=0 runtime_log_timestamp=1773665405446879
Mar 16 12:50:05 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:05.495289Z  INFO laser_warden::journal: Loading revoked access tokens from: local_data/state/tokens runtime_type="iggy" runtime_version="0.7.2-edge.1" runtime_log_level="INFO" runtime_log_module="server::http::jwt::storage" runtime_log_thread=0 runtime_log_timestamp=1773665405486785
Mar 16 12:50:05 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:05.495328Z  INFO laser_warden::journal: Loaded 3 revoked access tokens runtime_type="iggy" runtime_version="0.7.2-edge.1" runtime_log_level="INFO" runtime_log_module="server::http::jwt::storage" runtime_log_thread=0 runtime_log_timestamp=1773665405486880
Mar 16 12:50:05 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:05.495367Z  INFO laser_warden::journal: Revoked access token with ID: 019cf6b2-4a2c-76e1-94cb-842c758413aa runtime_type="iggy" runtime_version="0.7.2-edge.1" runtime_log_level="INFO" runtime_log_module="server::http::jwt::jwt_manager" runtime_log_thread=0 runtime_log_timestamp=1773665405488639
Mar 16 12:50:05 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:05.546566Z  INFO laser_warden::iggy::credentials: Created prober stream: _ld
Mar 16 12:50:05 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:05.554742Z  INFO laser_warden::iggy::credentials: Created prober topic: prober in stream: _ld
Mar 16 12:50:05 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:05.557849Z  INFO laser_warden::iggy::service: Warden PAT file found: /etc/warden/credentials/warden.pat
Mar 16 12:50:05 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:05.566784Z  INFO laser_warden::iggy::service: Connected to iggy server via HTTP with PAT auth at http://127.0.0.1:3000
Mar 16 12:50:05 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:05.569697Z  INFO laser_warden::runtime::runner: Node: 610918396883632646 transitioning to active
Mar 16 12:50:05 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:05.569727Z  INFO laser_warden::runtime::runner: Starting iggy-connectors.service...
Mar 16 12:50:05 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:05.569763Z  INFO laser_warden::config: Fetching the Connectors Runtime config file...
Mar 16 12:50:05 ip-10-0-0-116 laser-warden[1409]: Fetching the primary config for node ID: 610918396883632646, kind: connectors...
Mar 16 12:50:05 ip-10-0-0-116 laser-warden[1409]: Fetched primary config for node ID: 610918396883632646, kind: connectors.
Mar 16 12:50:05 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:05.606272Z  INFO laser_warden::config: Created Connectors Runtime config file: /opt/connectors/connectors-0.3.2-edge.1/connectors.env
Mar 16 12:50:05 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:05.606814Z  INFO laser_warden::journal: Journal reader started for unit: iggy-connectors.service
Mar 16 12:50:05 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:05.606829Z  INFO laser_warden::runtime::runner: Journal reader started for: connectors
Mar 16 12:50:05 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:05.606843Z  INFO laser_warden::systemd: Starting systemd unit: iggy-connectors.service
Mar 16 12:50:05 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:05.618388Z  INFO laser_warden::runtime::runner: iggy-connectors.service is now active
Mar 16 12:50:05 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:05.636974Z  INFO laser_warden::journal:   ___                              ____                                         _ runtime_type="connectors" runtime_version="0.3.2-edge.1" runtime_log_level="INFO" runtime_log_module="" runtime_log_thread=0
Mar 16 12:50:05 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:05.637053Z  INFO laser_warden::journal:  |_ _|   __ _    __ _   _   _     / ___|   ___    _ __    _ __     ___    ___  | |_    ___    _ __   ___ runtime_type="connectors" runtime_version="0.3.2-edge.1" runtime_log_level="INFO" runtime_log_module="" runtime_log_thread=0
Mar 16 12:50:05 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:05.637094Z  INFO laser_warden::journal:   | |   / _` |  / _` | | | | |   | |      / _ \  | '_ \  | '_ \   / _ \  / __| | __|  / _ \  | '__| / __| runtime_type="connectors" runtime_version="0.3.2-edge.1" runtime_log_level="INFO" runtime_log_module="" runtime_log_thread=0
Mar 16 12:50:05 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:05.637136Z  INFO laser_warden::journal:   | |  | (_| | | (_| | | |_| |   | |___  | (_) | | | | | | | | | |  __/ | (__  | |_  | (_) | | |    \__ \ runtime_type="connectors" runtime_version="0.3.2-edge.1" runtime_log_level="INFO" runtime_log_module="" runtime_log_thread=0
Mar 16 12:50:05 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:05.637175Z  INFO laser_warden::journal:  |___|  \__, |  \__, |  \__, |    \____|  \___/  |_| |_| |_| |_|  \___|  \___|  \__|  \___/  |_|    |___/ runtime_type="connectors" runtime_version="0.3.2-edge.1" runtime_log_level="INFO" runtime_log_module="" runtime_log_thread=0
Mar 16 12:50:05 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:05.637216Z  INFO laser_warden::journal:         |___/   |___/   |___/ runtime_type="connectors" runtime_version="0.3.2-edge.1" runtime_log_level="INFO" runtime_log_module="" runtime_log_thread=0
Mar 16 12:50:05 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:05.637253Z  INFO laser_warden::journal: Starting Iggy Connectors Runtime, loading configuration from: core/connectors/runtime/config.toml... runtime_type="connectors" runtime_version="0.3.2-edge.1" runtime_log_level="INFO" runtime_log_module="" runtime_log_thread=0
Mar 16 12:50:05 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:05.637301Z  INFO laser_warden::journal: State will be stored in: /opt/connectors/state runtime_type="connectors" runtime_version="0.3.2-edge.1" runtime_log_level="INFO" runtime_log_module="iggy_connectors" runtime_log_thread=0 runtime_log_timestamp=1773665405635973
Mar 16 12:50:05 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:05.637345Z  INFO laser_warden::journal: Using token=PcD*** for Iggy authentication runtime_type="connectors" runtime_version="0.3.2-edge.1" runtime_log_level="INFO" runtime_log_module="iggy_connectors::stream" runtime_log_thread=0 runtime_log_timestamp=1773665405636032
Mar 16 12:50:05 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:05.637384Z  INFO laser_warden::journal: Iggy client is connecting to server: 127.0.0.1:8090... runtime_type="connectors" runtime_version="0.3.2-edge.1" runtime_log_level="INFO" runtime_log_module="iggy::tcp::tcp_client" runtime_log_thread=0 runtime_log_timestamp=1773665405636087
Mar 16 12:50:05 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:05.773037Z  INFO laser_warden::journal: Iggy client: 127.0.0.1:46654 has connected to server: 127.0.0.1:8090 at: 2026-03-16 12:50:05 runtime_type="connectors" runtime_version="0.3.2-edge.1" runtime_log_level="INFO" runtime_log_module="iggy::tcp::tcp_client" runtime_log_thread=0 runtime_log_timestamp=1773665405690987
Mar 16 12:50:05 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:05.773112Z  INFO laser_warden::journal: Iggy client: 127.0.0.1:46654 is signing in... runtime_type="connectors" runtime_version="0.3.2-edge.1" runtime_log_level="INFO" runtime_log_module="iggy::tcp::tcp_client" runtime_log_thread=0 runtime_log_timestamp=1773665405691033
Mar 16 12:50:05 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:05.773151Z  INFO laser_warden::journal: Iggy client: 127.0.0.1:46654 has signed in with a personal access token. runtime_type="connectors" runtime_version="0.3.2-edge.1" runtime_log_level="INFO" runtime_log_module="iggy::tcp::tcp_client" runtime_log_thread=0 runtime_log_timestamp=1773665405772718
Mar 16 12:50:05 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:05.773301Z  INFO laser_warden::journal: Saved stream with ID: 0. runtime_type="iggy" runtime_version="0.7.2-edge.1" runtime_log_level="INFO" runtime_log_module="server::streaming::streams::storage" runtime_log_thread=0 runtime_log_timestamp=1773665405544255
Mar 16 12:50:05 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:05.773360Z  INFO laser_warden::journal: Saved topic with ID: 0. for stream with ID: 0 runtime_type="iggy" runtime_version="0.7.2-edge.1" runtime_log_level="INFO" runtime_log_module="server::streaming::topics::storage" runtime_log_thread=0 runtime_log_timestamp=1773665405547212
Mar 16 12:50:05 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:05.773425Z  INFO laser_warden::journal: Saving partition with ID: 0 for stream with ID: 0 and topic with ID: 0... runtime_type="iggy" runtime_version="0.7.2-edge.1" runtime_log_level="INFO" runtime_log_module="server::streaming::partitions::storage" runtime_log_thread=0 runtime_log_timestamp=1773665405547308
Mar 16 12:50:05 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:05.773470Z  INFO laser_warden::journal: Saved partition with start ID: 0 for stream with ID: 0 and topic with ID: 0, path: local_data/streams/0/topics/0/partitions/0. runtime_type="iggy" runtime_version="0.7.2-edge.1" runtime_log_level="INFO" runtime_log_module="server::streaming::partitions::storage" runtime_log_thread=0 runtime_log_timestamp=1773665405547968
Mar 16 12:50:05 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:05.773523Z  INFO laser_warden::journal: Initializing partition in local_partitions: partition ID: 0 for topic ID: 0 for stream ID: 0 runtime_type="iggy" runtime_version="0.7.2-edge.1" runtime_log_level="INFO" runtime_log_module="server::shard::system::partitions" runtime_log_thread=0 runtime_log_timestamp=1773665405551647
Mar 16 12:50:05 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:05.773562Z  INFO laser_warden::journal: No segments found on disk for partition ID: 0 for topic ID: 0 for stream ID: 0, creating initial segment runtime_type="iggy" runtime_version="0.7.2-edge.1" runtime_log_level="INFO" runtime_log_module="server::shard::system::partitions" runtime_log_thread=0 runtime_log_timestamp=1773665405551848
Mar 16 12:50:05 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:05.773601Z  INFO laser_warden::journal: Initialized partition in local_partitions: partition ID: 0 for topic ID: 0 for stream ID: 0 with offset: 0 runtime_type="iggy" runtime_version="0.7.2-edge.1" runtime_log_level="INFO" runtime_log_module="server::shard::system::partitions" runtime_log_thread=0 runtime_log_timestamp=1773665405552009
Mar 16 12:50:05 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:05.773640Z  INFO laser_warden::journal: Loading revoked access tokens from: local_data/state/tokens runtime_type="iggy" runtime_version="0.7.2-edge.1" runtime_log_level="INFO" runtime_log_module="server::http::jwt::storage" runtime_log_thread=0 runtime_log_timestamp=1773665405555074
Mar 16 12:50:05 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:05.773675Z  INFO laser_warden::journal: Loaded 4 revoked access tokens runtime_type="iggy" runtime_version="0.7.2-edge.1" runtime_log_level="INFO" runtime_log_module="server::http::jwt::storage" runtime_log_thread=0 runtime_log_timestamp=1773665405555259
Mar 16 12:50:05 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:05.773714Z  INFO laser_warden::journal: Revoked access token with ID: 019cf6b2-4a67-73e0-b07f-304b145e4151 runtime_type="iggy" runtime_version="0.7.2-edge.1" runtime_log_level="INFO" runtime_log_module="server::http::jwt::jwt_manager" runtime_log_thread=0 runtime_log_timestamp=1773665405557357
Mar 16 12:50:05 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:05.773752Z  INFO laser_warden::journal: Accepted new TCP connection for TLS handshake: 127.0.0.1:46654 runtime_type="iggy" runtime_version="0.7.2-edge.1" runtime_log_level="INFO" runtime_log_module="server::tcp::tcp_tls_listener" runtime_log_thread=0 runtime_log_timestamp=1773665405636307
Mar 16 12:50:05 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:05.773806Z  INFO laser_warden::journal: TLS handshake successful, adding TCP client: 127.0.0.1:46654 runtime_type="iggy" runtime_version="0.7.2-edge.1" runtime_log_level="INFO" runtime_log_module="server::tcp::tcp_tls_listener" runtime_log_thread=0 runtime_log_timestamp=1773665405731723
Mar 16 12:50:05 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:05.773851Z  INFO laser_warden::journal: Added tcp client with session: client ID: 1015318102, IP address: 127.0.0.1:46654 for IP address: 127.0.0.1:46654 runtime_type="iggy" runtime_version="0.7.2-edge.1" runtime_log_level="INFO" runtime_log_module="server::tcp::tcp_tls_listener" runtime_log_thread=0 runtime_log_timestamp=1773665405732054
Mar 16 12:50:05 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:05.773889Z  INFO laser_warden::journal: Created new session: client ID: 1015318102, IP address: 127.0.0.1:46654 runtime_type="iggy" runtime_version="0.7.2-edge.1" runtime_log_level="INFO" runtime_log_module="server::tcp::tcp_tls_listener" runtime_log_thread=0 runtime_log_timestamp=1773665405732068
Mar 16 12:50:05 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:05.908885Z  WARN laser_warden::runtime::runner: Health check failed. Health check failed: Connectors health check failed. error sending request for url (http://127.0.0.1:8081/health)
Mar 16 12:50:06 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:06.273112Z  INFO laser_warden::journal: Accepted new TCP connection for TLS handshake: 127.0.0.1:46658 runtime_type="iggy" runtime_version="0.7.2-edge.1" runtime_log_level="INFO" runtime_log_module="server::tcp::tcp_tls_listener" runtime_log_thread=0 runtime_log_timestamp=1773665405813998
Mar 16 12:50:06 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:06.273200Z  INFO laser_warden::journal: TLS handshake successful, adding TCP client: 127.0.0.1:46658 runtime_type="iggy" runtime_version="0.7.2-edge.1" runtime_log_level="INFO" runtime_log_module="server::tcp::tcp_tls_listener" runtime_log_thread=0 runtime_log_timestamp=1773665405859731
Mar 16 12:50:06 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:06.273239Z  INFO laser_warden::journal: Added tcp client with session: client ID: 2804267367, IP address: 127.0.0.1:46658 for IP address: 127.0.0.1:46658 runtime_type="iggy" runtime_version="0.7.2-edge.1" runtime_log_level="INFO" runtime_log_module="server::tcp::tcp_tls_listener" runtime_log_thread=0 runtime_log_timestamp=1773665405859775
Mar 16 12:50:06 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:06.273275Z  INFO laser_warden::journal: Created new session: client ID: 2804267367, IP address: 127.0.0.1:46658 runtime_type="iggy" runtime_version="0.7.2-edge.1" runtime_log_level="INFO" runtime_log_module="server::tcp::tcp_tls_listener" runtime_log_thread=0 runtime_log_timestamp=1773665405859787
Mar 16 12:50:06 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:06.273112Z  INFO laser_warden::journal: Using token=PcD*** for Iggy authentication runtime_type="connectors" runtime_version="0.3.2-edge.1" runtime_log_level="INFO" runtime_log_module="iggy_connectors::stream" runtime_log_thread=0 runtime_log_timestamp=1773665405813802
Mar 16 12:50:06 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:06.273338Z  INFO laser_warden::journal: Iggy client is connecting to server: 127.0.0.1:8090... runtime_type="connectors" runtime_version="0.3.2-edge.1" runtime_log_level="INFO" runtime_log_module="iggy::tcp::tcp_client" runtime_log_thread=0 runtime_log_timestamp=1773665405813846
Mar 16 12:50:06 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:06.273377Z  INFO laser_warden::journal: Iggy client: 127.0.0.1:46658 has connected to server: 127.0.0.1:8090 at: 2026-03-16 12:50:05 runtime_type="connectors" runtime_version="0.3.2-edge.1" runtime_log_level="INFO" runtime_log_module="iggy::tcp::tcp_client" runtime_log_thread=0 runtime_log_timestamp=1773665405819797
Mar 16 12:50:06 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:06.273415Z  INFO laser_warden::journal: Iggy client: 127.0.0.1:46658 is signing in... runtime_type="connectors" runtime_version="0.3.2-edge.1" runtime_log_level="INFO" runtime_log_module="iggy::tcp::tcp_client" runtime_log_thread=0 runtime_log_timestamp=1773665405819827
Mar 16 12:50:06 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:06.273462Z  INFO laser_warden::journal: Iggy client: 127.0.0.1:46658 has signed in with a personal access token. runtime_type="connectors" runtime_version="0.3.2-edge.1" runtime_log_level="INFO" runtime_log_module="iggy::tcp::tcp_client" runtime_log_thread=0 runtime_log_timestamp=1773665405900642
Mar 16 12:50:06 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:06.273516Z  INFO laser_warden::journal: Found 0 source and 0 sink configurations. runtime_type="connectors" runtime_version="0.3.2-edge.1" runtime_log_level="INFO" runtime_log_module="iggy_connectors" runtime_log_thread=0 runtime_log_timestamp=1773665405949301
Mar 16 12:50:06 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:06.273554Z  INFO laser_warden::journal: All sources and sinks spawned. runtime_type="connectors" runtime_version="0.3.2-edge.1" runtime_log_level="INFO" runtime_log_module="iggy_connectors" runtime_log_thread=0 runtime_log_timestamp=1773665405949397
Mar 16 12:50:06 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:06.273592Z  INFO laser_warden::journal: Started iggy-connectors HTTP API on: 127.0.0.1:8081 runtime_type="connectors" runtime_version="0.3.2-edge.1" runtime_log_level="INFO" runtime_log_module="iggy_connectors::api" runtime_log_thread=0 runtime_log_timestamp=1773665405949595
Mar 16 12:50:07 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:07.580926Z  INFO laser_warden::heartbeats: Sent 7 heartbeats for node ID: 610918396883632646.
Mar 16 12:50:07 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:07.595567Z  INFO laser_warden::metrics: Sent 3 metrics for node ID: 610918396883632646.
Mar 16 12:50:07 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:07.883031Z  INFO laser_warden::tasks: Fetching tasks for node ID: 610918396883632646...
Mar 16 12:50:07 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:07.915782Z  INFO laser_warden::tasks: Fetched tasks for node ID: 610918396883632646.
Mar 16 12:50:12 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:12.573564Z  INFO laser_warden::heartbeats: Sent 3 heartbeats for node ID: 610918396883632646.
Mar 16 12:50:12 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:12.574018Z  INFO laser_warden::metrics: Sent 6 metrics for node ID: 610918396883632646.
Mar 16 12:50:12 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:12.883506Z  INFO laser_warden::tasks: Fetching tasks for node ID: 610918396883632646...
Mar 16 12:50:12 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:12.914161Z  INFO laser_warden::tasks: Fetched tasks for node ID: 610918396883632646.
Mar 16 12:50:14 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:14.385064Z  INFO laser_warden::journal: CPU: 0.00%/0.46% (IggyUsage/Total), Mem: 48.97%/95.46 MB/487.73 MB/955.73 MB (Free/IggyUsage/TotalUsed/Total), Clients: 2, Messages: 0, Read: 3.23 MB, Written: 102.40 KB, OpenFDs: 191 runtime_type="iggy" runtime_version="0.7.2-edge.1" runtime_log_level="INFO" runtime_log_module="server::shard::tasks::periodic::sysinfo_printer" runtime_log_thread=0 runtime_log_timestamp=1773665414074034
Mar 16 12:50:15 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:15.886593Z  INFO laser_warden::journal: Accepted new TCP connection for TLS handshake: 127.0.0.1:53550 runtime_type="iggy" runtime_version="0.7.2-edge.1" runtime_log_level="INFO" runtime_log_module="server::tcp::tcp_tls_listener" runtime_log_thread=0 runtime_log_timestamp=1773665415769997
Mar 16 12:50:15 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:15.886677Z  INFO laser_warden::journal: TLS handshake successful, adding TCP client: 127.0.0.1:53550 runtime_type="iggy" runtime_version="0.7.2-edge.1" runtime_log_level="INFO" runtime_log_module="server::tcp::tcp_tls_listener" runtime_log_thread=0 runtime_log_timestamp=1773665415816736
Mar 16 12:50:15 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:15.886727Z  INFO laser_warden::journal: Added tcp client with session: client ID: 2903613313, IP address: 127.0.0.1:53550 for IP address: 127.0.0.1:53550 runtime_type="iggy" runtime_version="0.7.2-edge.1" runtime_log_level="INFO" runtime_log_module="server::tcp::tcp_tls_listener" runtime_log_thread=0 runtime_log_timestamp=1773665415816770
Mar 16 12:50:15 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:15.886768Z  INFO laser_warden::journal: Created new session: client ID: 2903613313, IP address: 127.0.0.1:53550 runtime_type="iggy" runtime_version="0.7.2-edge.1" runtime_log_level="INFO" runtime_log_module="server::tcp::tcp_tls_listener" runtime_log_thread=0 runtime_log_timestamp=1773665415816777
Mar 16 12:50:17 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:17.572751Z  INFO laser_warden::heartbeats: Sent 3 heartbeats for node ID: 610918396883632646.
Mar 16 12:50:17 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:17.574309Z  INFO laser_warden::metrics: Sent 3 metrics for node ID: 610918396883632646.
Mar 16 12:50:17 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:17.883795Z  INFO laser_warden::tasks: Fetching tasks for node ID: 610918396883632646...
Mar 16 12:50:17 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:17.915375Z  INFO laser_warden::tasks: Fetched tasks for node ID: 610918396883632646.
Mar 16 12:50:20 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:20.971695Z  INFO laser_warden::journal: Accepted new TCP connection for TLS handshake: 109.243.3.168:15628 runtime_type="iggy" runtime_version="0.7.2-edge.1" runtime_log_level="INFO" runtime_log_module="server::tcp::tcp_tls_listener" runtime_log_thread=0 runtime_log_timestamp=1773665420702395
Mar 16 12:50:20 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:20.971768Z  INFO laser_warden::journal: TLS handshake successful, adding TCP client: 109.243.3.168:15628 runtime_type="iggy" runtime_version="0.7.2-edge.1" runtime_log_level="INFO" runtime_log_module="server::tcp::tcp_tls_listener" runtime_log_thread=0 runtime_log_timestamp=1773665420933938
Mar 16 12:50:20 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:20.971810Z  INFO laser_warden::journal: Added tcp client with session: client ID: 3323741115, IP address: 109.243.3.168:15628 for IP address: 109.243.3.168:15628 runtime_type="iggy" runtime_version="0.7.2-edge.1" runtime_log_level="INFO" runtime_log_module="server::tcp::tcp_tls_listener" runtime_log_thread=0 runtime_log_timestamp=1773665420933975
Mar 16 12:50:20 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:20.971853Z  INFO laser_warden::journal: Created new session: client ID: 3323741115, IP address: 109.243.3.168:15628 runtime_type="iggy" runtime_version="0.7.2-edge.1" runtime_log_level="INFO" runtime_log_module="server::tcp::tcp_tls_listener" runtime_log_thread=0 runtime_log_timestamp=1773665420933995
Mar 16 12:50:20 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:20.971989Z  INFO laser_warden::journal: server::binary::handlers::users::login_user_handler: Logging in user: root ... runtime_type="iggy" runtime_version="0.7.2-edge.1" runtime_log_level="INFO" runtime_log_module="iggy_client_id=3323741115}" runtime_log_thread=0 runtime_log_timestamp=1773665420934028
Mar 16 12:50:20 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:20.972037Z  INFO laser_warden::journal: server::binary::handlers::users::login_user_handler: Logged in user: root with ID: 0. runtime_type="iggy" runtime_version="0.7.2-edge.1" runtime_log_level="INFO" runtime_log_module="iggy_client_id=3323741115}" runtime_log_thread=0 runtime_log_timestamp=1773665420971273
Mar 16 12:50:22 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:22.273204Z  INFO laser_warden::journal: Saved stream with ID: 1. runtime_type="iggy" runtime_version="0.7.2-edge.1" runtime_log_level="INFO" runtime_log_module="server::streaming::streams::storage" runtime_log_thread=0 runtime_log_timestamp=1773665421928641
Mar 16 12:50:22 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:22.572620Z  INFO laser_warden::heartbeats: Sent 3 heartbeats for node ID: 610918396883632646.
Mar 16 12:50:22 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:22.572830Z  INFO laser_warden::metrics: Sent 6 metrics for node ID: 610918396883632646.
Mar 16 12:50:22 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:22.573068Z  INFO laser_warden::journal: Saved topic with ID: 0. for stream with ID: 1 runtime_type="iggy" runtime_version="0.7.2-edge.1" runtime_log_level="INFO" runtime_log_module="server::streaming::topics::storage" runtime_log_thread=0 runtime_log_timestamp=1773665422300689
Mar 16 12:50:22 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:22.573135Z  INFO laser_warden::journal: Saving partition with ID: 0 for stream with ID: 1 and topic with ID: 0... runtime_type="iggy" runtime_version="0.7.2-edge.1" runtime_log_level="INFO" runtime_log_module="server::streaming::partitions::storage" runtime_log_thread=0 runtime_log_timestamp=1773665422300794
Mar 16 12:50:22 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:22.573179Z  INFO laser_warden::journal: Saved partition with start ID: 0 for stream with ID: 1 and topic with ID: 0, path: local_data/streams/1/topics/0/partitions/0. runtime_type="iggy" runtime_version="0.7.2-edge.1" runtime_log_level="INFO" runtime_log_module="server::streaming::partitions::storage" runtime_log_thread=0 runtime_log_timestamp=1773665422300981
Mar 16 12:50:22 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:22.573219Z  INFO laser_warden::journal: Initializing partition in local_partitions: partition ID: 0 for topic ID: 0 for stream ID: 1 runtime_type="iggy" runtime_version="0.7.2-edge.1" runtime_log_level="INFO" runtime_log_module="server::shard::system::partitions" runtime_log_thread=0 runtime_log_timestamp=1773665422301057
Mar 16 12:50:22 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:22.573258Z  INFO laser_warden::journal: No segments found on disk for partition ID: 0 for topic ID: 0 for stream ID: 1, creating initial segment runtime_type="iggy" runtime_version="0.7.2-edge.1" runtime_log_level="INFO" runtime_log_module="server::shard::system::partitions" runtime_log_thread=0 runtime_log_timestamp=1773665422301238
Mar 16 12:50:22 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:22.573293Z  INFO laser_warden::journal: Initialized partition in local_partitions: partition ID: 0 for topic ID: 0 for stream ID: 1 with offset: 0 runtime_type="iggy" runtime_version="0.7.2-edge.1" runtime_log_level="INFO" runtime_log_module="server::shard::system::partitions" runtime_log_thread=0 runtime_log_timestamp=1773665422301382
Mar 16 12:50:22 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:22.883815Z  INFO laser_warden::tasks: Fetching tasks for node ID: 610918396883632646...
Mar 16 12:50:22 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:22.916793Z  INFO laser_warden::tasks: Fetched tasks for node ID: 610918396883632646.
Mar 16 12:50:24 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:24.274297Z  INFO laser_warden::journal: CPU: 0.00%/1.17% (IggyUsage/Total), Mem: 49.08%/95.69 MB/486.66 MB/955.73 MB (Free/IggyUsage/TotalUsed/Total), Clients: 4, Messages: 202, Read: 3.23 MB, Written: 114.69 KB, OpenFDs: 197 runtime_type="iggy" runtime_version="0.7.2-edge.1" runtime_log_level="INFO" runtime_log_module="server::shard::tasks::periodic::sysinfo_printer" runtime_log_thread=0 runtime_log_timestamp=1773665424074629
Mar 16 12:50:27 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:27.573038Z  INFO laser_warden::heartbeats: Sent 3 heartbeats for node ID: 610918396883632646.
Mar 16 12:50:27 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:27.573720Z  INFO laser_warden::metrics: Sent 6 metrics for node ID: 610918396883632646.
Mar 16 12:50:27 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:27.883210Z  INFO laser_warden::tasks: Fetching tasks for node ID: 610918396883632646...
Mar 16 12:50:27 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:27.915398Z  INFO laser_warden::tasks: Fetched tasks for node ID: 610918396883632646.
Mar 16 12:50:29 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:29.023181Z  INFO laser_warden::journal: Deleted tcp client with ID: 3323741115 for IP address: 109.243.3.168:15628 runtime_type="iggy" runtime_version="0.7.2-edge.1" runtime_log_level="INFO" runtime_log_module="server::shard::system::clients" runtime_log_thread=0 runtime_log_timestamp=1773665428689226
Mar 16 12:50:29 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:29.023284Z  INFO laser_warden::journal: Successfully closed TCP TLS stream for client: 3323741115, address: 109.243.3.168:15628. runtime_type="iggy" runtime_version="0.7.2-edge.1" runtime_log_level="INFO" runtime_log_module="server::tcp::tcp_tls_listener" runtime_log_thread=0 runtime_log_timestamp=1773665428689359
Mar 16 12:50:32 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:32.576148Z  INFO laser_warden::metrics: Sent 3 metrics for node ID: 610918396883632646.
Mar 16 12:50:32 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:32.599149Z  INFO laser_warden::heartbeats: Sent 3 heartbeats for node ID: 610918396883632646.
Mar 16 12:50:32 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:32.883686Z  INFO laser_warden::tasks: Fetching tasks for node ID: 610918396883632646...
Mar 16 12:50:32 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:32.914955Z  INFO laser_warden::tasks: Fetched tasks for node ID: 610918396883632646.
Mar 16 12:50:34 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:34.274307Z  INFO laser_warden::journal: CPU: 0.00%/0.42% (IggyUsage/Total), Mem: 49.11%/95.69 MB/486.38 MB/955.73 MB (Free/IggyUsage/TotalUsed/Total), Clients: 3, Messages: 1k, Read: 3.23 MB, Written: 118.78 KB, OpenFDs: 196 runtime_type="iggy" runtime_version="0.7.2-edge.1" runtime_log_level="INFO" runtime_log_module="server::shard::tasks::periodic::sysinfo_printer" runtime_log_thread=0 runtime_log_timestamp=1773665434075216
Mar 16 12:50:34 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:34.274416Z  INFO laser_warden::journal: Flushed 2 partitions. runtime_type="iggy" runtime_version="0.7.2-edge.1" runtime_log_level="INFO" runtime_log_module="server::shard::tasks::periodic::message_saver" runtime_log_thread=0 runtime_log_timestamp=1773665434088574
Mar 16 12:50:35 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:35.214191Z  INFO laser_warden::journal: Accepted new TCP connection for TLS handshake: 109.243.3.168:15649 runtime_type="iggy" runtime_version="0.7.2-edge.1" runtime_log_level="INFO" runtime_log_module="server::tcp::tcp_tls_listener" runtime_log_thread=0 runtime_log_timestamp=1773665434936784
Mar 16 12:50:35 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:35.523188Z  INFO laser_warden::journal: TLS handshake successful, adding TCP client: 109.243.3.168:15649 runtime_type="iggy" runtime_version="0.7.2-edge.1" runtime_log_level="INFO" runtime_log_module="server::tcp::tcp_tls_listener" runtime_log_thread=0 runtime_log_timestamp=1773665435213818
Mar 16 12:50:35 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:35.523301Z  INFO laser_warden::journal: Added tcp client with session: client ID: 218821652, IP address: 109.243.3.168:15649 for IP address: 109.243.3.168:15649 runtime_type="iggy" runtime_version="0.7.2-edge.1" runtime_log_level="INFO" runtime_log_module="server::tcp::tcp_tls_listener" runtime_log_thread=0 runtime_log_timestamp=1773665435213911
Mar 16 12:50:35 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:35.523346Z  INFO laser_warden::journal: Created new session: client ID: 218821652, IP address: 109.243.3.168:15649 runtime_type="iggy" runtime_version="0.7.2-edge.1" runtime_log_level="INFO" runtime_log_module="server::tcp::tcp_tls_listener" runtime_log_thread=0 runtime_log_timestamp=1773665435213919
Mar 16 12:50:35 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:35.523392Z  INFO laser_warden::journal: server::binary::handlers::users::login_user_handler: Logging in user: root ... runtime_type="iggy" runtime_version="0.7.2-edge.1" runtime_log_level="INFO" runtime_log_module="iggy_client_id=218821652}" runtime_log_thread=0 runtime_log_timestamp=1773665435214699
Mar 16 12:50:35 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:35.523430Z  INFO laser_warden::journal: server::binary::handlers::users::login_user_handler: Logged in user: root with ID: 0. runtime_type="iggy" runtime_version="0.7.2-edge.1" runtime_log_level="INFO" runtime_log_module="iggy_client_id=218821652}" runtime_log_thread=0 runtime_log_timestamp=1773665435253980
Mar 16 12:50:37 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:37.571665Z  INFO laser_warden::heartbeats: Sent 3 heartbeats for node ID: 610918396883632646.
Mar 16 12:50:37 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:37.572459Z  INFO laser_warden::metrics: Sent 6 metrics for node ID: 610918396883632646.
Mar 16 12:50:37 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:37.882977Z  INFO laser_warden::tasks: Fetching tasks for node ID: 610918396883632646...
Mar 16 12:50:37 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:37.915106Z  INFO laser_warden::tasks: Fetched tasks for node ID: 610918396883632646.
Mar 16 12:50:42 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:42.572061Z  INFO laser_warden::heartbeats: Sent 3 heartbeats for node ID: 610918396883632646.
Mar 16 12:50:42 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:42.689530Z  INFO laser_warden::metrics: Sent 6 metrics for node ID: 610918396883632646.
Mar 16 12:50:42 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:42.882995Z  INFO laser_warden::tasks: Fetching tasks for node ID: 610918396883632646...
Mar 16 12:50:42 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:42.883358Z  INFO laser_warden::journal: Deleted tcp client with ID: 218821652 for IP address: 109.243.3.168:15649 runtime_type="iggy" runtime_version="0.7.2-edge.1" runtime_log_level="INFO" runtime_log_module="server::shard::system::clients" runtime_log_thread=0 runtime_log_timestamp=1773665442675764
Mar 16 12:50:42 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:42.883421Z  INFO laser_warden::journal: Successfully closed TCP TLS stream for client: 218821652, address: 109.243.3.168:15649. runtime_type="iggy" runtime_version="0.7.2-edge.1" runtime_log_level="INFO" runtime_log_module="server::tcp::tcp_tls_listener" runtime_log_thread=0 runtime_log_timestamp=1773665442675859
Mar 16 12:50:42 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:42.916907Z  INFO laser_warden::tasks: Fetched tasks for node ID: 610918396883632646.
Mar 16 12:50:44 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:44.274264Z  INFO laser_warden::journal: CPU: 0.00%/0.46% (IggyUsage/Total), Mem: 46.92%/116.66 MB/507.27 MB/955.73 MB (Free/IggyUsage/TotalUsed/Total), Clients: 3, Messages: 1k, Read: 3.23 MB, Written: 614.40 KB, OpenFDs: 196 runtime_type="iggy" runtime_version="0.7.2-edge.1" runtime_log_level="INFO" runtime_log_module="server::shard::tasks::periodic::sysinfo_printer" runtime_log_thread=0 runtime_log_timestamp=1773665444075878
Mar 16 12:50:47 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:47.572853Z  INFO laser_warden::heartbeats: Sent 3 heartbeats for node ID: 610918396883632646.
Mar 16 12:50:47 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:47.573158Z  INFO laser_warden::metrics: Sent 3 metrics for node ID: 610918396883632646.
Mar 16 12:50:47 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:47.883648Z  INFO laser_warden::tasks: Fetching tasks for node ID: 610918396883632646...
Mar 16 12:50:47 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:47.917870Z  INFO laser_warden::tasks: Fetched tasks for node ID: 610918396883632646.
Mar 16 12:50:52 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:52.572561Z  INFO laser_warden::heartbeats: Sent 3 heartbeats for node ID: 610918396883632646.
Mar 16 12:50:52 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:52.572843Z  INFO laser_warden::metrics: Sent 6 metrics for node ID: 610918396883632646.
Mar 16 12:50:52 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:52.883319Z  INFO laser_warden::tasks: Fetching tasks for node ID: 610918396883632646...
Mar 16 12:50:52 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:52.915837Z  INFO laser_warden::tasks: Fetched tasks for node ID: 610918396883632646.
Mar 16 12:50:54 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:54.274324Z  INFO laser_warden::journal: CPU: 0.00%/0.33% (IggyUsage/Total), Mem: 46.92%/116.66 MB/507.27 MB/955.73 MB (Free/IggyUsage/TotalUsed/Total), Clients: 3, Messages: 1k, Read: 3.23 MB, Written: 618.50 KB, OpenFDs: 196 runtime_type="iggy" runtime_version="0.7.2-edge.1" runtime_log_level="INFO" runtime_log_module="server::shard::tasks::periodic::sysinfo_printer" runtime_log_thread=0 runtime_log_timestamp=1773665454076597
Mar 16 12:50:57 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:57.573836Z  INFO laser_warden::heartbeats: Sent 3 heartbeats for node ID: 610918396883632646.
Mar 16 12:50:57 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:57.574361Z  INFO laser_warden::metrics: Sent 6 metrics for node ID: 610918396883632646.
Mar 16 12:50:57 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:57.883837Z  INFO laser_warden::tasks: Fetching tasks for node ID: 610918396883632646...
Mar 16 12:50:57 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:50:57.915821Z  INFO laser_warden::tasks: Fetched tasks for node ID: 610918396883632646.
Mar 16 12:51:02 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:51:02.604180Z  INFO laser_warden::heartbeats: Sent 3 heartbeats for node ID: 610918396883632646.
Mar 16 12:51:02 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:51:02.604582Z  INFO laser_warden::metrics: Sent 3 metrics for node ID: 610918396883632646.
Mar 16 12:51:02 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:51:02.883053Z  INFO laser_warden::tasks: Fetching tasks for node ID: 610918396883632646...
Mar 16 12:51:02 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:51:02.920533Z  INFO laser_warden::tasks: Fetched tasks for node ID: 610918396883632646.
Mar 16 12:51:02 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:51:02.920679Z  INFO laser_warden::tasks: Task signature verified for task: warden:snapshot ID: 610918598612943366
Mar 16 12:51:02 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:51:02.920989Z  INFO laser_warden::tasks: Task ID: 610918598612943366 persisted to disk at /etc/warden/task.toml
Mar 16 12:51:02 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:51:02.921012Z  INFO laser_warden::tasks: New task: warden:snapshot ID: 610918598612943366 has been received for node ID: 610918396883632646
Mar 16 12:51:04 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:51:04.274299Z  INFO laser_warden::journal: CPU: 0.00%/0.84% (IggyUsage/Total), Mem: 46.92%/116.66 MB/507.27 MB/955.73 MB (Free/IggyUsage/TotalUsed/Total), Clients: 3, Messages: 1k, Read: 3.23 MB, Written: 618.50 KB, OpenFDs: 196 runtime_type="iggy" runtime_version="0.7.2-edge.1" runtime_log_level="INFO" runtime_log_module="server::shard::tasks::periodic::sysinfo_printer" runtime_log_thread=0 runtime_log_timestamp=1773665464077149
Mar 16 12:51:04 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:51:04.274385Z  INFO laser_warden::journal: Flushed 1 partitions. runtime_type="iggy" runtime_version="0.7.2-edge.1" runtime_log_level="INFO" runtime_log_module="server::shard::tasks::periodic::message_saver" runtime_log_thread=0 runtime_log_timestamp=1773665464093861
Mar 16 12:51:05 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:51:05.887353Z  INFO laser_warden::runtime::runner: Processing warden task: warden:snapshot ID: 610918598612943366
Mar 16 12:51:05 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:51:05.887519Z  INFO laser_warden::tasks: Task ID: 610918598612943366 persisted to disk at /etc/warden/task.toml
Mar 16 12:51:05 ip-10-0-0-116 laser-warden[1409]: 2026-03-16T12:51:05.887670Z  INFO laser_warden::internal::snapshot: Starting debug snapshot for node ID: 610918396883632646, include Iggy, redact secrets
Mar 16 12:51:06 ip-10-0-0-116 systemd[1]: warden.service: Got notification message from PID 1535, but reception only permitted for main PID 1409
Mar 16 12:51:06 ip-10-0-0-116 systemd[1]: warden.service: Got notification message from PID 1634, but reception only permitted for main PID 1409
Mar 16 12:51:06 ip-10-0-0-116 systemd[1]: warden.service: Got notification message from PID 1656, but reception only permitted for main PID 1409
Mar 16 12:51:06 ip-10-0-0-116 systemd[1]: warden.service: Got notification message from PID 1695, but reception only permitted for main PID 1409
Mar 16 12:51:06 ip-10-0-0-116 systemd[1]: warden.service: Got notification message from PID 1686, but reception only permitted for main PID 1409
Mar 16 12:51:06 ip-10-0-0-116 systemd[1]: warden.service: Got notification message from PID 1736, but reception only permitted for main PID 1409
Mar 16 12:51:06 ip-10-0-0-116 systemd[1]: warden.service: Got notification message from PID 1738, but reception only permitted for main PID 1409
Mar 16 12:51:06 ip-10-0-0-116 systemd[1]: warden.service: Got notification message from PID 1712, but reception only permitted for main PID 1409
Mar 16 12:51:06 ip-10-0-0-116 systemd[1]: warden.service: Got notification message from PID 1696, but reception only permitted for main PID 1409
Mar 16 12:51:06 ip-10-0-0-116 systemd[1]: warden.service: Got notification message from PID 1703, but reception only permitted for main PID 1409
Mar 16 12:51:06 ip-10-0-0-116 systemd[1]: warden.service: Got notification message from PID 1698, but reception only permitted for main PID 1409
Mar 16 12:51:06 ip-10-0-0-116 systemd[1]: warden.service: Got notification message from PID 1745, but reception only permitted for main PID 1409
Mar 16 12:51:06 ip-10-0-0-116 systemd[1]: warden.service: Got notification message from PID 1718, but reception only permitted for main PID 1409
Mar 16 12:51:06 ip-10-0-0-116 systemd[1]: warden.service: Got notification message from PID 1733, but reception only permitted for main PID 1409
Mar 16 12:51:06 ip-10-0-0-116 systemd[1]: warden.service: Got notification message from PID 1740, but reception only permitted for main PID 1409
Mar 16 12:51:06 ip-10-0-0-116 systemd[1]: warden.service: Got notification message from PID 1752, but reception only permitted for main PID 1409
Mar 16 12:51:06 ip-10-0-0-116 systemd[1]: warden.service: Got notification message from PID 1742, but reception only permitted for main PID 1409
Mar 16 12:51:06 ip-10-0-0-116 systemd[1]: warden.service: Got notification message from PID 1772, but reception only permitted for main PID 1409
Mar 16 12:51:06 ip-10-0-0-116 systemd[1]: warden.service: Got notification message from PID 1800, but reception only permitted for main PID 1409
Mar 16 12:51:06 ip-10-0-0-116 systemd[1]: warden.service: Got notification message from PID 1746, but reception only permitted for main PID 1409
Mar 16 12:51:06 ip-10-0-0-116 systemd[1]: warden.service: Got notification message from PID 1816, but reception only permitted for main PID 1409
Mar 16 12:51:06 ip-10-0-0-116 systemd[1]: warden.service: Got notification message from PID 1687, but reception only permitted for main PID 1409
Mar 16 12:51:06 ip-10-0-0-116 systemd[1]: warden.service: Got notification message from PID 1859, but reception only permitted for main PID 1409
Mar 16 12:51:06 ip-10-0-0-116 systemd[1]: warden.service: Got notification message from PID 1848, but reception only permitted for main PID 1409
Mar 16 12:51:06 ip-10-0-0-116 systemd[1]: warden.service: Got notification message from PID 1851, but reception only permitted for main PID 1409
Mar 16 12:51:06 ip-10-0-0-116 systemd[1]: warden.service: Got notification message from PID 1855, but reception only permitted for main PID 1409
Mar 16 12:51:06 ip-10-0-0-116 systemd[1]: warden.service: Got notification message from PID 1907, but reception only permitted for main PID 1409
Warden errors only (last 24h)
-- No entries --

Iggy Logs2 entries

journalctl -u iggy-server (last 2000 lines)
Mar 16 12:50:02 ip-10-0-0-116 systemd[1]: Started iggy-server.service - Iggy Server.
Mar 16 12:50:02 ip-10-0-0-116 iggy-server[1482]:   ___                             ____
Mar 16 12:50:02 ip-10-0-0-116 iggy-server[1482]:  |_ _|   __ _    __ _   _   _    / ___|    ___   _ __  __   __   ___   _ __
Mar 16 12:50:02 ip-10-0-0-116 iggy-server[1482]:   | |   / _` |  / _` | | | | |   \___ \   / _ \ | '__| \ \ / /  / _ \ | '__|
Mar 16 12:50:02 ip-10-0-0-116 iggy-server[1482]:   | |  | (_| | | (_| | | |_| |    ___) | |  __/ | |     \ V /  |  __/ | |
Mar 16 12:50:02 ip-10-0-0-116 iggy-server[1482]:  |___|  \__, |  \__, |  \__, |   |____/   \___| |_|      \_/    \___| |_|
Mar 16 12:50:02 ip-10-0-0-116 iggy-server[1482]:         |___/   |___/   |___/
Mar 16 12:50:02 ip-10-0-0-116 iggy-server[1482]: 2026-03-16T12:50:02.886270Z  INFO main server::log::logger: It seems that you are a developer. Environment variable IGGY_CI_BUILD is not set to 'true', skipping build info print.
Mar 16 12:50:02 ip-10-0-0-116 iggy-server[1482]: 2026-03-16T12:50:02.886464Z  INFO main configs::configs_impl::file_provider: Loading config from path: 'core/server/config.toml'...
Mar 16 12:50:02 ip-10-0-0-116 iggy-server[1482]: 2026-03-16T12:50:02.886853Z  WARN main configs::configs_impl::file_provider: Configuration file not found at path: 'core/server/config.toml'.
Mar 16 12:50:02 ip-10-0-0-116 iggy-server[1482]: 2026-03-16T12:50:02.886860Z  INFO main configs::configs_impl::file_provider: Using default configuration embedded into server, as no config file was found.
Mar 16 12:50:02 ip-10-0-0-116 iggy-server[1482]: 2026-03-16T12:50:02.888524Z  WARN main configs::configs_impl::typed_env_provider: Unknown environment variable 'IGGY_ENCRYPTION_ENABLED' will be ignored. Similar variables: IGGY_SYSTEM_ENCRYPTION_ENABLED?
Mar 16 12:50:02 ip-10-0-0-116 iggy-server[1482]: 2026-03-16T12:50:02.889459Z  WARN main configs::configs_impl::typed_env_provider: Unknown environment variable 'IGGY_ENCRYPTION_KEY' will be ignored. Similar variables: IGGY_SYSTEM_ENCRYPTION_KEY?
Mar 16 12:50:02 ip-10-0-0-116 iggy-server[1482]: 2026-03-16T12:50:02.889511Z  INFO main configs::configs_impl::typed_env_provider: IGGY_CONSUMER_GROUP_REBALANCING_TIMEOUT value changed to: 30 s from environment variable
Mar 16 12:50:02 ip-10-0-0-116 iggy-server[1482]: 2026-03-16T12:50:02.889528Z  INFO main configs::configs_impl::typed_env_provider: IGGY_CONSUMER_GROUP_REBALANCING_CHECK_INTERVAL value changed to: 5 s from environment variable
Mar 16 12:50:02 ip-10-0-0-116 iggy-server[1482]: 2026-03-16T12:50:02.889537Z  INFO main configs::configs_impl::typed_env_provider: IGGY_DATA_MAINTENANCE_MESSAGES_CLEANER_ENABLED value changed to: true from environment variable
Mar 16 12:50:02 ip-10-0-0-116 iggy-server[1482]: 2026-03-16T12:50:02.889544Z  INFO main configs::configs_impl::typed_env_provider: IGGY_DATA_MAINTENANCE_MESSAGES_INTERVAL value changed to: 1 m from environment variable
Mar 16 12:50:02 ip-10-0-0-116 iggy-server[1482]: 2026-03-16T12:50:02.889550Z  INFO main configs::configs_impl::typed_env_provider: IGGY_MESSAGE_SAVER_ENABLED value changed to: true from environment variable
Mar 16 12:50:02 ip-10-0-0-116 iggy-server[1482]: 2026-03-16T12:50:02.889557Z  INFO main configs::configs_impl::typed_env_provider: IGGY_MESSAGE_SAVER_ENFORCE_FSYNC value changed to: true from environment variable
Mar 16 12:50:02 ip-10-0-0-116 iggy-server[1482]: 2026-03-16T12:50:02.889564Z  INFO main configs::configs_impl::typed_env_provider: IGGY_MESSAGE_SAVER_INTERVAL value changed to: 30 s from environment variable
Mar 16 12:50:02 ip-10-0-0-116 iggy-server[1482]: 2026-03-16T12:50:02.889571Z  INFO main configs::configs_impl::typed_env_provider: IGGY_PERSONAL_ACCESS_TOKEN_MAX_TOKENS_PER_USER value changed to: 100 from environment variable
Mar 16 12:50:02 ip-10-0-0-116 iggy-server[1482]: 2026-03-16T12:50:02.889579Z  INFO main configs::configs_impl::typed_env_provider: IGGY_PERSONAL_ACCESS_TOKEN_CLEANER_ENABLED value changed to: true from environment variable
Mar 16 12:50:02 ip-10-0-0-116 iggy-server[1482]: 2026-03-16T12:50:02.889586Z  INFO main configs::configs_impl::typed_env_provider: IGGY_PERSONAL_ACCESS_TOKEN_CLEANER_INTERVAL value changed to: 1 m from environment variable
Mar 16 12:50:02 ip-10-0-0-116 iggy-server[1482]: 2026-03-16T12:50:02.889592Z  INFO main configs::configs_impl::typed_env_provider: IGGY_HEARTBEAT_ENABLED value changed to: false from environment variable
Mar 16 12:50:02 ip-10-0-0-116 iggy-server[1482]: 2026-03-16T12:50:02.889599Z  INFO main configs::configs_impl::typed_env_provider: IGGY_HEARTBEAT_INTERVAL value changed to: 5 s from environment variable
Mar 16 12:50:02 ip-10-0-0-116 iggy-server[1482]: 2026-03-16T12:50:02.889606Z  INFO main configs::configs_impl::typed_env_provider: IGGY_SYSTEM_PATH value changed to: local_data from environment variable
Mar 16 12:50:02 ip-10-0-0-116 iggy-server[1482]: 2026-03-16T12:50:02.889613Z  INFO main configs::configs_impl::typed_env_provider: IGGY_SYSTEM_BACKUP_PATH value changed to: backup from environment variable
Mar 16 12:50:02 ip-10-0-0-116 iggy-server[1482]: 2026-03-16T12:50:02.889621Z  INFO main configs::configs_impl::typed_env_provider: IGGY_SYSTEM_BACKUP_COMPATIBILITY_PATH value changed to: compatibility from environment variable
Mar 16 12:50:02 ip-10-0-0-116 iggy-server[1482]: 2026-03-16T12:50:02.889630Z  INFO main configs::configs_impl::typed_env_provider: IGGY_SYSTEM_STATE_ENFORCE_FSYNC value changed to: true from environment variable
Mar 16 12:50:02 ip-10-0-0-116 iggy-server[1482]: 2026-03-16T12:50:02.889638Z  INFO main configs::configs_impl::typed_env_provider: IGGY_SYSTEM_STATE_MAX_FILE_OPERATION_RETRIES value changed to: 1 from environment variable
Mar 16 12:50:02 ip-10-0-0-116 iggy-server[1482]: 2026-03-16T12:50:02.889645Z  INFO main configs::configs_impl::typed_env_provider: IGGY_SYSTEM_STATE_RETRY_DELAY value changed to: 1 s from environment variable
Mar 16 12:50:02 ip-10-0-0-116 iggy-server[1482]: 2026-03-16T12:50:02.889652Z  INFO main configs::configs_impl::typed_env_provider: IGGY_SYSTEM_RUNTIME_PATH value changed to: runtime from environment variable
Mar 16 12:50:02 ip-10-0-0-116 iggy-server[1482]: 2026-03-16T12:50:02.889659Z  INFO main configs::configs_impl::typed_env_provider: IGGY_SYSTEM_LOGGING_PATH value changed to: logs from environment variable
Mar 16 12:50:02 ip-10-0-0-116 iggy-server[1482]: 2026-03-16T12:50:02.889666Z  INFO main configs::configs_impl::typed_env_provider: IGGY_SYSTEM_LOGGING_LEVEL value changed to: info from environment variable
Mar 16 12:50:02 ip-10-0-0-116 iggy-server[1482]: 2026-03-16T12:50:02.889673Z  INFO main configs::configs_impl::typed_env_provider: IGGY_SYSTEM_LOGGING_FILE_ENABLED value changed to: true from environment variable
Mar 16 12:50:02 ip-10-0-0-116 iggy-server[1482]: 2026-03-16T12:50:02.889681Z  INFO main configs::configs_impl::typed_env_provider: IGGY_SYSTEM_LOGGING_MAX_FILE_SIZE value changed to: 20 MB from environment variable
Mar 16 12:50:02 ip-10-0-0-116 iggy-server[1482]: 2026-03-16T12:50:02.889688Z  INFO main configs::configs_impl::typed_env_provider: IGGY_SYSTEM_LOGGING_MAX_TOTAL_SIZE value changed to: 100 MB from environment variable
Mar 16 12:50:02 ip-10-0-0-116 iggy-server[1482]: 2026-03-16T12:50:02.889696Z  INFO main configs::configs_impl::typed_env_provider: IGGY_SYSTEM_LOGGING_ROTATION_CHECK_INTERVAL value changed to: 1 h from environment variable
Mar 16 12:50:02 ip-10-0-0-116 iggy-server[1482]: 2026-03-16T12:50:02.889704Z  INFO main configs::configs_impl::typed_env_provider: IGGY_SYSTEM_LOGGING_RETENTION value changed to: 7 days from environment variable
Mar 16 12:50:02 ip-10-0-0-116 iggy-server[1482]: 2026-03-16T12:50:02.889711Z  INFO main configs::configs_impl::typed_env_provider: IGGY_SYSTEM_LOGGING_SYSINFO_PRINT_INTERVAL value changed to: 10 s from environment variable
Mar 16 12:50:02 ip-10-0-0-116 iggy-server[1482]: 2026-03-16T12:50:02.889719Z  INFO main configs::configs_impl::typed_env_provider: IGGY_SYSTEM_STREAM_PATH value changed to: streams from environment variable
Mar 16 12:50:02 ip-10-0-0-116 iggy-server[1482]: 2026-03-16T12:50:02.889726Z  INFO main configs::configs_impl::typed_env_provider: IGGY_SYSTEM_TOPIC_PATH value changed to: topics from environment variable
Mar 16 12:50:02 ip-10-0-0-116 iggy-server[1482]: 2026-03-16T12:50:02.889734Z  INFO main configs::configs_impl::typed_env_provider: IGGY_SYSTEM_TOPIC_MAX_SIZE value changed to: unlimited from environment variable
Mar 16 12:50:02 ip-10-0-0-116 iggy-server[1482]: 2026-03-16T12:50:02.889741Z  INFO main configs::configs_impl::typed_env_provider: IGGY_SYSTEM_TOPIC_MESSAGE_EXPIRY value changed to: none from environment variable
Mar 16 12:50:02 ip-10-0-0-116 iggy-server[1482]: 2026-03-16T12:50:02.889748Z  INFO main configs::configs_impl::typed_env_provider: IGGY_SYSTEM_PARTITION_PATH value changed to: partitions from environment variable
Mar 16 12:50:02 ip-10-0-0-116 iggy-server[1482]: 2026-03-16T12:50:02.889756Z  INFO main configs::configs_impl::typed_env_provider: IGGY_SYSTEM_PARTITION_MESSAGES_REQUIRED_TO_SAVE value changed to: 1024 from environment variable
Mar 16 12:50:02 ip-10-0-0-116 iggy-server[1482]: 2026-03-16T12:50:02.889764Z  INFO main configs::configs_impl::typed_env_provider: IGGY_SYSTEM_PARTITION_SIZE_OF_MESSAGES_REQUIRED_TO_SAVE value changed to: 1 MiB from environment variable
Mar 16 12:50:02 ip-10-0-0-116 iggy-server[1482]: 2026-03-16T12:50:02.889772Z  INFO main configs::configs_impl::typed_env_provider: IGGY_SYSTEM_PARTITION_ENFORCE_FSYNC value changed to: true from environment variable
Mar 16 12:50:02 ip-10-0-0-116 iggy-server[1482]: 2026-03-16T12:50:02.889779Z  INFO main configs::configs_impl::typed_env_provider: IGGY_SYSTEM_PARTITION_VALIDATE_CHECKSUM value changed to: false from environment variable
Mar 16 12:50:02 ip-10-0-0-116 iggy-server[1482]: 2026-03-16T12:50:02.889787Z  INFO main configs::configs_impl::typed_env_provider: IGGY_SYSTEM_SEGMENT_SIZE value changed to: 1 GiB from environment variable
Mar 16 12:50:02 ip-10-0-0-116 iggy-server[1482]: 2026-03-16T12:50:02.889794Z  INFO main configs::configs_impl::typed_env_provider: IGGY_SYSTEM_SEGMENT_CACHE_INDEXES value changed to: open_segment from environment variable
Mar 16 12:50:02 ip-10-0-0-116 iggy-server[1482]: 2026-03-16T12:50:02.889802Z  INFO main configs::configs_impl::typed_env_provider: IGGY_SYSTEM_SEGMENT_ARCHIVE_EXPIRED value changed to: false from environment variable
Mar 16 12:50:02 ip-10-0-0-116 iggy-server[1482]: 2026-03-16T12:50:02.889813Z  INFO main configs::configs_impl::typed_env_provider: IGGY_SYSTEM_COMPRESSION_ALLOW_OVERRIDE value changed to: false from environment variable
Mar 16 12:50:02 ip-10-0-0-116 iggy-server[1482]: 2026-03-16T12:50:02.889820Z  INFO main configs::configs_impl::typed_env_provider: IGGY_SYSTEM_COMPRESSION_DEFAULT_ALGORITHM value changed to: none from environment variable
Mar 16 12:50:02 ip-10-0-0-116 iggy-server[1482]: 2026-03-16T12:50:02.889828Z  INFO main configs::configs_impl::typed_env_provider: IGGY_SYSTEM_MESSAGE_DEDUPLICATION_ENABLED value changed to: false from environment variable
Mar 16 12:50:02 ip-10-0-0-116 iggy-server[1482]: 2026-03-16T12:50:02.889836Z  INFO main configs::configs_impl::typed_env_provider: IGGY_SYSTEM_MESSAGE_DEDUPLICATION_MAX_ENTRIES value changed to: 10000 from environment variable
Mar 16 12:50:02 ip-10-0-0-116 iggy-server[1482]: 2026-03-16T12:50:02.889844Z  INFO main configs::configs_impl::typed_env_provider: IGGY_SYSTEM_MESSAGE_DEDUPLICATION_EXPIRY value changed to: 1 m from environment variable
Mar 16 12:50:02 ip-10-0-0-116 iggy-server[1482]: 2026-03-16T12:50:02.889851Z  INFO main configs::configs_impl::typed_env_provider: IGGY_SYSTEM_RECOVERY_RECREATE_MISSING_STATE value changed to: false from environment variable
Mar 16 12:50:02 ip-10-0-0-116 iggy-server[1482]: 2026-03-16T12:50:02.889860Z  INFO main configs::configs_impl::typed_env_provider: IGGY_SYSTEM_MEMORY_POOL_ENABLED value changed to: true from environment variable
Mar 16 12:50:02 ip-10-0-0-116 iggy-server[1482]: 2026-03-16T12:50:02.889868Z  INFO main configs::configs_impl::typed_env_provider: IGGY_SYSTEM_MEMORY_POOL_SIZE value changed to: 4 GiB from environment variable
Mar 16 12:50:02 ip-10-0-0-116 iggy-server[1482]: 2026-03-16T12:50:02.889876Z  INFO main configs::configs_impl::typed_env_provider: IGGY_SYSTEM_MEMORY_POOL_BUCKET_CAPACITY value changed to: 8192 from environment variable
Mar 16 12:50:02 ip-10-0-0-116 iggy-server[1482]: 2026-03-16T12:50:02.889882Z  INFO main configs::configs_impl::typed_env_provider: IGGY_SYSTEM_SHARDING_CPU_ALLOCATION value changed to: numa:auto from environment variable
Mar 16 12:50:02 ip-10-0-0-116 iggy-server[1482]: 2026-03-16T12:50:02.889890Z  INFO main configs::configs_impl::typed_env_provider: IGGY_QUIC_ENABLED value changed to: false from environment variable
Mar 16 12:50:02 ip-10-0-0-116 iggy-server[1482]: 2026-03-16T12:50:02.889896Z  INFO main configs::configs_impl::typed_env_provider: IGGY_QUIC_ADDRESS value changed to: 0.0.0.0:8080 from environment variable
Mar 16 12:50:02 ip-10-0-0-116 iggy-server[1482]: 2026-03-16T12:50:02.889903Z  INFO main configs::configs_impl::typed_env_provider: IGGY_QUIC_MAX_CONCURRENT_BIDI_STREAMS value changed to: 10000 from environment variable
Mar 16 12:50:02 ip-10-0-0-116 iggy-server[1482]: 2026-03-16T12:50:02.889910Z  INFO main configs::configs_impl::typed_env_provider: IGGY_QUIC_DATAGRAM_SEND_BUFFER_SIZE value changed to: 100 KB from environment variable
Mar 16 12:50:02 ip-10-0-0-116 iggy-server[1482]: 2026-03-16T12:50:02.889917Z  INFO main configs::configs_impl::typed_env_provider: IGGY_QUIC_INITIAL_MTU value changed to: 8 KB from environment variable
Mar 16 12:50:02 ip-10-0-0-116 iggy-server[1482]: 2026-03-16T12:50:02.889923Z  INFO main configs::configs_impl::typed_env_provider: IGGY_QUIC_SEND_WINDOW value changed to: 100 KB from environment variable
Mar 16 12:50:02 ip-10-0-0-116 iggy-server[1482]: 2026-03-16T12:50:02.889930Z  INFO main configs::configs_impl::typed_env_provider: IGGY_QUIC_RECEIVE_WINDOW value changed to: 100 KB from environment variable
Mar 16 12:50:02 ip-10-0-0-116 iggy-server[1482]: 2026-03-16T12:50:02.889937Z  INFO main configs::configs_impl::typed_env_provider: IGGY_QUIC_KEEP_ALIVE_INTERVAL value changed to: 5 s from environment variable
Mar 16 12:50:02 ip-10-0-0-116 iggy-server[1482]: 2026-03-16T12:50:02.889944Z  INFO main configs::configs_impl::typed_env_provider: IGGY_QUIC_MAX_IDLE_TIMEOUT value changed to: 10 s from environment variable
Mar 16 12:50:02 ip-10-0-0-116 iggy-server[1482]: 2026-03-16T12:50:02.889951Z  INFO main configs::configs_impl::typed_env_provider: IGGY_QUIC_CERTIFICATE_SELF_SIGNED value changed to: true from environment variable
Mar 16 12:50:02 ip-10-0-0-116 iggy-server[1482]: 2026-03-16T12:50:02.889963Z  INFO main configs::configs_impl::typed_env_provider: IGGY_QUIC_SOCKET_OVERRIDE_DEFAULTS value changed to: false from environment variable
Mar 16 12:50:02 ip-10-0-0-116 iggy-server[1482]: 2026-03-16T12:50:02.889970Z  INFO main configs::configs_impl::typed_env_provider: IGGY_QUIC_SOCKET_RECV_BUFFER_SIZE value changed to: 64 KB from environment variable
Mar 16 12:50:02 ip-10-0-0-116 iggy-server[1482]: 2026-03-16T12:50:02.889978Z  INFO main configs::configs_impl::typed_env_provider: IGGY_QUIC_SOCKET_SEND_BUFFER_SIZE value changed to: 64 KB from environment variable
Mar 16 12:50:02 ip-10-0-0-116 iggy-server[1482]: 2026-03-16T12:50:02.889985Z  INFO main configs::configs_impl::typed_env_provider: IGGY_QUIC_SOCKET_KEEPALIVE value changed to: false from environment variable
Mar 16 12:50:02 ip-10-0-0-116 iggy-server[1482]: 2026-03-16T12:50:02.889991Z  INFO main configs::configs_impl::typed_env_provider: IGGY_TCP_ENABLED value changed to: true from environment variable
Mar 16 12:50:02 ip-10-0-0-116 iggy-server[1482]: 2026-03-16T12:50:02.889998Z  INFO main configs::configs_impl::typed_env_provider: IGGY_TCP_ADDRESS value changed to: 0.0.0.0:8090 from environment variable
Mar 16 12:50:02 ip-10-0-0-116 iggy-server[1482]: 2026-03-16T12:50:02.890005Z  INFO main configs::configs_impl::typed_env_provider: IGGY_TCP_IPV6 value changed to: false from environment variable
Mar 16 12:50:02 ip-10-0-0-116 iggy-server[1482]: 2026-03-16T12:50:02.890012Z  INFO main configs::configs_impl::typed_env_provider: IGGY_TCP_SOCKET_MIGRATION value changed to: true from environment variable
Mar 16 12:50:02 ip-10-0-0-116 iggy-server[1482]: 2026-03-16T12:50:02.890019Z  INFO main configs::configs_impl::typed_env_provider: IGGY_TCP_TLS_ENABLED value changed to: true from environment variable
Mar 16 12:50:02 ip-10-0-0-116 iggy-server[1482]: 2026-03-16T12:50:02.890026Z  INFO main configs::configs_impl::typed_env_provider: IGGY_TCP_TLS_SELF_SIGNED value changed to: false from environment variable
Mar 16 12:50:02 ip-10-0-0-116 iggy-server[1482]: 2026-03-16T12:50:02.890033Z  INFO main configs::configs_impl::typed_env_provider: IGGY_TCP_TLS_CERT_FILE value changed to: /etc/laserdata/certs/server-fullchain.crt from environment variable
Mar 16 12:50:02 ip-10-0-0-116 iggy-server[1482]: 2026-03-16T12:50:02.890042Z  INFO main configs::configs_impl::typed_env_provider: IGGY_TCP_TLS_KEY_FILE value changed to: /etc/laserdata/certs/server.key from environment variable
Mar 16 12:50:02 ip-10-0-0-116 iggy-server[1482]: 2026-03-16T12:50:02.890050Z  INFO main configs::configs_impl::typed_env_provider: IGGY_TCP_SOCKET_OVERRIDE_DEFAULTS value changed to: false from environment variable
Mar 16 12:50:02 ip-10-0-0-116 iggy-server[1482]: 2026-03-16T12:50:02.890058Z  INFO main configs::configs_impl::typed_env_provider: IGGY_TCP_SOCKET_RECV_BUFFER_SIZE value changed to: 100 KB from environment variable
Mar 16 12:50:02 ip-10-0-0-116 iggy-server[1482]: 2026-03-16T12:50:02.890066Z  INFO main configs::configs_impl::typed_env_provider: IGGY_TCP_SOCKET_SEND_BUFFER_SIZE value changed to: 100 KB from environment variable
Mar 16 12:50:02 ip-10-0-0-116 iggy-server[1482]: 2026-03-16T12:50:02.890074Z  INFO main configs::configs_impl::typed_env_provider: IGGY_TCP_SOCKET_KEEPALIVE value changed to: false from environment variable
Mar 16 12:50:02 ip-10-0-0-116 iggy-server[1482]: 2026-03-16T12:50:02.890081Z  INFO main configs::configs_impl::typed_env_provider: IGGY_TCP_SOCKET_NODELAY value changed to: false from environment variable
Mar 16 12:50:02 ip-10-0-0-116 iggy-server[1482]: 2026-03-16T12:50:02.890088Z  INFO main configs::configs_impl::typed_env_provider: IGGY_TCP_SOCKET_LINGER value changed to: 0 s from environment variable
Mar 16 12:50:02 ip-10-0-0-116 iggy-server[1482]: 2026-03-16T12:50:02.890094Z  INFO main configs::configs_impl::typed_env_provider: IGGY_HTTP_ENABLED value changed to: true from environment variable
Mar 16 12:50:02 ip-10-0-0-116 iggy-server[1482]: 2026-03-16T12:50:02.890100Z  INFO main configs::configs_impl::typed_env_provider: IGGY_HTTP_ADDRESS value changed to: 127.0.0.1:3000 from environment variable
Mar 16 12:50:02 ip-10-0-0-116 iggy-server[1482]: 2026-03-16T12:50:02.890107Z  INFO main configs::configs_impl::typed_env_provider: IGGY_HTTP_MAX_REQUEST_SIZE value changed to: 2 MB from environment variable
Mar 16 12:50:02 ip-10-0-0-116 iggy-server[1482]: 2026-03-16T12:50:02.890114Z  INFO main configs::configs_impl::typed_env_provider: IGGY_HTTP_WEB_UI value changed to: false from environment variable
Mar 16 12:50:02 ip-10-0-0-116 iggy-server[1482]: 2026-03-16T12:50:02.890120Z  INFO main configs::configs_impl::typed_env_provider: IGGY_HTTP_CORS_ENABLED value changed to: true from environment variable
Mar 16 12:50:02 ip-10-0-0-116 iggy-server[1482]: 2026-03-16T12:50:02.890127Z  INFO main configs::configs_impl::typed_env_provider: IGGY_HTTP_CORS_ALLOWED_METHODS value changed to: [GET,POST,PUT,DELETE] from environment variable
Mar 16 12:50:02 ip-10-0-0-116 iggy-server[1482]: 2026-03-16T12:50:02.890136Z  INFO main configs::configs_impl::typed_env_provider: IGGY_HTTP_CORS_ALLOWED_ORIGINS value changed to: [*] from environment variable
Mar 16 12:50:02 ip-10-0-0-116 iggy-server[1482]: 2026-03-16T12:50:02.890143Z  INFO main configs::configs_impl::typed_env_provider: IGGY_HTTP_CORS_ALLOWED_HEADERS value changed to: [content-type,authorization] from environment variable
Mar 16 12:50:02 ip-10-0-0-116 iggy-server[1482]: 2026-03-16T12:50:02.890151Z  INFO main configs::configs_impl::typed_env_provider: IGGY_HTTP_CORS_EXPOSED_HEADERS value changed to: [] from environment variable
Mar 16 12:50:02 ip-10-0-0-116 iggy-server[1482]: 2026-03-16T12:50:02.890156Z  INFO main configs::configs_impl::typed_env_provider: IGGY_HTTP_CORS_ALLOW_CREDENTIALS value changed to: false from environment variable
Mar 16 12:50:02 ip-10-0-0-116 iggy-server[1482]: 2026-03-16T12:50:02.890162Z  INFO main configs::configs_impl::typed_env_provider: IGGY_HTTP_CORS_ALLOW_PRIVATE_NETWORK value changed to: false from environment variable
Mar 16 12:50:02 ip-10-0-0-116 iggy-server[1482]: 2026-03-16T12:50:02.890168Z  INFO main configs::configs_impl::typed_env_provider: IGGY_HTTP_JWT_ALGORITHM value changed to: HS256 from environment variable
Mar 16 12:50:02 ip-10-0-0-116 iggy-server[1482]: 2026-03-16T12:50:02.890175Z  INFO main configs::configs_impl::typed_env_provider: IGGY_HTTP_JWT_ISSUER value changed to: laserdata.cloud from environment variable
Mar 16 12:50:02 ip-10-0-0-116 iggy-server[1482]: 2026-03-16T12:50:02.890181Z  INFO main configs::configs_impl::typed_env_provider: IGGY_HTTP_JWT_AUDIENCE value changed to: laserdata.cloud from environment variable
Mar 16 12:50:02 ip-10-0-0-116 iggy-server[1482]: 2026-03-16T12:50:02.890188Z  INFO main configs::configs_impl::typed_env_provider: IGGY_HTTP_JWT_VALID_ISSUERS value changed to: [laserdata.cloud] from environment variable
Mar 16 12:50:02 ip-10-0-0-116 iggy-server[1482]: 2026-03-16T12:50:02.890196Z  INFO main configs::configs_impl::typed_env_provider: IGGY_HTTP_JWT_VALID_AUDIENCES value changed to: [laserdata.cloud] from environment variable
Mar 16 12:50:02 ip-10-0-0-116 iggy-server[1482]: 2026-03-16T12:50:02.890203Z  INFO main configs::configs_impl::typed_env_provider: IGGY_HTTP_JWT_ACCESS_TOKEN_EXPIRY value changed to: 1 h from environment variable
Mar 16 12:50:02 ip-10-0-0-116 iggy-server[1482]: 2026-03-16T12:50:02.890210Z  INFO main configs::configs_impl::typed_env_provider: IGGY_HTTP_JWT_CLOCK_SKEW value changed to: 5 s from environment variable
Mar 16 12:50:02 ip-10-0-0-116 iggy-server[1482]: 2026-03-16T12:50:02.890216Z  INFO main configs::configs_impl::typed_env_provider: IGGY_HTTP_JWT_NOT_BEFORE value changed to: 0 s from environment variable
Mar 16 12:50:02 ip-10-0-0-116 iggy-server[1482]: 2026-03-16T12:50:02.890223Z  INFO main configs::configs_impl::typed_env_provider: IGGY_HTTP_JWT_ENCODING_SECRET value changed to: ****** from environment variable
Mar 16 12:50:02 ip-10-0-0-116 iggy-server[1482]: 2026-03-16T12:50:02.890230Z  INFO main configs::configs_impl::typed_env_provider: IGGY_HTTP_JWT_DECODING_SECRET value changed to: ****** from environment variable
Mar 16 12:50:02 ip-10-0-0-116 iggy-server[1482]: 2026-03-16T12:50:02.890237Z  INFO main configs::configs_impl::typed_env_provider: IGGY_HTTP_JWT_USE_BASE64_SECRET value changed to: true from environment variable
Mar 16 12:50:02 ip-10-0-0-116 iggy-server[1482]: 2026-03-16T12:50:02.890243Z  INFO main configs::configs_impl::typed_env_provider: IGGY_HTTP_METRICS_ENABLED value changed to: true from environment variable
Mar 16 12:50:02 ip-10-0-0-116 iggy-server[1482]: 2026-03-16T12:50:02.890250Z  INFO main configs::configs_impl::typed_env_provider: IGGY_HTTP_METRICS_ENDPOINT value changed to: /metrics from environment variable
Mar 16 12:50:02 ip-10-0-0-116 iggy-server[1482]: 2026-03-16T12:50:02.890257Z  INFO main configs::configs_impl::typed_env_provider: IGGY_HTTP_TLS_ENABLED value changed to: false from environment variable
Mar 16 12:50:02 ip-10-0-0-116 iggy-server[1482]: 2026-03-16T12:50:02.890265Z  INFO main configs::configs_impl::typed_env_provider: IGGY_WEBSOCKET_ENABLED value changed to: true from environment variable
Mar 16 12:50:02 ip-10-0-0-116 iggy-server[1482]: 2026-03-16T12:50:02.890273Z  INFO main configs::configs_impl::typed_env_provider: IGGY_WEBSOCKET_ADDRESS value changed to: 0.0.0.0:8070 from environment variable
Mar 16 12:50:02 ip-10-0-0-116 iggy-server[1482]: 2026-03-16T12:50:02.890287Z  INFO main configs::configs_impl::typed_env_provider: IGGY_WEBSOCKET_TLS_ENABLED value changed to: true from environment variable
Mar 16 12:50:02 ip-10-0-0-116 iggy-server[1482]: 2026-03-16T12:50:02.890295Z  INFO main configs::configs_impl::typed_env_provider: IGGY_WEBSOCKET_TLS_SELF_SIGNED value changed to: false from environment variable
Mar 16 12:50:02 ip-10-0-0-116 iggy-server[1482]: 2026-03-16T12:50:02.890304Z  INFO main configs::configs_impl::typed_env_provider: IGGY_WEBSOCKET_TLS_CERT_FILE value changed to: /etc/laserdata/certs/server-fullchain.crt from environment variable
Mar 16 12:50:02 ip-10-0-0-116 iggy-server[1482]: 2026-03-16T12:50:02.890312Z  INFO main configs::configs_impl::typed_env_provider: IGGY_WEBSOCKET_TLS_KEY_FILE value changed to: /etc/laserdata/certs/server.key from environment variable
Mar 16 12:50:02 ip-10-0-0-116 iggy-server[1482]: 2026-03-16T12:50:02.890320Z  INFO main configs::configs_impl::typed_env_provider: IGGY_TELEMETRY_ENABLED value changed to: false from environment variable
Mar 16 12:50:02 ip-10-0-0-116 iggy-server[1482]: 2026-03-16T12:50:02.890328Z  INFO main configs::configs_impl::typed_env_provider: IGGY_TELEMETRY_SERVICE_NAME value changed to: iggy from environment variable
Mar 16 12:50:02 ip-10-0-0-116 iggy-server[1482]: 2026-03-16T12:50:02.890336Z  INFO main configs::configs_impl::typed_env_provider: IGGY_TELEMETRY_LOGS_TRANSPORT value changed to: grpc from environment variable
Mar 16 12:50:02 ip-10-0-0-116 iggy-server[1482]: 2026-03-16T12:50:02.890345Z  INFO main configs::configs_impl::typed_env_provider: IGGY_TELEMETRY_TRACES_TRANSPORT value changed to: grpc from environment variable
Mar 16 12:50:02 ip-10-0-0-116 iggy-server[1482]: 2026-03-16T12:50:02.890353Z  INFO main configs::configs_impl::typed_env_provider: IGGY_CLUSTER_ENABLED value changed to: false from environment variable
Mar 16 12:50:02 ip-10-0-0-116 iggy-server[1482]: 2026-03-16T12:50:02.890722Z  INFO main configs::configs_impl::file_provider: Config loaded successfully.
Mar 16 12:50:02 ip-10-0-0-116 iggy-server[1482]: 2026-03-16T12:50:02.890798Z  INFO main configs::configs_impl::file_provider: Using Config: { consumer_group: { rebalancing_timeout: 30s, rebalancing_check_interval: 5s }, data_maintenance: { messages: { cleaner_enabled: true, interval: 1m } }, message_saver: { enabled: true, enforce_fsync: true, interval: 30s }, heartbeat: { enabled: false, interval: 5s }, system: { path: local_data, logging: { path: logs, level: info, file_enabled: true, max_file_size: 20.00 MB, max_total_size: 100.00 MB, rotation_check_interval: 1h, retention: 7days }, stream: { path: streams }, topic: { path: topics, max_size: unlimited, message_expiry: never_expire }, partition: { path: partitions, messages_required_to_save: 1024, size_of_messages_required_to_save: 1.05 MB, enforce_fsync: true, validate_checksum: false }, segment: { size_bytes: 1.07 GB, cache_indexes: OpenSegment, archive_expired: false }, encryption: { enabled: false }, state: { enforce_fsync: true, max_file_operation_retries: 1, retry_delay: 1s } }, quic: { enabled: false, address: 0.0.0.0:8080, max_concurrent_bidi_streams: 10000, datagram_send_buffer_size: 100.00 KB, initial_mtu: 8.00 KB, send_window: 100.00 KB, receive_window: 100.00 KB, keep_alive_interval: 5s, max_idle_timeout: 10s, certificate: { self_signed: true, cert_file: core/certs/iggy_cert.pem, key_file: core/certs/iggy_key.pem } }, tcp: { enabled: true, address: 0.0.0.0:8090, ipv6: false, tls: { enabled: true, self_signed: false, cert_file: /etc/laserdata/certs/server-fullchain.crt, key_file: /etc/laserdata/certs/server.key }, socket: { override defaults: false, recv buffer size: 100.00 KB, send buffer size 100.00 KB, keepalive: false, nodelay: false, linger: 0s }, socket_migration: true }, http: { enabled: true, address: 127.0.0.1:3000, max_request_size: 2.00 MB, web_ui: false, cors: { enabled: true, allowed_methods: ["GET", "POST", "PUT", "DELETE"], allowed_origins: ["*"], allowed_headers: ["content-type", "authorization"], exposed_headers: [], allow_credentials: false, allow_private_network: false }, jwt: { algorithm: HS256, audience: laserdata.cloud, access_token_expiry: 1h, use_base64_secret=*** }, metrics: { enabled: true, endpoint: /metrics }, tls: { enabled: false, cert_file: core/certs/iggy_cert.pem, key_file: core/certs/iggy_key.pem } }, telemetry: { enabled: false, service_name: iggy, logs: { transport: grpc, endpoint: http://localhost:7281/v1/logs }, traces: { transport: grpc, endpoint: http://localhost:7281/v1/traces } } }
Mar 16 12:50:02 ip-10-0-0-116 iggy-server[1482]: 2026-03-16T12:50:02.891353Z  INFO main server::bootstrap: Initializing system, data will be stored at: local_data
Mar 16 12:50:02 ip-10-0-0-116 iggy-server[1482]: 2026-03-16T12:50:02.894670Z  INFO main server::log::logger: Logging initialized, logs will be stored at: "local_data/logs". Logs will be rotated based on size. Log filter: info.
Mar 16 12:50:02 ip-10-0-0-116 iggy-server[1482]: 2026-03-16T12:50:02.899391Z  INFO main iggy_common::alloc::memory_pool: Initializing MemoryPool with 32 buckets, each will have capacity: 8192.
Mar 16 12:50:02 ip-10-0-0-116 iggy-server[1482]: 2026-03-16T12:50:02.899464Z  INFO main iggy_server: Current semantic version: SemanticVersion { major: 0, minor: 7, patch: 2, prerelease: Some("edge.1") }
Mar 16 12:50:02 ip-10-0-0-116 iggy-server[1482]: 2026-03-16T12:50:02.899563Z  INFO main iggy_server: System info not found, creating...
Mar 16 12:50:02 ip-10-0-0-116 iggy-server[1482]: 2026-03-16T12:50:02.901740Z  INFO main server::shard::system::storage: Saved system info, system info, version: 0.7.2-edge.1
Mar 16 12:50:02 ip-10-0-0-116 iggy-server[1482]: 2026-03-16T12:50:02.901809Z  INFO main iggy_server: Loaded system info, version: 0.7.2-edge.1.
Mar 16 12:50:02 ip-10-0-0-116 iggy-server[1482]: 2026-03-16T12:50:02.901862Z  INFO main iggy_server: System version 0.7.2-edge.1 is up to date.
Mar 16 12:50:02 ip-10-0-0-116 iggy-server[1482]: 2026-03-16T12:50:02.901902Z  INFO main iggy_server: Server-side encryption is disabled.
Mar 16 12:50:02 ip-10-0-0-116 iggy-server[1482]: 2026-03-16T12:50:02.902006Z  INFO main server::state::file: State file is empty
Mar 16 12:50:02 ip-10-0-0-116 iggy-server[1482]: 2026-03-16T12:50:02.902047Z  INFO main server::state::system: No users found, creating the root user...
Mar 16 12:50:02 ip-10-0-0-116 iggy-server[1482]: 2026-03-16T12:50:02.902089Z  INFO main server::bootstrap: Using the custom root user credentials.
Mar 16 12:50:02 ip-10-0-0-116 iggy-server[1482]: 2026-03-16T12:50:02.957174Z  INFO main server::state::file: Loading state, file size: 192 B
Mar 16 12:50:02 ip-10-0-0-116 iggy-server[1482]: 2026-03-16T12:50:02.957311Z  INFO main server::state::file: Loaded 1 state entries, current index: 0
Mar 16 12:50:02 ip-10-0-0-116 iggy-server[1482]: 2026-03-16T12:50:02.957390Z  INFO main server::bootstrap: Building metadata: 1 users, 0 personal access tokens
Mar 16 12:50:02 ip-10-0-0-116 iggy-server[1482]: 2026-03-16T12:50:02.957436Z  INFO main server::bootstrap: Built metadata: 0 streams, 0 topics, 0 partitions, 0 consumer groups
Mar 16 12:50:04 ip-10-0-0-116 iggy-server[1482]: 2026-03-16T12:50:04.070508Z  INFO main server::shard_allocator: Using 1 shards with 1 NUMA node, 1 cores per node, and avoid hyperthread true
Mar 16 12:50:04 ip-10-0-0-116 iggy-server[1482]: 2026-03-16T12:50:04.070542Z  INFO main iggy_server: Using mimalloc allocator
Mar 16 12:50:04 ip-10-0-0-116 iggy-server[1482]: 2026-03-16T12:50:04.070551Z  INFO main iggy_server: Enable TCP socket migration across shards: true.
Mar 16 12:50:04 ip-10-0-0-116 iggy-server[1482]: 2026-03-16T12:50:04.070556Z  INFO main iggy_server: Starting 1 shard(s)
Mar 16 12:50:04 ip-10-0-0-116 iggy-server[1482]: 2026-03-16T12:50:04.071334Z  INFO shard-0 server::shard_allocator: Thread bound to CPUs: {0}
Mar 16 12:50:04 ip-10-0-0-116 iggy-server[1482]: 2026-03-16T12:50:04.071437Z  INFO    main iggy_server: Iggy server is running. Press Ctrl+C or send SIGTERM to shutdown.
Mar 16 12:50:04 ip-10-0-0-116 iggy-server[1482]: 2026-03-16T12:50:04.072607Z  INFO shard-0 server::shard_allocator: Memory bound to NUMA node 0
Mar 16 12:50:04 ip-10-0-0-116 iggy-server[1482]: 2026-03-16T12:50:04.072883Z  INFO shard-0 server::shard: Starting...
Mar 16 12:50:04 ip-10-0-0-116 iggy-server[1482]: 2026-03-16T12:50:04.072904Z  INFO shard-0 server::shard: Initialized 1 user(s).
Mar 16 12:50:04 ip-10-0-0-116 iggy-server[1482]: 2026-03-16T12:50:04.072961Z  INFO shard-0 server::shard::tasks::periodic::message_saver: Message saver is enabled, buffered messages will be automatically saved every: 30s, enforce fsync: true.
Mar 16 12:50:04 ip-10-0-0-116 iggy-server[1482]: 2026-03-16T12:50:04.072979Z  INFO shard-0 server::shard::tasks::periodic::message_cleaner: Message cleaner is enabled, expired segments will be automatically deleted every: 60s
Mar 16 12:50:04 ip-10-0-0-116 iggy-server[1482]: 2026-03-16T12:50:04.072988Z  INFO shard-0 server::shard::tasks::periodic::personal_access_token_cleaner: Personal access token cleaner is enabled, expired tokens will be deleted every: 60s.
Mar 16 12:50:04 ip-10-0-0-116 iggy-server[1482]: 2026-03-16T12:50:04.072995Z  INFO shard-0 server::shard::tasks::periodic::revocation_timeout: Pending partition revocations will be checked every: 5s. Timeout: 30s.
Mar 16 12:50:04 ip-10-0-0-116 iggy-server[1482]: 2026-03-16T12:50:04.073004Z  INFO shard-0 server::shard::tasks::periodic::sysinfo_printer: System info logger is enabled, OS info will be printed every: 10s
Mar 16 12:50:04 ip-10-0-0-116 iggy-server[1482]: 2026-03-16T12:50:04.073012Z  INFO shard-0 server::shard: Initialized in 0 ms.
Mar 16 12:50:04 ip-10-0-0-116 iggy-server[1482]: 2026-03-16T12:50:04.073024Z  INFO shard-0 server::shard::tasks::continuous::message_pump: Starting message passing task
Mar 16 12:50:04 ip-10-0-0-116 iggy-server[1482]: 2026-03-16T12:50:04.073082Z  INFO shard-0 server::tcp::tcp_server: Initializing Iggy TCP TLS server...
Mar 16 12:50:04 ip-10-0-0-116 iggy-server[1482]: 2026-03-16T12:50:04.073158Z  INFO shard-0 server::shard::tasks::continuous::http_server: Starting HTTP server on shard: 0
Mar 16 12:50:04 ip-10-0-0-116 iggy-server[1482]: 2026-03-16T12:50:04.073206Z  INFO shard-0 server::websocket::websocket_server: Starting WebSocket TLS server on: 0.0.0.0:8070 for shard: 0...
Mar 16 12:50:04 ip-10-0-0-116 iggy-server[1482]: 2026-03-16T12:50:04.073379Z  INFO shard-0 server::tcp::tcp_tls_listener: Loading certificates from cert_file: /etc/laserdata/certs/server-fullchain.crt, key_file: /etc/laserdata/certs/server.key
Mar 16 12:50:04 ip-10-0-0-116 iggy-server[1482]: 2026-03-16T12:50:04.073740Z  INFO shard-0 server::tcp::tcp_tls_listener: Iggy TCP TLS server has started on: 0.0.0.0:8090
Mar 16 12:50:04 ip-10-0-0-116 iggy-server[1482]: 2026-03-16T12:50:04.073769Z  INFO shard-0 server::websocket::websocket_tls_listener: Loading certificates from cert_file: /etc/laserdata/certs/server-fullchain.crt, key_file: /etc/laserdata/certs/server.key
Mar 16 12:50:04 ip-10-0-0-116 iggy-server[1482]: 2026-03-16T12:50:04.074039Z  INFO shard-0 server::websocket::websocket_tls_listener: WebSocket TLS Server has started on: wss://0.0.0.0:8070
Mar 16 12:50:04 ip-10-0-0-116 iggy-server[1482]: 2026-03-16T12:50:04.074057Z  INFO shard-0 server::websocket::websocket_tls_listener: WebSocket TLS config: max_message_size: None, max_frame_size: None, accept_unmasked_frames: false
Mar 16 12:50:04 ip-10-0-0-116 iggy-server[1482]: 2026-03-16T12:50:04.074064Z  INFO shard-0 server::websocket::websocket_tls_listener: WebSocket TLS accept loop started, waiting for connections...
Mar 16 12:50:04 ip-10-0-0-116 iggy-server[1482]: 2026-03-16T12:50:04.074127Z  INFO shard-0 server::http::jwt::storage: No revoked access tokens found to load.
Mar 16 12:50:04 ip-10-0-0-116 iggy-server[1482]: 2026-03-16T12:50:04.074601Z  INFO shard-0 server::shard::tasks::periodic::jwt_token_cleaner: JWT token cleaner is enabled, expired revoked tokens will be deleted every: 300 seconds.
Mar 16 12:50:04 ip-10-0-0-116 iggy-server[1482]: 2026-03-16T12:50:04.074687Z  INFO shard-0 server::http::http_server: Started HTTP API on: 127.0.0.1:3000
Mar 16 12:50:04 ip-10-0-0-116 iggy-server[1482]: 2026-03-16T12:50:04.074705Z  INFO shard-0 server::shard::handlers: Received AddressBound event for Http with address: 127.0.0.1:3000
Mar 16 12:50:04 ip-10-0-0-116 iggy-server[1482]: 2026-03-16T12:50:04.074737Z  INFO shard-0 server::shard::tasks::oneshot::config_writer: Config writer: TCP addr = Some(0.0.0.0:8090), QUIC addr = None, HTTP addr = Some(127.0.0.1:3000), WebSocket addr = Some(0.0.0.0:8070)
Mar 16 12:50:04 ip-10-0-0-116 iggy-server[1482]: 2026-03-16T12:50:04.079616Z  INFO shard-0 server::shard::tasks::oneshot::config_writer: Current config written and synced to: local_data/runtime/current_config.toml with all bound addresses
Mar 16 12:50:05 ip-10-0-0-116 iggy-server[1482]: 2026-03-16T12:50:05.115576Z  INFO shard-0 server::shard::system::personal_access_tokens: Created personal access token=war*** for user with ID: 1.
Mar 16 12:50:05 ip-10-0-0-116 iggy-server[1482]: 2026-03-16T12:50:05.119559Z  INFO shard-0 trace_logout_user{iggy_user_id=1}: server::http::jwt::storage: No revoked access tokens found to load.
Mar 16 12:50:05 ip-10-0-0-116 iggy-server[1482]: 2026-03-16T12:50:05.123003Z  INFO shard-0 trace_logout_user{iggy_user_id=1}: server::http::jwt::jwt_manager: Revoked access token with ID: 019cf6b2-48bb-7992-8ca5-eab0cc90cacc
Mar 16 12:50:05 ip-10-0-0-116 iggy-server[1482]: 2026-03-16T12:50:05.280169Z  INFO shard-0 server::shard::system::personal_access_tokens: Created personal access token=con*** for user with ID: 2.
Mar 16 12:50:05 ip-10-0-0-116 iggy-server[1482]: 2026-03-16T12:50:05.284124Z  INFO shard-0 trace_logout_user{iggy_user_id=2}: server::http::jwt::storage: Loading revoked access tokens from: local_data/state/tokens
Mar 16 12:50:05 ip-10-0-0-116 iggy-server[1482]: 2026-03-16T12:50:05.284195Z  INFO shard-0 trace_logout_user{iggy_user_id=2}: server::http::jwt::storage: Loaded 1 revoked access tokens
Mar 16 12:50:05 ip-10-0-0-116 iggy-server[1482]: 2026-03-16T12:50:05.287288Z  INFO shard-0 trace_logout_user{iggy_user_id=2}: server::http::jwt::jwt_manager: Revoked access token with ID: 019cf6b2-495f-7a21-8240-80edc9121333
Mar 16 12:50:05 ip-10-0-0-116 iggy-server[1482]: 2026-03-16T12:50:05.442215Z  INFO shard-0 server::shard::system::personal_access_tokens: Created personal access token=pro*** for user with ID: 3.
Mar 16 12:50:05 ip-10-0-0-116 iggy-server[1482]: 2026-03-16T12:50:05.445416Z  INFO shard-0 trace_logout_user{iggy_user_id=3}: server::http::jwt::storage: Loading revoked access tokens from: local_data/state/tokens
Mar 16 12:50:05 ip-10-0-0-116 iggy-server[1482]: 2026-03-16T12:50:05.445539Z  INFO shard-0 trace_logout_user{iggy_user_id=3}: server::http::jwt::storage: Loaded 2 revoked access tokens
Mar 16 12:50:05 ip-10-0-0-116 iggy-server[1482]: 2026-03-16T12:50:05.446879Z  INFO shard-0 trace_logout_user{iggy_user_id=3}: server::http::jwt::jwt_manager: Revoked access token with ID: 019cf6b2-4a01-7a53-9378-a6fce70f0ff6
Mar 16 12:50:05 ip-10-0-0-116 iggy-server[1482]: 2026-03-16T12:50:05.486785Z  INFO shard-0 trace_logout_user{iggy_user_id=0}: server::http::jwt::storage: Loading revoked access tokens from: local_data/state/tokens
Mar 16 12:50:05 ip-10-0-0-116 iggy-server[1482]: 2026-03-16T12:50:05.486880Z  INFO shard-0 trace_logout_user{iggy_user_id=0}: server::http::jwt::storage: Loaded 3 revoked access tokens
Mar 16 12:50:05 ip-10-0-0-116 iggy-server[1482]: 2026-03-16T12:50:05.488639Z  INFO shard-0 trace_logout_user{iggy_user_id=0}: server::http::jwt::jwt_manager: Revoked access token with ID: 019cf6b2-4a2c-76e1-94cb-842c758413aa
Mar 16 12:50:05 ip-10-0-0-116 iggy-server[1482]: 2026-03-16T12:50:05.544255Z  INFO shard-0 server::streaming::streams::storage: Saved stream with ID: 0.
Mar 16 12:50:05 ip-10-0-0-116 iggy-server[1482]: 2026-03-16T12:50:05.547212Z  INFO shard-0 server::streaming::topics::storage: Saved topic with ID: 0. for stream with ID: 0
Mar 16 12:50:05 ip-10-0-0-116 iggy-server[1482]: 2026-03-16T12:50:05.547308Z  INFO shard-0 server::streaming::partitions::storage: Saving partition with ID: 0 for stream with ID: 0 and topic with ID: 0...
Mar 16 12:50:05 ip-10-0-0-116 iggy-server[1482]: 2026-03-16T12:50:05.547968Z  INFO shard-0 server::streaming::partitions::storage: Saved partition with start ID: 0 for stream with ID: 0 and topic with ID: 0, path: local_data/streams/0/topics/0/partitions/0.
Mar 16 12:50:05 ip-10-0-0-116 iggy-server[1482]: 2026-03-16T12:50:05.551647Z  INFO shard-0 server::shard::system::partitions: Initializing partition in local_partitions: partition ID: 0 for topic ID: 0 for stream ID: 0
Mar 16 12:50:05 ip-10-0-0-116 iggy-server[1482]: 2026-03-16T12:50:05.551848Z  INFO shard-0 server::shard::system::partitions: No segments found on disk for partition ID: 0 for topic ID: 0 for stream ID: 0, creating initial segment
Mar 16 12:50:05 ip-10-0-0-116 iggy-server[1482]: 2026-03-16T12:50:05.552009Z  INFO shard-0 server::shard::system::partitions: Initialized partition in local_partitions: partition ID: 0 for topic ID: 0 for stream ID: 0 with offset: 0
Mar 16 12:50:05 ip-10-0-0-116 iggy-server[1482]: 2026-03-16T12:50:05.555074Z  INFO shard-0 trace_logout_user{iggy_user_id=0}: server::http::jwt::storage: Loading revoked access tokens from: local_data/state/tokens
Mar 16 12:50:05 ip-10-0-0-116 iggy-server[1482]: 2026-03-16T12:50:05.555259Z  INFO shard-0 trace_logout_user{iggy_user_id=0}: server::http::jwt::storage: Loaded 4 revoked access tokens
Mar 16 12:50:05 ip-10-0-0-116 iggy-server[1482]: 2026-03-16T12:50:05.557357Z  INFO shard-0 trace_logout_user{iggy_user_id=0}: server::http::jwt::jwt_manager: Revoked access token with ID: 019cf6b2-4a67-73e0-b07f-304b145e4151
Mar 16 12:50:05 ip-10-0-0-116 iggy-server[1482]: 2026-03-16T12:50:05.636307Z  INFO shard-0 server::tcp::tcp_tls_listener: Accepted new TCP connection for TLS handshake: 127.0.0.1:46654
Mar 16 12:50:05 ip-10-0-0-116 iggy-server[1482]: 2026-03-16T12:50:05.731723Z  INFO shard-0 server::tcp::tcp_tls_listener: TLS handshake successful, adding TCP client: 127.0.0.1:46654
Mar 16 12:50:05 ip-10-0-0-116 iggy-server[1482]: 2026-03-16T12:50:05.732054Z  INFO shard-0 server::tcp::tcp_tls_listener: Added tcp client with session: client ID: 1015318102, IP address: 127.0.0.1:46654 for IP address: 127.0.0.1:46654
Mar 16 12:50:05 ip-10-0-0-116 iggy-server[1482]: 2026-03-16T12:50:05.732068Z  INFO shard-0 server::tcp::tcp_tls_listener: Created new session: client ID: 1015318102, IP address: 127.0.0.1:46654
Mar 16 12:50:05 ip-10-0-0-116 iggy-server[1482]: 2026-03-16T12:50:05.813998Z  INFO shard-0 server::tcp::tcp_tls_listener: Accepted new TCP connection for TLS handshake: 127.0.0.1:46658
Mar 16 12:50:05 ip-10-0-0-116 iggy-server[1482]: 2026-03-16T12:50:05.859731Z  INFO shard-0 server::tcp::tcp_tls_listener: TLS handshake successful, adding TCP client: 127.0.0.1:46658
Mar 16 12:50:05 ip-10-0-0-116 iggy-server[1482]: 2026-03-16T12:50:05.859775Z  INFO shard-0 server::tcp::tcp_tls_listener: Added tcp client with session: client ID: 2804267367, IP address: 127.0.0.1:46658 for IP address: 127.0.0.1:46658
Mar 16 12:50:05 ip-10-0-0-116 iggy-server[1482]: 2026-03-16T12:50:05.859787Z  INFO shard-0 server::tcp::tcp_tls_listener: Created new session: client ID: 2804267367, IP address: 127.0.0.1:46658
Mar 16 12:50:14 ip-10-0-0-116 iggy-server[1482]: 2026-03-16T12:50:14.074034Z  INFO shard-0 server::shard::tasks::periodic::sysinfo_printer: CPU: 0.00%/0.46% (IggyUsage/Total), Mem: 48.97%/95.46 MB/487.73 MB/955.73 MB (Free/IggyUsage/TotalUsed/Total), Clients: 2, Messages: 0, Read: 3.23 MB, Written: 102.40 KB, OpenFDs: 191
Mar 16 12:50:15 ip-10-0-0-116 iggy-server[1482]: 2026-03-16T12:50:15.769997Z  INFO shard-0 server::tcp::tcp_tls_listener: Accepted new TCP connection for TLS handshake: 127.0.0.1:53550
Mar 16 12:50:15 ip-10-0-0-116 iggy-server[1482]: 2026-03-16T12:50:15.816736Z  INFO shard-0 server::tcp::tcp_tls_listener: TLS handshake successful, adding TCP client: 127.0.0.1:53550
Mar 16 12:50:15 ip-10-0-0-116 iggy-server[1482]: 2026-03-16T12:50:15.816770Z  INFO shard-0 server::tcp::tcp_tls_listener: Added tcp client with session: client ID: 2903613313, IP address: 127.0.0.1:53550 for IP address: 127.0.0.1:53550
Mar 16 12:50:15 ip-10-0-0-116 iggy-server[1482]: 2026-03-16T12:50:15.816777Z  INFO shard-0 server::tcp::tcp_tls_listener: Created new session: client ID: 2903613313, IP address: 127.0.0.1:53550
Mar 16 12:50:20 ip-10-0-0-116 iggy-server[1482]: 2026-03-16T12:50:20.702395Z  INFO shard-0 server::tcp::tcp_tls_listener: Accepted new TCP connection for TLS handshake: 109.243.3.168:15628
Mar 16 12:50:20 ip-10-0-0-116 iggy-server[1482]: 2026-03-16T12:50:20.933938Z  INFO shard-0 server::tcp::tcp_tls_listener: TLS handshake successful, adding TCP client: 109.243.3.168:15628
Mar 16 12:50:20 ip-10-0-0-116 iggy-server[1482]: 2026-03-16T12:50:20.933975Z  INFO shard-0 server::tcp::tcp_tls_listener: Added tcp client with session: client ID: 3323741115, IP address: 109.243.3.168:15628 for IP address: 109.243.3.168:15628
Mar 16 12:50:20 ip-10-0-0-116 iggy-server[1482]: 2026-03-16T12:50:20.933995Z  INFO shard-0 server::tcp::tcp_tls_listener: Created new session: client ID: 3323741115, IP address: 109.243.3.168:15628
Mar 16 12:50:20 ip-10-0-0-116 iggy-server[1482]: 2026-03-16T12:50:20.934028Z  INFO shard-0 trace_login_user{iggy_user_id=4294967295 iggy_client_id=3323741115}: server::binary::handlers::users::login_user_handler: Logging in user: root ...
Mar 16 12:50:20 ip-10-0-0-116 iggy-server[1482]: 2026-03-16T12:50:20.971273Z  INFO shard-0 trace_login_user{iggy_user_id=4294967295 iggy_client_id=3323741115}: server::binary::handlers::users::login_user_handler: Logged in user: root with ID: 0.
Mar 16 12:50:21 ip-10-0-0-116 iggy-server[1482]: 2026-03-16T12:50:21.928641Z  INFO shard-0 server::streaming::streams::storage: Saved stream with ID: 1.
Mar 16 12:50:22 ip-10-0-0-116 iggy-server[1482]: 2026-03-16T12:50:22.300689Z  INFO shard-0 server::streaming::topics::storage: Saved topic with ID: 0. for stream with ID: 1
Mar 16 12:50:22 ip-10-0-0-116 iggy-server[1482]: 2026-03-16T12:50:22.300794Z  INFO shard-0 server::streaming::partitions::storage: Saving partition with ID: 0 for stream with ID: 1 and topic with ID: 0...
Mar 16 12:50:22 ip-10-0-0-116 iggy-server[1482]: 2026-03-16T12:50:22.300981Z  INFO shard-0 server::streaming::partitions::storage: Saved partition with start ID: 0 for stream with ID: 1 and topic with ID: 0, path: local_data/streams/1/topics/0/partitions/0.
Mar 16 12:50:22 ip-10-0-0-116 iggy-server[1482]: 2026-03-16T12:50:22.301057Z  INFO shard-0 server::shard::system::partitions: Initializing partition in local_partitions: partition ID: 0 for topic ID: 0 for stream ID: 1
Mar 16 12:50:22 ip-10-0-0-116 iggy-server[1482]: 2026-03-16T12:50:22.301238Z  INFO shard-0 server::shard::system::partitions: No segments found on disk for partition ID: 0 for topic ID: 0 for stream ID: 1, creating initial segment
Mar 16 12:50:22 ip-10-0-0-116 iggy-server[1482]: 2026-03-16T12:50:22.301382Z  INFO shard-0 server::shard::system::partitions: Initialized partition in local_partitions: partition ID: 0 for topic ID: 0 for stream ID: 1 with offset: 0
Mar 16 12:50:24 ip-10-0-0-116 iggy-server[1482]: 2026-03-16T12:50:24.074629Z  INFO shard-0 server::shard::tasks::periodic::sysinfo_printer: CPU: 0.00%/1.17% (IggyUsage/Total), Mem: 49.08%/95.69 MB/486.66 MB/955.73 MB (Free/IggyUsage/TotalUsed/Total), Clients: 4, Messages: 202, Read: 3.23 MB, Written: 114.69 KB, OpenFDs: 197
Mar 16 12:50:28 ip-10-0-0-116 iggy-server[1482]: 2026-03-16T12:50:28.689226Z  INFO shard-0 server::shard::system::clients: Deleted tcp client with ID: 3323741115 for IP address: 109.243.3.168:15628
Mar 16 12:50:28 ip-10-0-0-116 iggy-server[1482]: 2026-03-16T12:50:28.689359Z  INFO shard-0 server::tcp::tcp_tls_listener: Successfully closed TCP TLS stream for client: 3323741115, address: 109.243.3.168:15628.
Mar 16 12:50:34 ip-10-0-0-116 iggy-server[1482]: 2026-03-16T12:50:34.075216Z  INFO shard-0 server::shard::tasks::periodic::sysinfo_printer: CPU: 0.00%/0.42% (IggyUsage/Total), Mem: 49.11%/95.69 MB/486.38 MB/955.73 MB (Free/IggyUsage/TotalUsed/Total), Clients: 3, Messages: 1k, Read: 3.23 MB, Written: 118.78 KB, OpenFDs: 196
Mar 16 12:50:34 ip-10-0-0-116 iggy-server[1482]: 2026-03-16T12:50:34.088574Z  INFO shard-0 server::shard::tasks::periodic::message_saver: Flushed 2 partitions.
Mar 16 12:50:34 ip-10-0-0-116 iggy-server[1482]: 2026-03-16T12:50:34.936784Z  INFO shard-0 server::tcp::tcp_tls_listener: Accepted new TCP connection for TLS handshake: 109.243.3.168:15649
Mar 16 12:50:35 ip-10-0-0-116 iggy-server[1482]: 2026-03-16T12:50:35.213818Z  INFO shard-0 server::tcp::tcp_tls_listener: TLS handshake successful, adding TCP client: 109.243.3.168:15649
Mar 16 12:50:35 ip-10-0-0-116 iggy-server[1482]: 2026-03-16T12:50:35.213911Z  INFO shard-0 server::tcp::tcp_tls_listener: Added tcp client with session: client ID: 218821652, IP address: 109.243.3.168:15649 for IP address: 109.243.3.168:15649
Mar 16 12:50:35 ip-10-0-0-116 iggy-server[1482]: 2026-03-16T12:50:35.213919Z  INFO shard-0 server::tcp::tcp_tls_listener: Created new session: client ID: 218821652, IP address: 109.243.3.168:15649
Mar 16 12:50:35 ip-10-0-0-116 iggy-server[1482]: 2026-03-16T12:50:35.214699Z  INFO shard-0 trace_login_user{iggy_user_id=4294967295 iggy_client_id=218821652}: server::binary::handlers::users::login_user_handler: Logging in user: root ...
Mar 16 12:50:35 ip-10-0-0-116 iggy-server[1482]: 2026-03-16T12:50:35.253980Z  INFO shard-0 trace_login_user{iggy_user_id=4294967295 iggy_client_id=218821652}: server::binary::handlers::users::login_user_handler: Logged in user: root with ID: 0.
Mar 16 12:50:42 ip-10-0-0-116 iggy-server[1482]: 2026-03-16T12:50:42.675764Z  INFO shard-0 server::shard::system::clients: Deleted tcp client with ID: 218821652 for IP address: 109.243.3.168:15649
Mar 16 12:50:42 ip-10-0-0-116 iggy-server[1482]: 2026-03-16T12:50:42.675859Z  INFO shard-0 server::tcp::tcp_tls_listener: Successfully closed TCP TLS stream for client: 218821652, address: 109.243.3.168:15649.
Mar 16 12:50:44 ip-10-0-0-116 iggy-server[1482]: 2026-03-16T12:50:44.075878Z  INFO shard-0 server::shard::tasks::periodic::sysinfo_printer: CPU: 0.00%/0.46% (IggyUsage/Total), Mem: 46.92%/116.66 MB/507.27 MB/955.73 MB (Free/IggyUsage/TotalUsed/Total), Clients: 3, Messages: 1k, Read: 3.23 MB, Written: 614.40 KB, OpenFDs: 196
Mar 16 12:50:54 ip-10-0-0-116 iggy-server[1482]: 2026-03-16T12:50:54.076597Z  INFO shard-0 server::shard::tasks::periodic::sysinfo_printer: CPU: 0.00%/0.33% (IggyUsage/Total), Mem: 46.92%/116.66 MB/507.27 MB/955.73 MB (Free/IggyUsage/TotalUsed/Total), Clients: 3, Messages: 1k, Read: 3.23 MB, Written: 618.50 KB, OpenFDs: 196
Mar 16 12:51:04 ip-10-0-0-116 iggy-server[1482]: 2026-03-16T12:51:04.077149Z  INFO shard-0 server::shard::tasks::periodic::sysinfo_printer: CPU: 0.00%/0.84% (IggyUsage/Total), Mem: 46.92%/116.66 MB/507.27 MB/955.73 MB (Free/IggyUsage/TotalUsed/Total), Clients: 3, Messages: 1k, Read: 3.23 MB, Written: 618.50 KB, OpenFDs: 196
Mar 16 12:51:04 ip-10-0-0-116 iggy-server[1482]: 2026-03-16T12:51:04.093861Z  INFO shard-0 server::shard::tasks::periodic::message_saver: Flushed 1 partitions.
Iggy errors only (last 24h)
-- No entries --

Connectors Logs2 entries

journalctl -u iggy-connectors (last 2000 lines)
Mar 16 12:50:05 ip-10-0-0-116 systemd[1]: Started iggy-connectors.service - Iggy Connectors Runtime.
Mar 16 12:50:05 ip-10-0-0-116 iggy-connectors[1513]:   ___                              ____                                         _
Mar 16 12:50:05 ip-10-0-0-116 iggy-connectors[1513]:  |_ _|   __ _    __ _   _   _     / ___|   ___    _ __    _ __     ___    ___  | |_    ___    _ __   ___
Mar 16 12:50:05 ip-10-0-0-116 iggy-connectors[1513]:   | |   / _` |  / _` | | | | |   | |      / _ \  | '_ \  | '_ \   / _ \  / __| | __|  / _ \  | '__| / __|
Mar 16 12:50:05 ip-10-0-0-116 iggy-connectors[1513]:   | |  | (_| | | (_| | | |_| |   | |___  | (_) | | | | | | | | | |  __/ | (__  | |_  | (_) | | |    \__ \
Mar 16 12:50:05 ip-10-0-0-116 iggy-connectors[1513]:  |___|  \__, |  \__, |  \__, |    \____|  \___/  |_| |_| |_| |_|  \___|  \___|  \__|  \___/  |_|    |___/
Mar 16 12:50:05 ip-10-0-0-116 iggy-connectors[1513]:         |___/   |___/   |___/
Mar 16 12:50:05 ip-10-0-0-116 iggy-connectors[1513]: Starting Iggy Connectors Runtime, loading configuration from: core/connectors/runtime/config.toml...
Mar 16 12:50:05 ip-10-0-0-116 iggy-connectors[1513]: 2026-03-16T12:50:05.635973Z  INFO iggy_connectors: State will be stored in: /opt/connectors/state
Mar 16 12:50:05 ip-10-0-0-116 iggy-connectors[1513]: 2026-03-16T12:50:05.636032Z  INFO iggy_connectors::stream: Using token=PcD*** for Iggy authentication
Mar 16 12:50:05 ip-10-0-0-116 iggy-connectors[1513]: 2026-03-16T12:50:05.636087Z  INFO iggy::tcp::tcp_client: Iggy client is connecting to server: 127.0.0.1:8090...
Mar 16 12:50:05 ip-10-0-0-116 iggy-connectors[1513]: 2026-03-16T12:50:05.690987Z  INFO iggy::tcp::tcp_client: Iggy client: 127.0.0.1:46654 has connected to server: 127.0.0.1:8090 at: 2026-03-16 12:50:05
Mar 16 12:50:05 ip-10-0-0-116 iggy-connectors[1513]: 2026-03-16T12:50:05.691033Z  INFO iggy::tcp::tcp_client: Iggy client: 127.0.0.1:46654 is signing in...
Mar 16 12:50:05 ip-10-0-0-116 iggy-connectors[1513]: 2026-03-16T12:50:05.772718Z  INFO iggy::tcp::tcp_client: Iggy client: 127.0.0.1:46654 has signed in with a personal access token.
Mar 16 12:50:05 ip-10-0-0-116 iggy-connectors[1513]: 2026-03-16T12:50:05.813802Z  INFO iggy_connectors::stream: Using token=PcD*** for Iggy authentication
Mar 16 12:50:05 ip-10-0-0-116 iggy-connectors[1513]: 2026-03-16T12:50:05.813846Z  INFO iggy::tcp::tcp_client: Iggy client is connecting to server: 127.0.0.1:8090...
Mar 16 12:50:05 ip-10-0-0-116 iggy-connectors[1513]: 2026-03-16T12:50:05.819797Z  INFO iggy::tcp::tcp_client: Iggy client: 127.0.0.1:46658 has connected to server: 127.0.0.1:8090 at: 2026-03-16 12:50:05
Mar 16 12:50:05 ip-10-0-0-116 iggy-connectors[1513]: 2026-03-16T12:50:05.819827Z  INFO iggy::tcp::tcp_client: Iggy client: 127.0.0.1:46658 is signing in...
Mar 16 12:50:05 ip-10-0-0-116 iggy-connectors[1513]: 2026-03-16T12:50:05.900642Z  INFO iggy::tcp::tcp_client: Iggy client: 127.0.0.1:46658 has signed in with a personal access token.
Mar 16 12:50:05 ip-10-0-0-116 iggy-connectors[1513]: 2026-03-16T12:50:05.949301Z  INFO iggy_connectors: Found 0 source and 0 sink configurations.
Mar 16 12:50:05 ip-10-0-0-116 iggy-connectors[1513]: 2026-03-16T12:50:05.949397Z  INFO iggy_connectors: All sources and sinks spawned.
Mar 16 12:50:05 ip-10-0-0-116 iggy-connectors[1513]: 2026-03-16T12:50:05.949595Z  INFO iggy_connectors::api: Started iggy-connectors HTTP API on: 127.0.0.1:8081
Connectors errors only (last 24h)
-- No entries --

Prober Logs2 entries

journalctl -u prober (last 2000 lines)
Mar 16 12:50:02 ip-10-0-0-116 systemd[1]: laser-prober.service: Failed to load environment files: No such file or directory
Mar 16 12:50:02 ip-10-0-0-116 systemd[1]: laser-prober.service: Failed to spawn 'start-pre' task: No such file or directory
Mar 16 12:50:02 ip-10-0-0-116 systemd[1]: laser-prober.service: Failed with result 'resources'.
Mar 16 12:50:02 ip-10-0-0-116 systemd[1]: Failed to start laser-prober.service - LaserData Prober.
Mar 16 12:50:05 ip-10-0-0-116 systemd[1]: Stopped laser-prober.service - LaserData Prober.
Mar 16 12:50:05 ip-10-0-0-116 systemd[1]: laser-prober.service: Failed to load environment files: No such file or directory
Mar 16 12:50:05 ip-10-0-0-116 systemd[1]: laser-prober.service: Failed to spawn 'start-pre' task: No such file or directory
Mar 16 12:50:05 ip-10-0-0-116 systemd[1]: laser-prober.service: Failed with result 'resources'.
Mar 16 12:50:05 ip-10-0-0-116 systemd[1]: Failed to start laser-prober.service - LaserData Prober.
Mar 16 12:50:15 ip-10-0-0-116 systemd[1]: laser-prober.service: Scheduled restart job, restart counter is at 1.
Mar 16 12:50:15 ip-10-0-0-116 systemd[1]: Starting laser-prober.service - LaserData Prober...
Mar 16 12:50:15 ip-10-0-0-116 systemd[1]: Started laser-prober.service - LaserData Prober.
Prober errors only (last 24h)
Mar 16 12:50:02 ip-10-0-0-116 systemd[1]: laser-prober.service: Failed to load environment files: No such file or directory
Mar 16 12:50:02 ip-10-0-0-116 systemd[1]: Failed to start laser-prober.service - LaserData Prober.
Mar 16 12:50:05 ip-10-0-0-116 systemd[1]: laser-prober.service: Failed to load environment files: No such file or directory
Mar 16 12:50:05 ip-10-0-0-116 systemd[1]: Failed to start laser-prober.service - LaserData Prober.

Error & System Logs3 entries

journalctl -p err (last 500)
Mar 16 12:50:02 ip-10-0-0-116 systemd[1]: laser-prober.service: Failed to load environment files: No such file or directory
Mar 16 12:50:02 ip-10-0-0-116 systemd[1]: Failed to start laser-prober.service - LaserData Prober.
Mar 16 12:50:03 ip-10-0-0-116 systemd[1]: Failed to start cloud-final.service - Cloud-init: Final Stage.
Mar 16 12:50:05 ip-10-0-0-116 systemd[1]: laser-prober.service: Failed to load environment files: No such file or directory
Mar 16 12:50:05 ip-10-0-0-116 systemd[1]: Failed to start laser-prober.service - LaserData Prober.
journalctl -p warning (LaserData services, last 24h)
Mar 16 12:50:02 ip-10-0-0-116 systemd[1]: laser-prober.service: Failed to load environment files: No such file or directory
Mar 16 12:50:02 ip-10-0-0-116 systemd[1]: laser-prober.service: Failed to spawn 'start-pre' task: No such file or directory
Mar 16 12:50:02 ip-10-0-0-116 systemd[1]: laser-prober.service: Failed with result 'resources'.
Mar 16 12:50:02 ip-10-0-0-116 systemd[1]: Failed to start laser-prober.service - LaserData Prober.
Mar 16 12:50:05 ip-10-0-0-116 systemd[1]: laser-prober.service: Failed to load environment files: No such file or directory
Mar 16 12:50:05 ip-10-0-0-116 systemd[1]: laser-prober.service: Failed to spawn 'start-pre' task: No such file or directory
Mar 16 12:50:05 ip-10-0-0-116 systemd[1]: laser-prober.service: Failed with result 'resources'.
Mar 16 12:50:05 ip-10-0-0-116 systemd[1]: Failed to start laser-prober.service - LaserData Prober.
Mar 16 12:51:06 ip-10-0-0-116 systemd[1]: warden.service: Got notification message from PID 1535, but reception only permitted for main PID 1409
Mar 16 12:51:06 ip-10-0-0-116 systemd[1]: warden.service: Got notification message from PID 1634, but reception only permitted for main PID 1409
Mar 16 12:51:06 ip-10-0-0-116 systemd[1]: warden.service: Got notification message from PID 1656, but reception only permitted for main PID 1409
Mar 16 12:51:06 ip-10-0-0-116 systemd[1]: warden.service: Got notification message from PID 1695, but reception only permitted for main PID 1409
Mar 16 12:51:06 ip-10-0-0-116 systemd[1]: warden.service: Got notification message from PID 1686, but reception only permitted for main PID 1409
Mar 16 12:51:06 ip-10-0-0-116 systemd[1]: warden.service: Got notification message from PID 1736, but reception only permitted for main PID 1409
Mar 16 12:51:06 ip-10-0-0-116 systemd[1]: warden.service: Got notification message from PID 1738, but reception only permitted for main PID 1409
Mar 16 12:51:06 ip-10-0-0-116 systemd[1]: warden.service: Got notification message from PID 1712, but reception only permitted for main PID 1409
Mar 16 12:51:06 ip-10-0-0-116 systemd[1]: warden.service: Got notification message from PID 1696, but reception only permitted for main PID 1409
Mar 16 12:51:06 ip-10-0-0-116 systemd[1]: warden.service: Got notification message from PID 1703, but reception only permitted for main PID 1409
Mar 16 12:51:06 ip-10-0-0-116 systemd[1]: warden.service: Got notification message from PID 1698, but reception only permitted for main PID 1409
Mar 16 12:51:06 ip-10-0-0-116 systemd[1]: warden.service: Got notification message from PID 1745, but reception only permitted for main PID 1409
Mar 16 12:51:06 ip-10-0-0-116 systemd[1]: warden.service: Got notification message from PID 1718, but reception only permitted for main PID 1409
Mar 16 12:51:06 ip-10-0-0-116 systemd[1]: warden.service: Got notification message from PID 1733, but reception only permitted for main PID 1409
Mar 16 12:51:06 ip-10-0-0-116 systemd[1]: warden.service: Got notification message from PID 1740, but reception only permitted for main PID 1409
Mar 16 12:51:06 ip-10-0-0-116 systemd[1]: warden.service: Got notification message from PID 1752, but reception only permitted for main PID 1409
Mar 16 12:51:06 ip-10-0-0-116 systemd[1]: warden.service: Got notification message from PID 1742, but reception only permitted for main PID 1409
Mar 16 12:51:06 ip-10-0-0-116 systemd[1]: warden.service: Got notification message from PID 1772, but reception only permitted for main PID 1409
Mar 16 12:51:06 ip-10-0-0-116 systemd[1]: warden.service: Got notification message from PID 1800, but reception only permitted for main PID 1409
Boot log errors
Mar 16 12:50:02 ip-10-0-0-116 systemd[1]: laser-prober.service: Failed to load environment files: No such file or directory
Mar 16 12:50:02 ip-10-0-0-116 systemd[1]: Failed to start laser-prober.service - LaserData Prober.
Mar 16 12:50:03 ip-10-0-0-116 systemd[1]: Failed to start cloud-final.service - Cloud-init: Final Stage.
Mar 16 12:50:05 ip-10-0-0-116 systemd[1]: laser-prober.service: Failed to load environment files: No such file or directory
Mar 16 12:50:05 ip-10-0-0-116 systemd[1]: Failed to start laser-prober.service - LaserData Prober.

Dmesg & Kernel2 entries

dmesg --time-format iso (last 300)
Kernel errors & warnings

Journal Storage2 entries

journalctl --disk-usage
Archived and active journals take up 16.0M in the file system.
Journal configuration
(default configuration, no overrides)

Time Synchronization1 entries

Time sync status
=== Current time ===
2026-03-16 12:51:06 UTC
2026-03-16 12:51:06 UTC (local)

=== chrony status ===
Reference ID    : A9FEA97B (169.254.169.123)
Stratum         : 4
Ref time (UTC)  : Mon Mar 16 12:51:03 2026
System time     : 0.000014163 seconds slow of NTP time
Last offset     : -0.000013265 seconds
RMS offset      : 0.000201336 seconds
Frequency       : 0.727 ppm slow
Residual freq   : -0.026 ppm
Skew            : 1.213 ppm
Root delay      : 0.000313438 seconds
Root dispersion : 0.000207362 seconds
Update interval : 17.3 seconds
Leap status     : Normal


  .-- Source mode  '^' = server, '=' = peer, '#' = local clock.
 / .- Source state '*' = current best, '+' = combined, '-' = not combined,
| /             'x' = may be in error, '~' = too variable, '?' = unusable.
||                                                 .- xxxx [ yyyy ] +/- zzzz
||      Reachability register (octal) -.           |  xxxx = adjusted offset,
||      Log2(Polling interval) --.      |          |  yyyy = measured offset,
||                                \     |          |  zzzz = estimated error.
||                                 |    |           \
MS Name/IP address         Stratum Poll Reach LastRx Last sample               
===============================================================================
^* 169.254.169.123               3   4   377     2    -13us[  -26us] +/-  378us
^- prod-ntp-4.ntp4.ps5.cano>     2   6    37     4  +2051us[+2038us] +/-   68ms
^- prod-ntp-5.ntp1.ps5.cano>     2   6    37     3  +8884us[+8871us] +/-   78ms
^- prod-ntp-3.ntp1.ps5.cano>     2   6    37     3  +3048us[+3035us] +/-   68ms
^- alphyn.canonical.com          2   6    37     3  +3593us[+3580us] +/-   61ms
^- kjsl-fmt2-net.fmt2.kjsl.>     2   6    37     3    -53us[  -67us] +/- 1652us
^- s2-b.time.mci1.us.rozint>     2   6    17    68   +860us[ +850us] +/-   32ms
^- arm1.maxhost.io               2   6    37     4   +812us[ +799us] +/-   31ms
^- ntp1.lax.us.hojmark.net       2   6    37     4   -552us[ -564us] +/-   31ms

=== NTP status ===
(ntpq not available)

=== systemd-timesyncd ===
(timesyncd not active)

(timesync-status not available)

Outbound Connectivity1 entries

Let's Encrypt ACME reachability
=== acme-v02.api.letsencrypt.org ===
  HTTP status: 200
  ACME directory reachable

=== Outbound port 80/443 test ===
Port 443 outbound: OK
Port 80 outbound: OK

Coredump History1 entries

Recent coredumps
=== coredumpctl list (last 30 days) ===
(coredumpctl not available or no coredumps)

=== LaserData binary coredumps ===
=== Coredump storage ===
4.0K	/var/lib/systemd/coredump/

Security Context2 entries

AppArmor status
=== AppArmor ===
apparmor module is loaded.
apparmor module is loaded.
(AppArmor not available)

=== SELinux ===
(SELinux not available)
Kernel security features
=== Kernel security modules ===
lockdown,capability,landlock,yama,apparmor,ima,evm
=== ASLR ===
randomize_va_space: 2

=== Entropy available ===
entropy_avail: 256

=== Kernel hardening ===
kernel.dmesg_restrict                    = 1
kernel.kptr_restrict                     = 1
kernel.yama.ptrace_scope                 = 1

Cgroup & Resource Limits2 entries

Service resource limits
=== warden.service ===
  Cgroup: /system.slice/warden.service
  MemoryMax: infinity
  CPUQuota: infinity
  Current memory: 62697472
  OOM events: oom_kill 0

=== iggy-server.service ===
  Cgroup: /system.slice/iggy-server.service
  MemoryMax: infinity
  CPUQuota: infinity
  Current memory: 104681472
  OOM events: oom_kill 0

=== iggy-connectors.service ===
  Cgroup: /system.slice/iggy-connectors.service
  MemoryMax: infinity
  CPUQuota: infinity
  Current memory: 16736256
  OOM events: oom_kill 0

=== laser-prober.service ===
  Cgroup: /system.slice/laser-prober.service
  MemoryMax: infinity
  CPUQuota: infinity
  Current memory: 1019904
  OOM events: oom_kill 0

Cgroup v1/v2 detection
Cgroup version: v2 (unified)
Controllers: cpuset cpu io memory hugetlb pids rdma misc dmem

=== Systemd resource accounting ===
DefaultCPUAccounting=yes
DefaultMemoryAccounting=yes

Package & Update Status1 entries

Pending security updates
=== Pending updates ===
Listing...

=== Security updates count ===
Pending security updates: 0
0

=== Unattended-upgrades status ===
● unattended-upgrades.service - Unattended Upgrades Shutdown
     Loaded: loaded (/usr/lib/systemd/system/unattended-upgrades.service; enabled; preset: enabled)
     Active: active (running) since Mon 2026-03-16 12:49:50 UTC; 1min 17s ago
       Docs: man:unattended-upgrade(8)
   Main PID: 776 (unattended-upgr)
      Tasks: 2 (limit: 1013)
     Memory: 11.1M (peak: 11.3M)
        CPU: 83ms
     CGroup: /system.slice/unattended-upgrades.service
             └─776 /usr/bin/python3 /usr/share/unattended-upgrades/unattended-upgrade-shutdown --wait-for-signal

Mar 16 12:49:50 ip-10-0-0-116 systemd[1]: Started unattended-upgrades.service - Unattended Upgrades Shutdown.

=== Last apt update ===
2026-03-16 11:43:29.548733410 +0000

=== Kernel version check ===
Running: 6.17.0-1007-aws
Installed: linux-image-aws
=== Reboot required? ===
No reboot required

Kernel Modules & Hardware3 entries

Loaded kernel modules
=== Key modules ===
tcp_diag               12288  0
inet_diag              28672  2 tcp_diag,udp_diag
xt_mark                12288  5
xt_tcpudp              16384  0
xt_connmark            12288  9
nf_tables             385024  77 nft_compat
nf_conntrack          192512  1 xt_connmark
nf_defrag_ipv6         24576  1 nf_conntrack
nf_defrag_ipv4         12288  1 nf_conntrack
nvme_fabrics           36864  0
nfnetlink              20480  4 nft_compat,nf_tables
ip_tables              32768  0
x_tables               65536  5 nft_compat,xt_tcpudp,xt_connmark,ip_tables,xt_mark

=== All modules (count) ===
44
Interrupt distribution (top 20)
=== /proc/interrupts (top 20 by total count) ===
           CPU0       CPU1       
LOC:      19300      18095   Local timer interrupts
CAL:       8615       7310   Function call interrupts
 25:       4925          0 PCI-MSIX-0000:00:04.0   1-edge      nvme0q1
RES:       3064       2137   Rescheduling interrupts
 29:       1450          0 PCI-MSIX-0000:00:05.0   2-edge      ens5-Tx-Rx-1
 28:        541       1588 PCI-MSIX-0000:00:05.0   1-edge      ens5-Tx-Rx-0
TLB:        432        392   TLB shootdowns
 27:        118         10 PCI-MSIX-0000:00:05.0   0-edge      ena-mgmnt@pci:0000:00:05.0
  1:         10          0  IO-APIC   1-edge      i8042
MCP:          1          1   Machine check polls
IWI:          1         48   IRQ work interrupts
TRM:          0          0   Thermal event interrupts
THR:          0          0   Threshold APIC interrupts
SPU:          0          0   Spurious interrupts
RTR:          0          0   APIC ICR read retries
PMI:          0          0   Performance monitoring interrupts
PIW:          0          0   Posted-interrupt wakeup event
PIN:          0          0   Posted-interrupt notification event
NPI:          0          0   Nested posted-interrupt event
NMI:          0          0   Non-maskable interrupts

=== Softirq stats ===
                    CPU0       CPU1       
          HI:          0          0
       TIMER:       4220       4030
      NET_TX:        304         12
      NET_RX:       2389       2072
       BLOCK:        130        168
    IRQ_POLL:          0          0
     TASKLET:        679         12
       SCHED:       5233       4878
     HRTIMER:          0          0
         RCU:      14780      14491
MCE / hardware errors
=== Machine Check Exceptions ===

=== EDAC (ECC memory) ===

System Stability3 entries

Boot & reboot history
=== Reboot history (last 20) ===
reboot   system boot  6.17.0-1007-aws  Mon Mar 16 12:49   still running
reboot   system boot  6.17.0-1007-aws  Mon Mar 16 11:42 - 11:43  (00:01)

wtmp begins Mon Mar 16 11:42:15 2026

=== System boot time ===
         system boot  2026-03-16 12:49

=== Unexpected shutdowns ===
shutdown system down  6.17.0-1007-aws  Mon Mar 16 11:43 - 12:49  (01:05)

wtmp begins Mon Mar 16 11:42:15 2026
vmstat snapshot
=== vmstat (5 samples, 1s interval) ===
procs -----------memory---------- ---swap-- -----io---- -system-- -------cpu-------
 r  b   swpd   free   buff  cache   si   so    bi    bo   in   cs us sy id wa st gu
38  2      0 116956  20316 440920    0    0  3375  1928  658    4  5  3 45 47  0  0
 9  1      0 102888  20320 442564    0    0  1668     0 2865 5431 61 39  0  0  0  0
 2  1      0 112224  20320 442648    0    0   136     0 3069 5321 59 39  2  1  0  0
 0  1      0 121936  20320 442456    0    0     0     4 1637 2624  8 18 37 37  0  0
 0  1      0 131216  20320 442408    0    0     0     4  189  231  0  1 50 50  0  0

=== Swap activity ===

pswpin 0
pswpout 0
pgfault 799050
pgmajfault 1907
oom_kill 0
Zombie & defunct processes
No zombie processes

Systemd Unit Files & Overrides2 entries

Service unit file contents
=== /etc/systemd/system/warden.service ===
[Unit]
Description=LaserData Warden
After=network-online.target
Wants=network-online.target

[Service]
Type=notify
User=ubuntu
WorkingDirectory=/opt/warden
Environment="LASER_WARDEN_ENV_PATH=/etc/warden/warden.env"
ExecStart=/opt/warden/current/laser-warden
Restart=always
RestartSec=5
WatchdogSec=30
AmbientCapabilities=CAP_NET_BIND_SERVICE
StandardOutput=journal
StandardError=journal

[Install]
WantedBy=multi-user.target

=== /etc/systemd/system/iggy-server.service ===
[Unit]
Description=Iggy Server
After=network.target

[Service]
Type=simple
User=ubuntu
WorkingDirectory=/opt/iggy
EnvironmentFile=/opt/iggy/current/iggy.env
ExecStart=/opt/iggy/current/iggy-server
Restart=no
StandardOutput=journal
StandardError=journal

[Install]
WantedBy=multi-user.target

=== /etc/systemd/system/iggy-connectors.service ===
[Unit]
Description=Iggy Connectors Runtime
After=network.target

[Service]
Type=simple
User=ubuntu
WorkingDirectory=/opt/connectors
EnvironmentFile=/opt/connectors/current/connectors.env
ExecStart=/opt/connectors/current/iggy-connectors
Restart=no
StandardOutput=journal
StandardError=journal

[Install]
WantedBy=multi-user.target

=== /etc/systemd/system/laser-prober.service ===
[Unit]
Description=LaserData Prober
After=network.target warden.service

[Service]
Type=simple
User=ubuntu
WorkingDirectory=/opt/prober
EnvironmentFile=/opt/iggy/current/iggy.env
EnvironmentFile=/etc/warden/credentials/prober.env
ExecStartPre=/bin/bash -c 'for i in $(seq 1 60); do [ -s /etc/warden/credentials/prober.pat ] && [ -s /etc/warden/credentials/prober.env ] && exit 0; echo "Waiting for prober credentials ($i/60)..."; sleep 5; done; echo "FATAL: prober credentials not provisioned after 5 minutes"; exit 1'
ExecStart=/opt/prober/current/laser-prober
Restart=always
RestartSec=10
StandardOutput=journal
StandardError=journal

[Install]
WantedBy=multi-user.target

Systemd drop-in overrides
=== /etc/systemd/system/iggy-server.service.d/mimalloc.conf ===
[Service]
Environment="MIMALLOC_ALLOW_LARGE_OS_PAGES=1"

=== /etc/systemd/system/iggy-connectors.service.d/mimalloc.conf ===
[Service]
Environment="MIMALLOC_ALLOW_LARGE_OS_PAGES=1"

=== Override directories ===
total 12
drwxr-xr-x  2 root root 4096 Mar 16 11:43 .
drwxr-xr-x 29 root root 4096 Mar 16 12:49 ..
-rw-r--r--  1 root root   56 Mar 16 11:43 mimalloc.conf

total 12
drwxr-xr-x  2 root root 4096 Mar 16 11:43 .
drwxr-xr-x 29 root root 4096 Mar 16 12:49 ..
-rw-r--r--  1 root root   56 Mar 16 11:43 mimalloc.conf

Warden & Runtime Info10 entries

Warden Version
0.6.110
Node ID
610918396883632646
API Endpoint
https://us.aws.supervisor.laserdata.cloud
Iggy Runtime
version: 0.7.2-edge.1, status: RUNNING, exists: true, initialized: true
Connectors Runtime
version: 0.3.2-edge.1, status: RUNNING, exists: true, initialized: true
CPU Target
amd64-skylake
API Connectivity
https://us.aws.supervisor.laserdata.cloud -> reachable
Releases URL Connectivity
https://artifacts.laserdata.com -> reachable
Connectors Store
sinks: 0, sources: 0
Snapshot Timestamp
2026-03-16T12:51:11.225031009+00:00

Warden Process Metrics14 entries

Process ID
1409
Warden CPU Usage
0.0%
System CPU Usage
10.1%
Warden Memory
29.17 MB
Total Memory
955.73 MB total, 443.70 MB available
Warden Run Time
1m 10s
Warden Start Time
2026-03-16 12:50:01 UTC
Load Average
1m: 1.01, 5m: 0.51, 15m: 0.20
Disk Usage (/)
2.53 GB used / 19.68 GB total (17.16 GB available, 12.8% used)
Swap
0 B used / 0 B total
Disk I/O
read: 6.53 MB, written: 155.65 KB
Network I/O
rx: 42.04 MB, tx: 1.61 MB
File Descriptors
379 open / 524288 max
Threads
9

Runtime Telemetry4 entries

Runtime Statuses
  Connectors           Healthy
  Iggy                 Healthy
  Warden               Healthy
Warden Tasks
completed: 0, failed: 0
Connectors Runtime Metrics
Process ID:        1513
CPU Usage:         0.0%
Memory Usage:      27.47 MB
Run Time:          1m 2s
Sources:           0 running / 0 total
Sinks:             0 running / 0 total
Iggy Runtime Metrics
Process ID:        1482
CPU Usage:         0.0%
Memory Usage:      116.66 MB
Run Time:          1m 6s
Total Messages:    1011
User Messages:     1000
Prober Messages:   11
Streams:           2
Topics:            2
Partitions:        2
Clients:           3
Read Bytes:        3.23 MB
Written Bytes:     626.69 KB
Messages Size:     464.20 KB
Oldest Probe:      1773665416022976
Latest Probe:      1773665466024009

Iggy Server Health5 entries

Iggy API URL (from config)
http://localhost:3000
Iggy /ping
HTTP 200 OK
pong
Iggy /metrics
HTTP 200 OK
# HELP http_requests total count of http_requests.
# TYPE http_requests counter
http_requests_total 96
# HELP streams total count of streams.
# TYPE streams gauge
streams 2
# HELP topics total count of topics.
# TYPE topics gauge
topics 2
# HELP partitions total count of partitions.
# TYPE partitions gauge
partitions 2
# HELP segments total count of segments.
# TYPE segments gauge
segments 2
# HELP messages total count of messages.
# TYPE messages gauge
messages 1012
# HELP users total count of users.
# TYPE users gauge
users 4
# HELP clients total count of clients.
# TYPE clients gauge
clients 3
# EOF
Iggy Stats (authenticated)
Process ID:        1482
CPU Usage:         0.0%
Total CPU Usage:   6.4%
Memory Usage:      116.68 MB
Total Memory:      955.73 MB
Available Memory:  443.70 MB
Run Time:          1m 9s
Start Time:        2026-03-16 12:50:02
Read Bytes:        3.23 MB
Written Bytes:     626.69 KB
Messages Size:     464.32 KB
Streams:           2
Topics:            2
Partitions:        2
Segments:          2
Messages:          1012
Clients:           3
Consumer Groups:   0
Hostname:          ip-10-0-0-116
OS:                Ubuntu
OS Version:        Linux (Ubuntu 24.04)
Kernel:            6.17.0-1007-aws
Iggy Version:      0.7.2-edge.1
Iggy Semver:       7002
Iggy Transport Config & Reachability
=== HTTP Transport ===
enabled: true
address: 127.0.0.1:3000
tls_enabled: false
port 3000: LISTENING

=== TCP Transport ===
enabled: true
address: 0.0.0.0:8090
tls_enabled: true
tls_cert: /etc/laserdata/certs/server-fullchain.crt
port 8090: LISTENING
TLS handshake: Can't use SSL_get_servername
depth=2 C = US, ST = State, L = City, O = LaserData, OU = Security, CN = LaserData Root CA
verify return:1
depth=1 C = US, ST = California, L = San Francisco, O = LaserData, OU = Infrastructure, CN = LaserData aws 324037274906 us-west-1
verify return:1

=== QUIC Transport ===
enabled: false
address: 0.0.0.0:8080
(disabled - skipping port check)

=== WebSocket Transport ===
enabled: true
address: 0.0.0.0:8070
tls_enabled: true
port 8070: LISTENING