DCMD daemon getting crashed due to confd.

[iyyapa]

We've upgrading the software within patch releases. But, the dcmd went rolling reboot and the devices are stable after one hr.

Can someone help in which scenario we could hit the crash and the confd version is 6.3

confderr.log.1
^@^@^Ak^@,Internal error: failed to load AAA from CDB
j^@^@^D^[bWLA<83>h^Bk^@^Y13-Oct-2024::08:14:40.281h^Cd^@^Eerrorgd^@^Mnonode@nohost^@^@^@^^@^@^@^@^@h^Cgd^@^Mnonode@nohost^@^@^D¤^@^@^@^@^@k^@failed too load AAA ~p fromCDB: pnl^@^@^@^Bl^@^@^@^Al^@^@^@^Ad^@^\http://tail-f.com/ns/aaa/1.1d^@^Caaajh^Bd^@^Ofunction_clausel^@^@^@^Kh^Dd^@

confd.log
13-Oct-2024::12:59:24.381 st-intra-acc1Gsw01 confd[1145]: - Loading file /etc/confd/zone.ccl
13-Oct-2024::12:59:25.104 st-intra-acc1Gsw01 confd[1145]: - Starting to listen for Internal IPC on 127.0.0.1:4565
13-Oct-2024::12:59:27.844 st-intra-acc1Gsw01 confd[1145]: - ConfD phase0 started
13-Oct-2024::13:04:29.493 st-intra-acc1Gsw01 confd[1145]: - Internal error: failed to load AAA from CDB
13-Oct-2024::13:04:41.130 st-intra-acc1Gsw01 confd[3813]: - Enabling error log
13-Oct-2024::13:04:41.139 st-intra-acc1Gsw01 confd[3813]: - Writing error log to /var/confd/log/confderr.log
13-Oct-2024::13:04:41.175 st-intra-acc1Gsw01 confd[3813]: - Writing daemon log to /var/confd/log/confd.log
13-Oct-2024::13:04:41.175 st-intra-acc1Gsw01 confd[3813]: - Writing NETCONF log to /var/confd/log/netconf.log
13-Oct-2024::13:04:41.176 st-intra-acc1Gsw01 confd[3813]: - Writing audit log to /var/confd/log/audit.log
13-Oct-2024::13:04:41.176 st-intra-acc1Gsw01 confd[3813]: - Writing developer log to /var/confd/log/devel.log
13-Oct-2024::13:04:41.176 st-intra-acc1Gsw01 confd[3813]: - Daemon logging started
13-Oct-2024::13:04:41.190 st-intra-acc1Gsw01 confd[3813]: - Loading file libconfd.so
13-Oct-2024::13:04:41.217 st-intra-acc1Gsw01 confd[3813]: - Loading file /etc/confd/confd_types.so

13-Oct-2024::08:02:52.225 st-intra-coresw02 confd[4720]: - ConfD phase0 started
13-Oct-2024::08:02:52.693 st-intra-coresw02 confd[4720]: - no registration found for callpoint user_cp/get_next of type=external
13-Oct-2024::08:02:52.717 st-intra-coresw02 confd[4720]: - Internal error: failed to load AAA from CDB
13-Oct-2024::08:05:02.717 st-intra-coresw02 confd[8228]: - Enabling error log
13-Oct-2024::08:05:02.727 st-intra-coresw02 confd[8228]: - Writing error log to /var/confd/log/confderr.log
13-Oct-2024::08:05:02.766 st-intra-coresw02 confd[8228]: - Writing daemon log to /var/confd/log/confd.log
13-Oct-2024::08:05:02.767 st-intra-coresw02 confd[8228]: - Writing NETCONF log to /var/confd/log/netconf.log
13-Oct-2024::08:05:02.767 st-intra-coresw02 confd[8228]: - Writing audit log to /var/confd/log/audit.log
13-Oct-2024::08:05:02.767 st-intra-coresw02 confd[8228]: - Writing developer log to /var/confd/log/devel.log

(gdb) bt
#0 0x059e2d64 in *__GI_raise (sig=6) at ../nptl/sysdeps/unix/sysv/linux/raise.c:67
#1 0x059e8260 in *__GI_abort () at abort.c:88
#2 0x07179d94 in fos_sighandler (signum=318922584) at /vobs/projects/springboard/build/swbd1000/fabos/bccb/lib/utils/signals.c:212
#3
#4 0x059e2d64 in *__GI_raise (sig=6) at ../nptl/sysdeps/unix/sysv/linux/raise.c:67
#5 0x059e8260 in *__GI_abort () at abort.c:88
#6 0x059da6f0 in __GI___assert_fail (assertion=0xfcef43c "0", file=0xfc524cc "Framework/ObjectModel/WaveObjectManager.cpp", line=6537,
function=0xfc52118 "virtual void WaveNs::WaveObjectManager::prismAssert(bool, const char, WaveNs::UI32)") at assert.c:78
#7 0x0f3e00d0 in WaveNs::WaveObjectManager::prismAssert (this=0x108441b8, isAssertNotRequired=, pFileName=,
lineNumber=) at Framework/ObjectModel/WaveObjectManager.cpp:6537
#8 0x0f4cd698 in WaveNs::prismAssert (isAssertNotRequired=, pFileName=0xfcc1ea8 "Framework/OsLayer/PrismOsLayer.cpp", lineNumber=305)
at Framework/Utils/AssertUtils.cpp:17
#9 0x0f95409c in WaveNs::sigSegvHandler (signal=) at Framework/OsLayer/PrismOsLayer.cpp:305
#10
#11 0x05a315c0 in strlen () from ./lib/libc.so.6
#12 0x0739e68c in erl_mk_atom (s=0x0) at legacy/erl_eterm.c:140
#13 0x07362e34 in confd_notification_send (nctx=0x121cb288, time=0x1b506a58, values=0x1133a5f0, nvalues=) at confd_lib.c:5586
#14 0x0b4d5ec8 in DcmNs::NetconfNotificationStreamObjectManager::netconfNotificationHandler (this=0x1130b748, pNotifyMessage=0x16404120)
at ConfdGateway/NetconfNotificationStreamObjectManager.cpp:320
#15 0x0f3d3888 in WaveNs::WaveObjectManager::PrismOperationMapContext::executeMessageHandler (this=, pPrismMessage=)
at Framework/ObjectModel/WaveObjectManager.cpp:303
#16 0x0f3df8ac in WaveNs::WaveObjectManager::handlePrismMessage (this=0x1130b748, pPrismMessage=0x16404120) at Framework/ObjectModel/WaveObjectManager.cpp:1448
#17 0x0f96c1e4 in WaveNs::PrismThread::start (this=0x3) at Framework/MultiThreading/PrismThread.cpp:121
#18 0x0f96fcd0 in WaveNs::PrismPosixThread::pthreadStartMethod (pPrismPoixThread=0x0) at Framework/MultiThreading/PrismPosixThread.cpp:157
#19 0x0dfd9e98 in start_thread (arg=) at pthread_create.c:302
#20 0x05a8f554 in clone () from ./lib/libc.so.6
Previous frame inner to this frame (corrupt stack?)
(gdb)

[troglobit]

Sorry, but this is not the correct project. Infix has a component named confd, but it has no relation to the Tail-f/Cisco product ConfD. Happy you found us, but I'm closing this since we cannot help you.

Good luck!