[Z9100]: syncd crash is seen during fast-reboot

[chitra-raghavan]

Description

While running fast-reboot tests , synd crash is seen in Z9100 /Z9264f platforms.
script : advanced_reboot.py
Topology : T0

Steps to reproduce the issue:

1. Run the script advanced_reboot.py from sonic-mgmt repo
2. Check for syncd crash

Describe the results you received:
The device hangs after executing the fast-reboot command.

root@sonic-z9100-02:~# show arp  | wc
    510    2041   28511
root@sonic-z9100-02:~# [  525.222067] kexec_core: Starting new kernel 

syslog:
Jun 24 10:04:52.504158 sonic-z9100-02 NOTICE root: Rebooting with /sbin/kexec -e to SONiC-OS-HEAD.15-622c426a ...


 << Device hangs after this

Describe the results you expected:

Additional information you deem important (e.g. issue happens only occasionally):

Output of show version:

  root@sonic-z9100-02:~# show ver

SONiC Software Version: SONiC.HEAD.15-622c426a
Distribution: Debian 9.9
Kernel: 4.9.0-9-2-amd64
Build commit: 622c426a
Build date: Sun Jun 23 06:23:55 UTC 2019
Built by: johnar@jenkins-worker-3

Platform: x86_64-dell_z9100_c2538-r0
HwSKU: Force10-Z9100-C8D48
ASIC: broadcom
Serial Number: CN0GTX3X7793151D0003
Uptime: 10:18:41 up 11 min,  2 users,  load average: 0.66, 0.93, 0.82

Docker images:
REPOSITORY                 TAG                 IMAGE ID            SIZE
docker-syncd-brcm          HEAD.15-622c426a    7503f1450bf4        392MB
docker-syncd-brcm          latest              7503f1450bf4        392MB
docker-fpm-frr             HEAD.15-622c426a    381072f66e64        319MB
docker-fpm-frr             latest              381072f66e64        319MB
docker-lldp-sv2            HEAD.15-622c426a    b26e12331f44        299MB
docker-lldp-sv2            latest              b26e12331f44        299MB
docker-router-advertiser   HEAD.15-622c426a    c7138dc69688        280MB
docker-router-advertiser   latest              c7138dc69688        280MB
docker-dhcp-relay          HEAD.15-622c426a    586335930bed        288MB
docker-dhcp-relay          latest              586335930bed        288MB
docker-database            HEAD.15-622c426a    27f41ec7a059        280MB
docker-database            latest              27f41ec7a059        280MB
docker-teamd               HEAD.15-622c426a    ec3f1fda1b86        301MB
docker-teamd               latest              ec3f1fda1b86        301MB
docker-snmp-sv2            HEAD.15-622c426a    4233cbd40ad6        313MB
docker-snmp-sv2            latest              4233cbd40ad6        313MB
docker-orchagent           HEAD.15-622c426a    07471ddac6f2        319MB
docker-orchagent           latest              07471ddac6f2        319MB
docker-sonic-telemetry     HEAD.15-622c426a    a1f7cee4cb3d        302MB
docker-sonic-telemetry     latest              a1f7cee4cb3d        302MB
docker-platform-monitor    HEAD.15-622c426a    33fcdd9bfc0e        326MB
docker-platform-monitor    latest              33fcdd9bfc0e        326MB

Files Attached:
syslog-z9100-fast-reboot_master_15.log
fpmsyncd.1561370689.48.core.gz
syncd.1561370681.28.core.gz

[chitra-raghavan]

This is fixed in recent images