TritonDataCenter / smartos-live

For more information, please see http://smartos.org/ For any questions that aren't answered there, please join the SmartOS discussion list: https://smartos.topicbox.com/groups/smartos-discuss
1.57k stars 245 forks source link

panic in vmem_span_destroy running SmartOS 20200424T174452Z x86_64 #935

Open ingenthr opened 4 years ago

ingenthr commented 4 years ago

Glad to gather more information if it's of use. I've not looked at the core with mdb yet.

I had quite a bit of NFS file transfer traffic going on at the time, but nothing terribly intense.

2020-05-21T19:27:04.732631+00:00 00-14-d1-14-c1-84 klmmod: [ID 497209 kern.notice] NOTICE: Unable to set CLSET_NODELAYONERR#012
2020-05-21T19:36:28.540706+00:00 00-14-d1-14-c1-84 rsyslogd3: No files configured to be monitored [try http://www.rsyslog.com/e/-3 ]
2020-05-21T19:36:28.543867+00:00 00-14-d1-14-c1-84 unix: [ID 836849 kern.notice] #012#015panic[cpu0]/thread=fffffe005c017c20: 
2020-05-21T19:36:28.543875+00:00 00-14-d1-14-c1-84 genunix: [ID 683410 kern.notice] BAD TRAP: type=d (#gp General protection) rp=fffffe005c017880 addr=fffffe43a4f1c8e8
2020-05-21T19:36:28.543879+00:00 00-14-d1-14-c1-84 unix: [ID 100000 kern.notice] #012
2020-05-21T19:36:28.543882+00:00 00-14-d1-14-c1-84 unix: [ID 839527 kern.notice] sched: 
2020-05-21T19:36:28.543885+00:00 00-14-d1-14-c1-84 unix: [ID 753105 kern.notice] #gp General protection
2020-05-21T19:36:28.543888+00:00 00-14-d1-14-c1-84 unix: [ID 358286 kern.notice] addr=0xfffffe43a4f1c8e8
2020-05-21T19:36:28.543891+00:00 00-14-d1-14-c1-84 unix: [ID 243837 kern.notice] pid=0, pc=0xfffffffffbe9c814, sp=0xfffffe005c017970, eflags=0x10206
2020-05-21T19:36:28.543894+00:00 00-14-d1-14-c1-84 unix: [ID 619397 kern.notice] cr0: 8005003b<pg,wp,ne,et,ts,mp,pe>  cr4: 626f8<osxsav,pcide,vmxe,xmme,fxsr,pge,mce,pae,pse,de>
2020-05-21T19:36:28.543898+00:00 00-14-d1-14-c1-84 unix: [ID 152204 kern.notice] cr2: 7fffffefdff8  
2020-05-21T19:36:28.543901+00:00 00-14-d1-14-c1-84 unix: [ID 634440 kern.notice] cr3: 28400000  
2020-05-21T19:36:28.543913+00:00 00-14-d1-14-c1-84 unix: [ID 625715 kern.notice] cr8: 0
2020-05-21T19:36:28.543917+00:00 00-14-d1-14-c1-84 unix: [ID 100000 kern.notice] 
2020-05-21T19:36:28.543920+00:00 00-14-d1-14-c1-84 unix: [ID 592667 kern.notice] #011rdi: fffffe430a8b0000 rsi: fffffe43a4f4a2d8 rdx: fbfffe43a4f4a380
2020-05-21T19:36:28.543923+00:00 00-14-d1-14-c1-84 unix: [ID 592667 kern.notice] #011rcx: fffffe430a8b0000  r8: fffffe43a4f4a310  r9:            3ffff
2020-05-21T19:36:28.543926+00:00 00-14-d1-14-c1-84 unix: [ID 592667 kern.notice] #011rax: fffffe43a4f4a2a0 rbx: fffffe430a8b0020 rbp: fffffe005c017980
2020-05-21T19:36:28.543930+00:00 00-14-d1-14-c1-84 unix: [ID 592667 kern.notice] #011r10:                1 r11: fffffe4750dff000 r12: fffffe430a8b0000
2020-05-21T19:36:28.543933+00:00 00-14-d1-14-c1-84 unix: [ID 592667 kern.notice] #011r13: fffffe318f112000 r14: fffffe318f110000 r15: fffffe43a4f1c8e8
2020-05-21T19:36:28.543936+00:00 00-14-d1-14-c1-84 unix: [ID 592667 kern.notice] #011fsb:                0 gsb: fffffffffbc4c000  ds:               38
2020-05-21T19:36:28.543940+00:00 00-14-d1-14-c1-84 unix: [ID 592667 kern.notice] #011 es:                0  fs:                0  gs:                0
2020-05-21T19:36:28.543943+00:00 00-14-d1-14-c1-84 unix: [ID 592667 kern.notice] #011trp:                d err:                0 rip: fffffffffbe9c814
2020-05-21T19:36:28.543950+00:00 00-14-d1-14-c1-84 unix: [ID 592667 kern.notice] #011 cs:               30 rfl:            10206 rsp: fffffe005c017970
2020-05-21T19:36:28.543954+00:00 00-14-d1-14-c1-84 unix: [ID 266532 kern.notice] #011 ss:               38
2020-05-21T19:36:28.543957+00:00 00-14-d1-14-c1-84 unix: [ID 100000 kern.notice] 
2020-05-21T19:36:28.543960+00:00 00-14-d1-14-c1-84 genunix: [ID 655072 kern.notice] fffffe005c017780 unix:real_mode_stop_cpu_stage2_end+c38d ()
2020-05-21T19:36:28.543963+00:00 00-14-d1-14-c1-84 genunix: [ID 655072 kern.notice] fffffe005c017870 unix:trap+cc2 ()
2020-05-21T19:36:28.543966+00:00 00-14-d1-14-c1-84 genunix: [ID 655072 kern.notice] fffffe005c017880 unix:_cmntrap+e9 ()
2020-05-21T19:36:28.543970+00:00 00-14-d1-14-c1-84 genunix: [ID 655072 kern.notice] fffffe005c017980 genunix:vmem_span_destroy+34 ()
2020-05-21T19:36:28.543973+00:00 00-14-d1-14-c1-84 genunix: [ID 655072 kern.notice] fffffe005c0179e0 genunix:vmem_xfree+11c ()
2020-05-21T19:36:28.543976+00:00 00-14-d1-14-c1-84 genunix: [ID 655072 kern.notice] fffffe005c017a10 genunix:vmem_free+1a ()
2020-05-21T19:36:28.543986+00:00 00-14-d1-14-c1-84 genunix: [ID 655072 kern.notice] fffffe005c017a50 genunix:kmem_slab_destroy+87 ()
2020-05-21T19:36:28.543990+00:00 00-14-d1-14-c1-84 genunix: [ID 655072 kern.notice] fffffe005c017aa0 genunix:kmem_slab_free+2d7 ()
2020-05-21T19:36:28.543993+00:00 00-14-d1-14-c1-84 genunix: [ID 655072 kern.notice] fffffe005c017b10 genunix:kmem_magazine_destroy+a7 ()
2020-05-21T19:36:28.543996+00:00 00-14-d1-14-c1-84 genunix: [ID 655072 kern.notice] fffffe005c017b50 genunix:kmem_depot_ws_reap+65 ()
2020-05-21T19:36:28.544005+00:00 00-14-d1-14-c1-84 genunix: [ID 655072 kern.notice] fffffe005c017c00 genunix:taskq_thread+2cd ()
2020-05-21T19:36:28.544008+00:00 00-14-d1-14-c1-84 genunix: [ID 655072 kern.notice] fffffe005c017c10 unix:thread_start+b ()
2020-05-21T19:36:28.544011+00:00 00-14-d1-14-c1-84 unix: [ID 100000 kern.notice] 

full details from /etc/release

                     SmartOS 20200424T174452Z x86_64
                       Copyright 2020 Joyent, Inc.

  Built with the following components:

[
    {
        "repo": "smartos-live",
        "branch": "release-20200423",
        "commit_date": "1587049529",
        "rev": "6e745f02cbe70f29741ecf823cb63376c7434ba7",
        "url": "https://github.com/joyent/smartos-live.git"
    },
    {
        "repo": "illumos-joyent",
        "branch": "release-20200423",
        "commit_date": "1587748076",
        "rev": "a6a04a02949b930353bf90202b562f992a1b9775",
        "url": "https://github.com/joyent/illumos-joyent.git"
    },
    {
        "repo": "illumos-extra",
        "branch": "release-20200423",
        "commit_date": "1585568216",
        "rev": "6a022466d73931c76d1e28d52428bd022264495d",
        "url": "https://github.com/joyent/illumos-extra.git"
    },
    {
        "repo": "kbmd",
        "branch": "release-20200423",
        "commit_date": "1584635798",
        "rev": "7d7c8c861a8579688b63e017b2de298a8b14292e",
        "url": "https://github.com/joyent/kbmd.git"
    },
    {
        "repo": "kvm",
        "branch": "release-20200423",
        "commit_date": "1583856285",
        "rev": "aad3588ab9ac0410951291fbe46bbd4d5909feec",
        "url": "https://github.com/joyent/illumos-kvm.git"
    },
    {
        "repo": "kvm-cmd",
        "branch": "release-20200423",
        "commit_date": "1583856265",
        "rev": "b0b411d4710067e34b9c395ffde998c9e1688f9d",
        "url": "https://github.com/joyent/illumos-kvm-cmd.git"
    },
    {
        "repo": "mdata-client",
        "branch": "release-20200423",
        "commit_date": "1583856330",
        "rev": "c90f7a29a2eade4ab613cb678016e67032ed54ec",
        "url": "https://github.com/joyent/mdata-client.git"
    },
    {
        "repo": "ur-agent",
        "branch": "release-20200423",
        "commit_date": "1583856345",
        "rev": "0ea7e23a1c1503b51b660c7625b4344d3959f286",
        "url": "https://github.com/joyent/sdc-ur-agent.git"
    }
]