search

edgecomllc / eupf

5G User Plane Function (UPF) based on eBPF
Apache License 2.0
100 stars 20 forks source link

Deploy OAI UE+gNB+Core in K8s #479

Closed pirog-spb closed 10 months ago

pirog-spb commented 10 months ago

Based on https://gitlab.eurecom.fr/oai/openairinterface5g/-/tree/develop/ci-scripts/yaml_files/5g_l2sim_tdd example

Acceptance criteria:

mbaran0v commented 10 months ago

on our test environment we have 2 pods in ns open5gs:

step 1 (pod gnb):

step 2 (pod ue):

GNB log:

[PHY]   tx_reorder_thread started
[NR_MAC]   Frame.Slot 128.0

[NR_MAC]   Frame.Slot 256.0

[NR_MAC]   Frame.Slot 384.0

[HW]   A client connects, sending the current time
[NR_MAC]   Frame.Slot 512.0

[NR_PHY]   [gNB 0][RAPROC] Frame 599, slot 19 Initiating RA procedure with preamble 20, energy 56.4 dB (I0 0, thres 120), delay 0 start symbol 0 freq index 0
[MAC]   UL_info[Frame 599, Slot 19] Calling initiate_ra_proc RACH:SFN/SLOT:599/19
[NR_MAC]   [gNB 0][RAPROC] CC_id 0 Frame 599 Activating Msg2 generation in frame 600, slot 7 using RA rnti 10b SSB, new rnti dca9 index 0 RA index 0
[NR_MAC]   [gNB 0][RAPROC] CC_id 0 Frame 600, slotP 7: Generating RA-Msg2 DCI, rnti 0x10b, state 1, CoreSetType 2
[NR_MAC]   [RAPROC] Msg3 slot 17: current slot 7 Msg3 frame 600 k2 7 Msg3_tda_id 3
[NR_MAC]   [gNB 0][RAPROC] Frame 600, Subframe 7: rnti dca9 RA state 2
[NR_MAC]   Adding UE with rnti 0xdca9
[NR_MAC]   [gNB 0][RAPROC] PUSCH with TC_RNTI 0xdca9 received correctly, adding UE MAC Context RNTI 0xdca9
[NR_MAC]   [RAPROC] RA-Msg3 received (sdu_lenP 7)
[MAC]   [RAPROC] Received SDU for CCCH length 6 for UE dca9
[RLC]   activated srb0 for UE with RNTI 0xdca9
[RLC]   Added srb 1 to UE with RNTI 0xdca9
[NR_MAC]   Activating scheduling RA-Msg4 for TC_RNTI 0xdca9 (state 2)
[NR_MAC]   Unexpected ULSCH HARQ PID 0 (have -1) for RNTI 0xdca9 (ignore this warning for RA)
[NR_RRC]   Decoding CCCH: RNTI dca9, payload_size 6
[NR_RRC]   Returning new RRC UE context RRC ue id: 1
[NR_RRC]   Created new UE context: CU UE ID 1 DU UE ID 56489 (rnti: dca9, random ue id 5ebc35a93c000000)
[NR_RRC]   rrc_gNB_generate_RRCSetup for RNTI dca9
[NR_MAC]   No CU UE ID stored for UE RNTI dca9, adding CU UE ID 1
[NR_MAC]   ( 601. 5) SRB0 has 137 bytes
[NR_MAC]   UE dca9 Generate msg4: feedback at  601. 7, payload 149 bytes, next state WAIT_Msg4_ACK
[HW]   Lost socket
[NR_MAC]   (UE dca9) Received Nack of RA-Msg4. Preparing retransmission!
[NR_MAC]   UE dca9 Generate msg4: feedback at  601.17, payload 149 bytes, next state WAIT_Msg4_ACK
[NR_MAC]   (UE dca9) Received Nack of RA-Msg4. Preparing retransmission!
[NR_MAC]   UE dca9 Generate msg4: feedback at  602. 7, payload 149 bytes, next state WAIT_Msg4_ACK
[NR_MAC]   (UE dca9) Received Nack of RA-Msg4. Preparing retransmission!
[NR_MAC]   UE dca9 Generate msg4: feedback at  602.17, payload 149 bytes, next state WAIT_Msg4_ACK
[NR_MAC]    603. 3 UE dca9: RA Procedure failed at Msg4!
[NR_MAC]   Frame.Slot 640.0
UE RNTI dca9 (1) PH 0 dB PCMAX 0 dBm, average RSRP 0 (0 meas)
UE dca9: dlsch_rounds 1/1/1/1, dlsch_errors 1, pucch0_DTX 4, BLER 0.00000 MCS 0
UE dca9: dlsch_total_bytes 0
UE dca9: ulsch_rounds 0/0/0/0, ulsch_DTX 0, ulsch_errors 0, BLER 0.00000 MCS 0
UE dca9: ulsch_total_bytes_scheduled 0, ulsch_total_bytes_received 0
UE dca9: LCID 1: TX              0 RX              0 bytes

[NR_MAC]   Frame.Slot 768.0
UE RNTI dca9 (1) PH 0 dB PCMAX 0 dBm, average RSRP 0 (0 meas)
UE dca9: dlsch_rounds 1/1/1/1, dlsch_errors 1, pucch0_DTX 4, BLER 0.00000 MCS 0
UE dca9: dlsch_total_bytes 0
UE dca9: ulsch_rounds 0/0/0/0, ulsch_DTX 0, ulsch_errors 0, BLER 0.00000 MCS 0
UE dca9: ulsch_total_bytes_scheduled 0, ulsch_total_bytes_received 0
UE dca9: LCID 1: TX              0 RX              0 bytes

ue log

[SIM]   UICC simulation: IMSI=999700000000001, IMEISV=6754567890123413, Ki=465B5CE8B199B49FAA5F0A2EE238A6BC, OPc=E8ED289DEBA952E4283B54E88E6183CA, DNN=internet, SST=0x01, SD=0x111111
[HW]   Trying to connect to 10.233.50.146:4043
[HW]   Connection to 10.233.50.146:4043 established
[HW]   connect() to 10.233.50.146:4043 failed, errno(0)
[PHY]   [SCHED][UE] Check absolute frequency DL 3319680000.000000, UL 3319680000.000000 (RF card 0, oai_exit 0, channel 0, rx_num_channels 1)
[NR_PHY]   Starting sync detection
[PHY]   [UE thread Synch] Running Initial Synch
[PHY]   [UE] nr_synchro_time: Sync source = 0, Peak found at pos 0, val = 0 (0 dB) avg 0 dB, ffo 0.000000
[PHY]   PSS execution duration 66985 microseconds
[PHY]   [UE] nr_synchro_time: Sync source = 0, Peak found at pos 85696, val = 1818396808 (90 dB) avg 51 dB, ffo 0.000000
[PHY]   PSS execution duration 66098 microseconds
[PHY]   [UE0] Initial sync : Estimated PSS position 85696, Nid2 0
[PHY]   sync_pos 85696 ssb_offset 85588
[PHY]   Calling sss detection (normal CP)
[NR_PHY]   ffo_pss 0.000000 (0 Hz), ffo_sss 0.000663 (19 Hz),  ffo_pss+ffo_sss 0.000663 (19 Hz), nid1: 0, nid2: 0
[PHY]   [UE0] Initial sync: starting PBCH detection (rx_offset 0)
[PHY]   [UE0] Initial sync: pbch decoded sucessfully, ssb index 0
[NR_RRC]   Configuring MAC for first MIB reception
[PHY]   TDD Normal prefix: CellId 0 metric 45105, phase 7, pbch 0
[PHY]   [UE0] In synch, rx_offset 82276 samples
[PHY]   [UE 0] Measured Carrier Frequency 3319680000 Hz (offset 0 Hz)
[PHY]   HW: Configuring channel 0 (rf_chain 0): setting tx_freq 3319680000 Hz, rx_freq 3319680000 Hz, tune_offset 0
[PHY]   Got synch: hw_slot_offset 7, carrier off 0 Hz, rxgain 0.000000 (DL 3319680000.000000 Hz, UL 3319680000.000000 Hz)
[PHY]   UE synchronized decoded_frame_rx=462 UE->init_sync_frame=0 trashed_frames=30
[PHY]   Resynchronizing RX by 82276 samples
[NR_RRC]   SIB1 decoded
[NR_MAC]   NR band duplex spacing is 0 KHz (nr_bandtable[37].band = 78)
[NR_MAC]   NR band 78, duplex mode TDD, duplex spacing = 0 KHz
[NR_PHY]   ============================================
[NR_PHY]   Harq round stats for Downlink: 1/0/0
[NR_PHY]   ============================================
[NR_PHY]   ============================================
[NR_PHY]   Harq round stats for Downlink: 1/0/0
[NR_PHY]   ============================================
Entering ITTI signals handler
TYPE <CTRL-C> TO TERMINATE
[NR_MAC]   NR band duplex spacing is 0 KHz (nr_bandtable[37].band = 78)
[NR_MAC]   NR band 78, duplex mode TDD, duplex spacing = 0 KHz
[MAC]   Initialization of 4-step contention-based random access procedure
[NR_MAC]   PRACH scheduler: Selected RO Frame 599, Slot 19, Symbol 0, Fdm 0
[PHY]   PRACH [UE 0] in frame.slot 599.19, placing PRACH in position 2452, msg1 frequency start 27 (k1 27), preamble_offset 5, first_nonzero_root_idx 0
[NR_MAC]   [UE 0][RAPROC] Got BI RAR subPDU 5 ms
[NR_MAC]   [UE 0][RAPROC] Got RAPID RAR subPDU
[NR_MAC]   [UE 0][RAPROC][600.7] Found RAR with the intended RAPID 20
[MAC]   received TA command 31
[RLC]   activated srb0 for UE with RNTI 0xdca9
[PHY]   RAR-Msg2 decoded
[NR_MAC]   [RAPROC][600.17] RA-Msg3 transmitted

Assertion (1 + dci->pdsch_to_harq_feedback_timing_indicator.val > ((3))) failed!
In nr_ue_process_dci_dl_10() ../../../openair2/LAYER2/NR_MAC_UE/nr_ue_procedures.c:783
PDSCH to HARQ feedback time (2) needs to be higher than DURATION_RX_TO_TX (3).

Exiting execution
../../../openair2/LAYER2/NR_MAC_UE/nr_ue_procedures.c:783 nr_ue_process_dci_dl_10() Exiting OAI softmodem: _Assert_Exit_
Aborted (core dumped)
mbaran0v commented 10 months ago

OAI core + RAN works normally deployed by this documentation https://gitlab.eurecom.fr/oai/cn5g/oai-cn5g-fed/-/blob/master/docs/DEPLOY_SA5G_HC.md used scenario oai-5g-basic

mbaran0v commented 10 months ago

last messages from UE

[NR_MAC]   [UE 0][RAPROC] Got BI RAR subPDU 5 ms
[NR_MAC]   [UE 0][RAPROC] Got RAPID RAR subPDU
[NR_MAC]   [UE 0][RAPROC][492.7] Found RAR with the intended RAPID 13
[MAC]   received TA command 31
[NR_MAC]   [RAPROC][492.17] RA-Msg3 transmitted
[MAC]   [UE 0][RAPROC] Frame 493 : received contention resolution identity: 0x1b318aa13806 Terminating RA procedure
[MAC]   [UE 0][493.10][RAPROC] RA procedure succeeded. CB-RA: Contention Resolution is successful.
CMDLINE: "/opt/oai-nr-ue/bin/nr-uesoftmodem" "-O" "/opt/oai-nr-ue/etc/nr-ue.conf" "--sa" "-E" "--rfsim" "-r" "106" "--numerology" "1" "-C" "3619200000" "--nokrnmod" 
[CONFIG] get parameters from libconfig /opt/oai-nr-ue/etc/nr-ue.conf [LIBCONFIG] Path for include directive set to: /opt/oai-nr-ue/etc
[CONFIG] function config_libconfig_init returned 0
[CONFIG] config module libconfig loaded
[LIBCONFIG] config: 2/2 parameters successfully set, (2 to default value)
[CONFIG] debug flags: 0x00000000
[LIBCONFIG] log_config: 3/3 parameters successfully set, (2 to default value)
[LIBCONFIG] log_config: 53/53 parameters successfully set, (53 to default value)
[LIBCONFIG] log_config: 53/53 parameters successfully set, (53 to default value)
[LIBCONFIG] log_config: 16/16 parameters successfully set, (16 to default value)
[LIBCONFIG] log_config: 16/16 parameters successfully set, (16 to default value)
log init done
[LIBCONFIG] (root): 30/30 parameters successfully set, (28 to default value)
[LIBCONFIG] (root): 37/37 parameters successfully set, (34 to default value)
[LIBCONFIG] (root): 6/6 parameters successfully set, (5 to default value)
[LIBCONFIG] TTracer: 3/3 parameters successfully set, (3 to default value)
create a thread for core -1
create a thread for core -1
create a thread for core -1
create a thread for core -1
create a thread for core -1
create a thread for core -1
create a thread for core -1
create a thread for core -1
CPU Freq is 2.294547 
[LIBCONFIG] opt: 3/3 parameters successfully set, (3 to default value)
[LIBCONFIG] loader: 2/2 parameters successfully set, (2 to default value)
[LIBCONFIG] loader.ldpc: 2/2 parameters successfully set, (1 to default value)
shlib_path libldpc.so
[LOADER] library libldpc.so successfully loaded
[LIBCONFIG] nas.noS1: 3/3 parameters successfully set, (3 to default value)
DL frequency 3619200000: band 48, UL frequency 3619200000
[LIBCONFIG] loader.dfts: 2/2 parameters successfully set, (1 to default value)
shlib_path libdfts.so
[LOADER] library libdfts.so successfully loaded
[LIBCONFIG] list PRSs not found in config file /opt/oai-nr-ue/etc/nr-ue.conf 
[LIBCONFIG] device.recplay: 8/8 parameters successfully set, (8 to default value)
[LIBCONFIG] device: 1/1 parameters successfully set, (1 to default value)
[LIBCONFIG] loader.rfsimulator: 2/2 parameters successfully set, (1 to default value)
shlib_path librfsimulator.so
[LOADER] library librfsimulator.so successfully loaded
[LIBCONFIG] rfsimulator: 9/9 parameters successfully set, (8 to default value)
Initializing random number generator, seed 1346137380399827779
UE threads created by 1
TYPE <CTRL-C> TO TERMINATE
[LIBCONFIG] uicc0: 10/10 parameters successfully set, (5 to default value)
Entering ITTI signals handler
TYPE <CTRL-C> TO TERMINATE
<DL-CCCH-Message>
    <message>
        <c1>
            <rrcSetup>
                <rrc-TransactionIdentifier>2</rrc-TransactionIdentifier>
                <criticalExtensions>
                    <rrcSetup>
                        <radioBearerConfig>
                            <srb-ToAddModList>
                                <SRB-ToAddMod>
                                    <srb-Identity>1</srb-Identity>
                                </SRB-ToAddMod>
                            </srb-ToAddModList>
                        </radioBearerConfig>
                        <masterCellGroup>
                            5C 00 B0 01 11 7A EC 70 10 61 F0 00 7C 02 04 68 
                            3C 08 00 04 12 09 81 95 00 81 FF FF 00 00 00 01 
                            00 00 37 14 42 00 00 80 16 50 00 04 82 00 00 44 
                            09 34 0D 54 93 50 00 04 00 80 80 01 00 1A 02 00 
                            27 6C 96 30 1D C0 76 78 9A BC D0 00 00 29 A1 00 
                            20 00 25 80 C2 0C 02 C9 C1 82 1C 00 31 28 1C 00 
                            00 20 5E F4 01 00 01 00 00 06 40 01 40 03 2A 0A 
                            00 C4 40 15 00 00 00 00 01 42 00 80 00 14 50 80 
                            80 02 C6 00
                        </masterCellGroup>
                    </rrcSetup>
                </criticalExtensions>
            </rrcSetup>
        </c1>
    </message>
</DL-CCCH-Message>
[NR_RRC]   [UE0][RAPROC] Frame 493 : Logical Channel DL-CCCH (SRB0), Received NR_RRCSetup RNTI 5db3
[RRC]   Received mac_CellGroupConfig from gNB
[MAC]   Applying CellGroupConfig from gNodeB
[RLC]   ../../../openair2/LAYER2/nr_rlc/nr_rlc_oai_api.c:693:nr_rlc_add_srb: added srb 1 to UE with RNTI 0x5db3
[NR_RRC]   [UE 0], CONFIG_SRB1 1 corresponding to gNB_index 0
[NR_RRC]   [FRAME 00493][RRC_UE][MOD 00][][--- MAC_CONFIG_REQ  (SRB1 gNB 0) --->][MAC_UE][MOD 00][]
[NR_RRC]   [UE 0] State = NR_RRC_CONNECTED (gNB 0)
[NR_RRC]   [UE 0][RAPROC] Frame 493 : Logical Channel UL-DCCH (SRB1), Generating RRCSetupComplete (bytes42, gNB 0)
[NR_RRC]   [UE 0] Received RRC Release (gNB 0)
[NAS]   [UE 0] Received NAS_DOWNLINK_DATA_IND: length 4 , buffer 0x7fd9f8002fc0
[NR_RRC]   unknown message type 68
[NAS]   [UE 0] Received NAS_CONN_RELEASE_IND: cause 0
Returned from ITTI signal handler
oai_exit=1
Stream closed EOF for open5gs/oai-nr-ue-5cc6b949f8-ctk8g (nr-ue)
mbaran0v commented 10 months ago

amf log:

11/29 14:36:14.644: [amf] INFO: InitialUEMessage (../src/amf/ngap-handler.c:372)
11/29 14:36:14.644: [amf] INFO: [Added] Number of gNB-UEs is now 1 (../src/amf/context.c:2481)
11/29 14:36:14.644: [amf] INFO:     RAN_UE_NGAP_ID[0] AMF_UE_NGAP_ID[8] TAC[1] CellID[0xe0000] (../src/amf/ngap-handler.c:533)
11/29 14:36:14.645: [amf] INFO: [suci-0-999-70-0000-0-0-0000000001] Unknown UE by SUCI (../src/amf/context.c:1778)
11/29 14:36:14.645: [amf] INFO: [Added] Number of AMF-UEs is now 1 (../src/amf/context.c:1560)
11/29 14:36:14.645: [gmm] INFO: Registration request (../src/amf/gmm-sm.c:985)
11/29 14:36:14.645: [gmm] ERROR: Non cleartext IEs is included [0x6] (../src/amf/gmm-handler.c:116)
11/29 14:36:14.645: [gmm] ERROR: Unknown reg_type[0] (../src/amf/gmm-sm.c:1004)
11/29 14:36:14.645: [gmm] ERROR: gmm_handle_registration_request() failed [95] (../src/amf/gmm-sm.c:1008)
11/29 14:36:14.645: [amf] ERROR: Unknown reg_type[0] (../src/amf/nas-path.c:215)
11/29 14:36:14.645: [amf] WARNING: [(null)] Registration reject [95] (../src/amf/nas-path.c:219)
11/29 14:36:14.648: [amf] INFO: UE Context Release [Action:3] (../src/amf/ngap-handler.c:1632)
11/29 14:36:14.648: [amf] INFO:     RAN_UE_NGAP_ID[0] AMF_UE_NGAP_ID[8] (../src/amf/ngap-handler.c:1633)
11/29 14:36:14.649: [amf] INFO:     SUCI[Unknown] (../src/amf/ngap-handler.c:1636)
11/29 14:36:14.649: [amf] INFO: [Removed] Number of gNB-UEs is now 0 (../src/amf/context.c:2488)
11/29 14:36:14.649: [amf] INFO: [Removed] Number of AMF-UEs is now 0 (../src/amf/context.c:1653)
11/29 14:36:45.365: [amf] INFO: InitialUEMessage (../src/amf/ngap-handler.c:372)
11/29 14:36:45.366: [amf] INFO: [Added] Number of gNB-UEs is now 1 (../src/amf/context.c:2481)
11/29 14:36:45.366: [amf] INFO:     RAN_UE_NGAP_ID[0] AMF_UE_NGAP_ID[9] TAC[1] CellID[0xe0000] (../src/amf/ngap-handler.c:533)
11/29 14:36:45.367: [amf] INFO: [suci-0-999-70-0000-0-0-0000000001] Unknown UE by SUCI (../src/amf/context.c:1778)
11/29 14:36:45.367: [amf] INFO: [Added] Number of AMF-UEs is now 1 (../src/amf/context.c:1560)
11/29 14:36:45.367: [gmm] INFO: Registration request (../src/amf/gmm-sm.c:985)
11/29 14:36:45.367: [gmm] ERROR: Non cleartext IEs is included [0x6] (../src/amf/gmm-handler.c:116)
11/29 14:36:45.367: [gmm] ERROR: Unknown reg_type[0] (../src/amf/gmm-sm.c:1004)
11/29 14:36:45.367: [gmm] ERROR: gmm_handle_registration_request() failed [95] (../src/amf/gmm-sm.c:1008)
11/29 14:36:45.367: [amf] ERROR: Unknown reg_type[0] (../src/amf/nas-path.c:215)
11/29 14:36:45.367: [amf] WARNING: [(null)] Registration reject [95] (../src/amf/nas-path.c:219)
11/29 14:36:45.368: [amf] INFO: UE Context Release [Action:3] (../src/amf/ngap-handler.c:1632)
11/29 14:36:45.368: [amf] INFO:     RAN_UE_NGAP_ID[0] AMF_UE_NGAP_ID[9] (../src/amf/ngap-handler.c:1633)
11/29 14:36:45.368: [amf] INFO:     SUCI[Unknown] (../src/amf/ngap-handler.c:1636)
11/29 14:36:45.368: [amf] INFO: [Removed] Number of gNB-UEs is now 0 (../src/amf/context.c:2488)
11/29 14:36:45.368: [amf] INFO: [Removed] Number of AMF-UEs is now 0 (../src/amf/context.c:1653)