Modification required for Broadcom based FlexLOM cards (530/533FLR)

[halmartin]

The HPE 530FLR-SFP+ and 533FLR-T cards are based on the Broadcom BCM57810. These cards do not work with the adapter without modification.

The KCORES FlexibleLOM Adapter appears to have a more accurate pinout of the FlexLOM connector:

The following modifications to the adapter make it compatible with the Broadcom-based FlexibleLOM cards:

1. Cut the trace between Vdet (to make pin B1 N/C)
2. Cut the trace connecting PERST to pin A1 (between the center/right solder pads)
3. Bridge the PERST left/center solder pads so PERST is connected to A14
4. Bridge 3.3V pad to pin A1
5. Connect 3.3V pad to A10/A11
6. Bridge GND between pins A4/A5/A6/A7/A8

With the above changes, the 533FLR-T adapter is working for me: lspci output

---

Here is an annotated photo of the modifications required:

---

(The additional wire is to connect nWAKE)

[TobleMiner]

Cool! I'll prepare a RevB for testing. Many thanks for bringing this to my attention.

[halmartin]

For the pins requiring +3.3V, I bridged from +3.3V_AUX because it was easy and exposed on RevA, but I'm not sure if this is the "correct" way. KCORES are using +3.3V from pins B8/A9/A10 in their adapter.

I don't know enough KiCad to modify the adapter in this way, sorry.

[TobleMiner]

Hey, no worries. I'm not entirely sure about the 3.3V domains either. I wil derive PWROK from the main 3.3V rail since it is likely intended to be a power good signal for the 12V rail. To me another worry are the software deifned pins (SDP). I'm not entirely sure what they are doing. To me it seems a bit risky to pull them to 3.3V that hard. Unfortunately I don't have access to any HP servers with a FlexibleLOM slot. Thus I can't verify whether the KCORES adapter matches what HP is doing.

[obedouet]

Hello,

I tested successfully the modification with a HP 530FLR-SFP+, without such hack, card was not visible through lspci. I did not add the additional wire. Thanks for the trick !

[MGX3D]

Thanks Tobias for the adapter and Hal for the mods! I wanted to confirm that revision A didn't work for me, but with the mods above I got 533FLR-T working. I haven't benchmarked it at 10GbE yet, but lspci/LnkSta says it's 5GT/s x8, ssh/scp works fine over it, etc.

However, the adapter still does not work for 561FLR-T (Intel X540), the only mod I didn't do is the nWAKE one, not sure if required?

One other suggestion I have for rev B is to reduce the copper plane that gets exposed when beveled: this might also be the reason JLCPCB doesn't bevel the PCBs. They didn't for me either, I did it manually and ended up exposing this plane and managed to kill a motherboard with it. I did notice the copper was exposed even though bevel was very light compared to other PCIe cards, but I figured I'd be safe once inserted because it should sit under the PCIe contacts in the connector, but I forgot to disconnect the PSU (rookie mistake) so the motherboard powered on while I was inserting the adapter and that was that! Luckily it was not a super expensive mb.

[TobleMiner]

Hi!

I'm super sorry to hear that. Retracting the GND plane a bit is something I should have done in the initial design. I've just redesigned the adapter, fixing both the pin assignments for the Flexible LOM slot (I've left out the SPD pins for now though) and the GND plane in the beveled area: https://github.com/TobleMiner/HPE-FlexibleLOM-adapter/tree/revb-untested

The design is not tested yet, but I've ordered it yesterday. So it should be here within the next two weeks or so.

[MGX3D]

Small update, I think I figured out why the rev A PCB (without any mods) worked with 561FLR-T for others but not for me initially: the reason seems to be as simple as using a PCIe powered video card vs one with separate power from PSU. I guess it has to do with total power draw of the two cards or possible mb quirks? Anyway, wanted to confirm that 561FLR-T without mods does work for me as well (when using a beefier video card with separate power connector).

[DrivebyCoding]

Unfortunately I don't have access to any HP servers with a FlexibleLOM slot. Thus I can't verify whether the KCORES adapter matches what HP is doing

I have a bunch of machines with FlexLOM and 544FLR. Anything in particular you want tested? Bricking a few MBs or HBAs is not a problem.

[halmartin]

@obedouet Did you add GND on pins B9 and B11?

I purchased a 530FLR-SFP+ that draws 2W and does not enumerate on the PCIe bus without grounding pins B9 and B11. Grounding pins B9 and B11 results in the card consuming 6W and successfully initializing.

[TobleMiner]

@halmartin Are you sure grounding B9 is required? According to the information I got that should only be TX enable for NC-SI.

[halmartin]

@TobleMiner I'm not certain, I have two versions of the modified adapter, one with the modifications I describe above, and the other with those modifications plus B9/B11 grounded.

The 530FLR-SFP+ I have does not work in the adapter that does not have B9/B11 grounded. Unfortunately my soldering iron has broken, so I cannot desolder connections to test if only B11 is required. I can test this when my new soldering iron arrives.

[obedouet]

@obedouet Did you add GND on pins B9 and B11?

I purchased a 530FLR-SFP+ that draws 2W and does not enumerate on the PCIe bus without grounding pins B9 and B11. Grounding pins B9 and B11 results in the card consuming 6W and successfully initializing.

Hello, I did not modify B9 and B11. I've only applied your steps 1-6. The card is working in a ESX since my comment (1/5) without any issue, really stable.

[dmg244]

/gerbers//revB_panel.zip have revA files inside.

[TobleMiner]

@dmg244 Oops, sorry for that. I've just updated the branch to now feature the RevB gerbers in that file.

[dmg244]

@TobleMiner Can you make revision C with the grounding of lines B9, B11, A4, A6, A7 and the connected WAKE line - A9 LOM to B11 PCI-E, A10 and A11 to +3.3V (all lines like KCORES design)? I want try to order this design for test. Why you use only +3.3V_AUX and don't use +3.3V?

[Nooby1]

I have ordered the RevB, I have some 530FLR-SFP+ (647581-B21) and QDR 544+FLR-QSFP (764286-B21)

I will update you in about two weeks

Does anyone know if these 544 cards are confirmed working in rev A?

[TobleMiner]

@dmg244

@TobleMiner Can you make revision C with the grounding of lines B9, B11, A4, A6, A7 and the connected WAKE line - A9 LOM to B11 PCI-E, A10 and A11 to +3.3V (all lines like KCORES design)? want try to order this design for test

Sure, will do. I don't feel that comfortable pulling the SDP pins that hard, but at least for a test it should be fine.

Why you use only +3.3V_AUX and don't use +3.3V?

By mistake. PWROK shoudl have been connected to the 3v3 power rail. However, I think B10 is supposed to be +3v3_aux to allow NC-SI to work even during system shutdown.

[TobleMiner]

@dmg244 Here you go: https://github.com/TobleMiner/HPE-FlexibleLOM-adapter/blob/revc-experimental/gerbers/revC_panel.zip

Think that should cover everything you might want to test. I've made sure to expose a good lenght of trace to any of the pins where we are not sure whether they are required for cards to enumerate or not. Feel free to experiment with cutting any of those traces and pulling them high/low or leaving them floating :)

[dmg244]

Thank you! Already ordered from e-bay 2pcs HP 647579-001 649869-001 2-Port 530FLR SFP+ 10Gbps Ethernet Adapter 2pcs HPE 669281-001 Ethernet 560FLR-SFP+ 10GB 2-Ports PCI Express 2.0 x8 Adapter HP 4-Port 684208-B21 629135-B21 634025-001 Ethernet 1Gb 331FLR Adapter

and connectors for testing.

JLCPCB will be produced PCB from 19 Feb

[0mnicy]

@dmg244 good luck with your testing. looking forward to seeing the results.

[Digifreakl]

I have ordered the RevB, I have some 530FLR-SFP+ (647581-B21) and QDR 544+FLR-QSFP (764286-B21)

I also bought some 530FLR-SFP+ (647581-B21), do you have any update?

[dmg244]

Hello! Thank you for you attention!

Latest news )))

Already received: 2pcs HPE 669281-001 Ethernet 560FLR-SFP+ 10GB 2-Ports PCI Express 2.0 x8 Adapter 2pcs HPE AJ838A LC/LC FC 30m Multi-mode OM3 Cable (491028-001)

still waiting PCB's and connectors.

Also still waiting: 2pcs HP 647579-001 649869-001 2-Port 530FLR SFP+ 10Gbps Ethernet Adapter 1pcs HP 4-Port 684208-B21 629135-B21 634025-001 Ethernet 1Gb 331FLR Adapter 2pcs Intel E10GSFPSR FTLX8571D3BCV-IT E65689-001 SFP+ Transceiver For X520-DA2/SR2 2pcs JD092B HPE X130 10G SFP+SR LC FTLX8571D3BCL-HZ 850nm for 5900AF

[Nooby1]

My PCBs arrived today. I got some soldered up and can confirm the revB worked with the 40gbe FLOM card QDR 544+FLR-QSFP (764286-B21)

I purchased 100 PCBs as the cost was not really much more than 20 from JLPCB due to the paneling of the design (required for edge chamfering with no extra cost) If anyone would like to buy some PCBS or completed cards off me do let me know. I am in the UK and will list on ebay also

[halmartin]

@Nooby1 Are you in the EU? I'd be interested in buying some PCBs from you.

[Nooby1]

@Nooby1 Are you in the EU? I'd be interested in buying some PCBs from you

Uk, and sure happy to sell up to 80 of them. I dont know the best way to share contact details on here however.

[halmartin]

Can you email me? username (at) gmail

[Rainfey]

@Nooby1 Is this offer still on the table? Buying is preferable to waiting for shipping.

Regarding all the other adapters you ordered, have you managed to confirm if revB works with the 647579-001 model?

[Nooby1]

@Nooby1 Is this offer still on the table? Buying is preferable to waiting for shipping.

Regarding all the other adapters you ordered, have you managed to confirm if revB works with the 647579-001 model?

Yes I still have pcb and completed models avalable, not tested with anything but connectx3 pro currently. Could test with 530flr in future

[Rainfey]

@Nooby1 I have added you to a project with my email address in the description - shame about github's lack of social features. Drop me a line when you are able.

[dmg244]

Received all components. I may confirm that adapter ver.C working with:

HPE 669281-001 Ethernet 560FLR-SFP+ 10GB 2-Ports PCI Express 2.0 x8 Adapter

#lspci
02:00.0 Ethernet controller: Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)
02:00.1 Ethernet controller: Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)

HP 647579-001 649869-001 2-Port 530FLR SFP+ 10Gbps Ethernet Adapter

#lspci
02:00.0 Ethernet controller: Broadcom Inc. and subsidiaries NetXtreme II BCM57810 10 Gigabit Ethernet (rev 10)
02:00.1 Ethernet controller: Broadcom Inc. and subsidiaries NetXtreme II BCM57810 10 Gigabit Ethernet (rev 10)

HP 4-Port 684208-B21 629135-B21 634025-001 Ethernet 1Gb 331FLR Adapter

#lspci
02:00.0 Ethernet controller: Broadcom Inc. and subsidiaries NetXtreme BCM5719 Gigabit Ethernet PCIe (rev 01)
02:00.1 Ethernet controller: Broadcom Inc. and subsidiaries NetXtreme BCM5719 Gigabit Ethernet PCIe (rev 01)
02:00.2 Ethernet controller: Broadcom Inc. and subsidiaries NetXtreme BCM5719 Gigabit Ethernet PCIe (rev 01)
02:00.3 Ethernet controller: Broadcom Inc. and subsidiaries NetXtreme BCM5719 Gigabit Ethernet PCIe (rev 01)

[Rainfey]

Tried a 530FLR-SFP+ (649869-001) on a rev b board with no success. I noted the following after making modifications to the adapter (modifications made in succession without undoing previous mods): 1) Grounding B9, B11 - No effect 2) Grounding A4, A6, A7 - No effect 3) Connecting A10 and A11 to +3.3V - Enumerates in windows on a HP DL120 G7

[IcyPunch]

I need help guys, I would like to use 530FLR-SFP+ and / or 560FLR-SFP+ cards, but I don't know which version of the adapter to choose. I want to operate the cards safely (voltages, etc.). Can you help me out please? I can't have them printed myself I think.

@Nooby1 Were you able to confirm that 530FLR-SFP+ / 560FLR-SFP+ work in your rev. B boards? Are you still selling them?

[Nooby1]

I am still selling them, got loads left I have still only tested with connectx3 pro but from rainfeys comment it looks like they dont work on 530sfp+ without modifications

[IcyPunch]

I think we could get all this done together in this thread or in the one on serve the home if you guys are willing to help me. @Nooby1 Can I contact you somewhere to talk about details?

[IcyPunch]

@Nooby1 I can't seem to find your ebay.co.uk listing. I could contact you via eBay if I was able to find it.

[Nooby1]

@IcyPunch i have added you to a private repository, GitHub no private message is bad but will be able to send some out this saturday

[masterofrofln]

Hello,

first of all Thank you very much for the time and effort being put into this project.

I would like to purchase 2 adapters for HPE 533FLR-T 2-Port 10GbE PCI-Express x8 Network adapter cards (RJ45 ports).

Ideally I want the adapter to be Plug and Play - no soldering etc.

Where may I buy those? I am located in Germany.

I found this, but do not know the revision - A, B? C most like not.

@Nooby1 - please get into contact with me if you do have stock available.

[halmartin]

Tried a 530FLR-SFP+ (649869-001) on a rev b board with no success. I noted the following after making modifications to the adapter (modifications made in succession without undoing previous mods):

1. Grounding B9, B11 - No effect
2. Grounding A4, A6, A7 - No effect
3. Connecting A10 and A11 to +3.3V - Enumerates in windows on a HP DL120 G7

I tried a Rev B PCB with a 533FLR-T (700757-001/701534-001), and the only modification was A10 and A11 to +3.3V.

[kayjay010101]

@Nooby1 if you still have any complete boards I'd love to purchase one.

[NishaYume]

Hello @Nooby1, im interested in one if your version is compatible with HP 561FLR-T 10Gb.

Dont have the skills to solder this, hope someday somebody will sell the adapter ready to use!.

Anyway thanks!

[hps944]

Hello,

I found this project because I am searching a FlexLOM adapters for HPE 533FLR-T Cards, too. Great work to found such a solution for this problem. Is it still possible to buy such FlexLOM adapters with no soldering, just plug and play? I live Germany. Maybe @Nooby1 would sell such Rev B type adapters, or does anyone know a source to buy it.

Thanks!

[halmartin]

Is it still possible to buy such FlexLOM adapters with no soldering, just plug and play? I live Germany.

Probably the reason no one is selling assembled adapters is because it is time consuming to assemble and test them, and people are generally purchasing FlexLOM cards because they're inexpensive compared to the PCIe equivalent.

Paying someone to assemble the adapter removes most/all of the value proposition, you would be better off just buying the PCIe version of the card.

You can buy unassembled Rev A adapters from sysmocom.

~I have unassembled Rev B adapters that I'm willing to sell at cost, but you must solder them yourself.~

[kayjay010101]

Hello,

I found this project because I am searching a FlexLOM adapters for HPE 533FLR-T Cards, too. Great work to found such a solution for this problem. Is it still possible to buy such FlexLOM adapters with no soldering, just plug and play? I live Germany. Maybe @Nooby1 would sell such Rev B type adapters, or does anyone know a source to buy it.

Thanks!

I bought another adapter off eBay for quite cheap and to my surprise it does actually work. It does have a legit github page as well, albeit in Chinese. I have three of these adapters now and they all work on regular computers, making them + a fLOM card a much cheaper option than regular PCIe cards. Just search on eBay: "FlexibleLOM to PCIe" and it should be the only result.

[Nooby1]

I do have some rev B adapters left but @halmartin is correct, these take a long time to hand solder and QC check each one, checking it boots and enumerates. I cant send them out untested, and my time is expensive so I really dont make much money on each one for the time spent selling them at £20

[hps944]

I do have some rev B adapters left but @halmartin is correct, these take a long time to hand solder and QC check each one, checking it boots and enumerates. I cant send them out untested, and my time is expensive so I really dont make much money on each one for the time spent selling them at £20 Hello, thanks for your offer. It is clear, that it is a lot of work and to spent a lot of time. Therefore the price is ok and I need the adapters. How can I get two adapters from you?

[hps944]

Is it still possible to buy such FlexLOM adapters with no soldering, just plug and play? I live Germany.

Probably the reason no one is selling assembled adapters is because it is time consuming to assemble and test them, and people are generally purchasing FlexLOM cards because they're inexpensive compared to the PCIe equivalent.

Paying someone to assemble the adapter removes most/all of the value proposition, you would be better off just buying the PCIe version of the card.

You can buy unassembled Rev A adapters from sysmocom.

I have unassembled Rev B adapters that I'm willing to sell at cost, but you must solder them yourself.

Hello, thanks for your offer. I try to get 2 adapters from Nooby1, but I also want to try soldering them by myself. How can I buy 2 adapters? Thank you.

[Nooby1]

@hps944 I have invited you to a FLOMSELL code repository where we can exchange details

[halmartin]

@hps944 My contact details can be found in my profile.

[halmartin]

For anyone looking to use a 530/533FLR with the Rev. B adapter, you still need to make a modification to connect A10 and A11 to 3.3V or the card will not work.

However, the modification is much easier than Rev. A:

[megabug360]

Just got my PCBs today and was testing rev A with mods and my 533FLR-T just blew up.

Thoughts?

Nevermind... had a short from PWROK to 12V+

EDIT2: Repaired my card, working fine now... thanks for this nice pcb.