sinara-hw / sinara

Sayma AMC/RTM issue tracker
Other
42 stars 7 forks source link

Zotino v1.1 #446

Closed hartytp closed 6 years ago

hartytp commented 6 years ago
gkasprow commented 6 years ago

@jordens these heat sinks have wrong fins direction. So won't work with air flow from bottom to top. These are typical 3U enclosures where board fits inside in the inner slot and the enclosure fits between 3U rails. It needs different panel. The hole distance is 85mm. I can't find this dimension in the datasheet. But once you mount it to the back of PCB, won't be able to fit into the rack.

gkasprow commented 6 years ago

@hartytp 15x15mm TEC, 2.5Ohm, 7W + 12.5mm heatsink fit perfectly obraz

gkasprow commented 6 years ago

TEC model CP50441

jordens commented 6 years ago

Just fine for forced horizontal airflow. And AFAICT they will fit into the rack perfectly when the pcb is mounted to them. You only need a different front panel and card guide position.

hartytp commented 6 years ago

@gkasprow TEC and heat sink look good!

gkasprow commented 6 years ago

layout done, fixing some minor power integrity issues

gkasprow commented 6 years ago

Themal simulation with parameters - no air flow: obraz

obraz

gkasprow commented 6 years ago

@hartytp DAC temp is 53 degrees without airflow When I specify it as -0.6W instead of +400mW, the temperature drops to 42.1 degrees. With airflow 20cm/s: temp is 31.7 with TEC cooling and airflow and 38.5 without TEC cooling and with airflow.

gkasprow commented 6 years ago

Temperature distribution with 20cm/s airflow obraz

gkasprow commented 6 years ago

Current density for 12V rail. Far below limit. obraz

And for -12V rail. After optimisation: obraz

a-shafir commented 6 years ago

Can be improved:

  1. C12.2 is connected so SIGGND but not AGND or ground plane.
  2. J2.3 trace (and especially the via) looks weak
  3. TEC1- pad clearance to SDO trace looks dangerous, can be short with hand soldering of TEC and burn the DAC.
  4. Will TEC be powered from P3V3_MP? One pin of the signal cable IMHO it is not a good source for TEC power. Also it is shared power. Also it can be a long cable in some installations etc. Note: local P3V3 is also only 500mA max.
a-shafir commented 6 years ago

@gkasprow IMHO the TEC performance quickly degrades with the temperature drop. So will need more and more V*A to achieve the desired cold side temperature. Also it will heat the board around so with the temperature based feedback it is very difficult to stabilize. Do you have any estimation of the TEC current needed (worst case scenario)?

@hartytp i think need at least one more thermal sensor on board. Otherwise if we just trying to reach a target temperature in some cases for instance when the ambient is high it will lead to quite high power on TEC etc. The idea of @gkasprow "-0.6W instead of +400mW" will not work if we have only one sensor IMHO. I also not sure if a sensor on the regulator module can help. Basically we need to put one more sensor to the bottom-right side of the board and control it for a specific thermal difference between the sensors.

Also i think it still makes sense to add some thermal resistance for the ground plane. With V1.0 it was separated. Now it is tied. I think the optimal is somewhere in between.

gkasprow commented 6 years ago

@a-shafir Can be improved:

C12.2 is connected so SIGGND but not AGND or ground plane.

good catch, fixed

J2.3 trace (and especially the via) looks weak

OK, fixed, all current was passing via single pad

TEC1- pad clearance to SDO trace looks dangerous, can be short with hand soldering of TEC and burn the DAC.

there is solder mask, but I fixed

Will TEC be powered from P3V3_MP? One pin of the signal cable IMHO it is not a good source for TEC power. Also it is shared power. Also it can be a long cable in some installations etc. Note: local P3V3 is also only 500mA max.

nope, P3V3_MP is only to supply the I2C-> UART converter

gkasprow commented 6 years ago

@a-shafir in case of TEC I did experiments on prototype board. It needs very little power to cool by a few degrees. It has big heatsink above which has 10K/W at 200LFM (1m/s). We need max 1W of cooling power. Look at the plot below: obraz Let's assume that the hot side is 50 degrees. We need max 10degrees of difference and max 1W of cooling power. This means that we need much less than 0.4A (approx 0.2A) at input voltage ~2V. That's why I did thermal simulation to see how much 1W of cooling power will change the DAC temperature. You are right - I simply placed negative power to the DAC instead of other side of the PCB. So I modified the design and attached thermal PAD to the TEC mode. Hyperlynx ignores components without pads. So at the moment I can model DAC power and TEC power. So with air flow of 1m/s at which TEC heatshink is specified, with -1W of Q, I get 20.5deg at the TEC pad and 23 deg at the DAC case. With Q=0 I get 26.5 at the TEC pad and 26.8 at the DAC. When I lower the air flow to 0.2m/s, the DAC temp is 45.7 and TEC pad temp is 45.1 With Q=1W the DAC temp is 39.4 deg. With Q=2W and 0.2m/s air flow we get: DAC temp = 33.3 deg This is the worst case scenario, with all components dissipating their max power. Remember one thing - the Peltier module to cool down by 10 degrees at Q=1W needs to have roughly 20deg of temp difference due to heatsik thermal resistance and 10 deg temp increase at 1W. So in our case with cold side at 30 deg and Q=1W we get heatsink temperature of 50 degrees.

gkasprow commented 6 years ago

The temperature sensor is placed as close as possible to the DAC case. It is also thermally connected with thermal pad using 6 vias. I cannot do much better. Where do you want to put another temperature sensor?

gkasprow commented 6 years ago

We would need to add to the heatsing to protect it against operation without the air flow. In such case the regulator will try to cool down the DAC but without proper ventilation, the hot side will get too hot and will destroy the TEC and possibly DAC because TEC will start heating instead of cooling. We can simply add thermal switch attached to the sink which will simply disconnect the TEC supply.

hartytp commented 6 years ago

@gkasprow Thanks for doing all that! Looks really good.

Thanks @a-shafir for the comments.

C12.2 is connected so SIGGND but not AGND or ground plane.

Yes, let's try to make sure that all of the various grounds around the DAC are tied as well as possible to a single solid ground plane.

With Q=0 I get 26.5 at the TEC pad and 26.8 at the DAC. When I lower the air flow to 0.2m/s, the DAC temp is 45.7 and TEC pad temp is 45.1 With Q=1W the DAC temp is 39.4 deg. With Q=2W and 0.2m/s air flow we get: DAC temp = 33.3 deg

That all sounds good @gkasprow.

Remember that the anticipated use case for Zotino is in a lab with decent temperature control, so the ambient temperature should only fluctuate by a degree or two (mainly due to variable power consumption of other EEMs in the same rack). So, we only want our TEC to change the DAC temperature by a couple of degrees max. The max TEC current should be up to +-1.5A (limited by the MaximIC peltier driver) so this gives us plenty of head room.

The fact that we have so much headroom suggests that (from a thermal perspective) we can afford to increase the amount of ground plane surrounding the DAC.

hartytp commented 6 years ago

Basically we need to put one more sensor to the bottom-right side of the board and control it for a specific thermal difference between the sensors.

I don't understand this point. We're aiming to control the DAC's absolute temperature, not its relative temperature.

One sensor should be fine.

Edit: a second sensor can be useful for diagnostics (e.g. to measure drifts in the temperature controller, but the IDC is already getting quite bit so I'm loathed to add another two pins to it for a diagnostic that we won't use very often).

hartytp commented 6 years ago

@gkasprow My feedback (other than the final issues above that remain outstanding):

hartytp commented 6 years ago

Other than that, I'm happy for this to go to manufacture as it is.

hartytp commented 6 years ago

We would need to add to the heatsing to protect it against operation without the air flow. In such case the regulator will try to cool down the DAC but without proper ventilation, the hot side will get too hot and will destroy the TEC and possibly DAC because TEC will start heating instead of cooling. We can simply add thermal switch attached to the sink which will simply disconnect the TEC supply.

@gkasprow We should be able to solve this in software on the temperature controller (Thermostat). e.g. one can set a max current and a shutoff temperature in the controller software. That should be sufficient to prevent damage without having to add extra thermal switches etc. Let's not overcomplicate the hardware for this.

a-shafir commented 6 years ago

@hartytp imagine we have the DAC not powered and rest of the board powered. So we will have let's say 28C the board temperature under the DAC. With the DAC powered it will be higher. So can compensate by the TEC the exceed heat from the DAC. In case if we will try to set the DAC 25C than there will be a temperature gradient so part of the board heat will be "pumped" with TEC. It looks like the ground plane thermal impedance us low. Greg can simulate how many W need to drop the temperature of the DAC few degree below the board temperature. And it is not impossible to have the board temperature 30-40C or even more in some hot places or with insufficient airflow. Any way, trying to drop the DAC temperature few deg under the surrounding PCB temperature will require high wattage of TEC and will make the situation even worst when the airflow is not good. So if we have 1 or 2 (diagonal across) the DAC sensors we can cool the DAC right to the board temperature with the low TEC wattage as @gkasprov planned.

In case if we need to cool it below the board temperature need to check the thermal impedance and the extra TEC power needed etc.

gkasprow commented 6 years ago

@a-shafir we can always set the temperature of the DAC a few degrees below the ambient. We don't care about absolute value but stability in long term. The conditions in the lab don't change that often.

a-shafir commented 6 years ago

@gkasprov yes, if we will follow the board temperature and if the airflow will be that high than will need around 1W. Than it makes sense to power the thermostat from 12V of course. But for this need more sensor(s) - see above message and also some more advanced thermostat logic or hw.

gkasprow commented 6 years ago

@a-shafir the regulator we will use supports only one sensor. We can add LM75 sensor on the board to sense ambient temperature. Then the regulator can be adjusted a few degrees below ambient.

a-shafir commented 6 years ago

@gkasprov You have the temp simulator. Can you try how many "minus W" need to apply for the DAC to make the current thermal sensor 5C below the board temperature few sm from the DAC?

a-shafir commented 6 years ago

@gkasprov what is the model of the regulator planned?

gkasprow commented 6 years ago

https://www.thorlabs.de/newgrouppage9.cfm?objectgroup_id=10626

hartytp commented 6 years ago

@a-shafir I'm not too worried about all of that.

Let's just stick with a single sensor rather than trying to overcomplicate all of this. Remember, the DAC doesn't have to be stabilised to mK, just to hundreds of mK in a rack that should be stable to a few K. Thus, we are only looking for a factor of 10 or so improvement in the ambient stability so we can ignore all second order effects.

a-shafir commented 6 years ago

@gkasprov my concern is not only temperature in the lab. If the airflow will not be sufficient the temperature inside of the case will slowly increase. Normally it finally (in hours) stabilizes because the efficiency of the cooling is increases with the device temperature (comparing to the ambient air). But in case of TEC if we are trying to hold a target temperature there is additional factor of the TEC hot side exceed power. So it is not impossible even a thermal runaway.

Also there are labs in hot places. Or what will happens if an unattended lab the air conditioning fails? If there is no target to keep the DAC at specific temperature indeed than there is certainly way to stay with low power on TEC using note sensors and also limit TEC power etc.

gkasprow commented 6 years ago

@a-shafir so we can add brutal switch mounted on the heatsink that will break the circuit.

hartytp commented 6 years ago

Currently, several of our designs will break without airflow (cf Kasli, unless the heatsink will fix that).

I'm not against a thermal switch if there is a really cheap, compact SMT option. But, I'm concerned that the complexity of this is the thing that's in most danger of going into runaway. We can always limit TEC V/I etc in software.

a-shafir commented 6 years ago

The protection is good to have.

Adding one more sensor cost nothing. In case of a programmable regulator it will allow to set the target temperature according to the situation.

You have all the data to decide.

a-shafir commented 6 years ago

"We can always limit TEC V/I etc in software."

Basically it even does not sounds crazy just to power TEC from a fixed wattage source! It will just do the job.

hartytp commented 6 years ago

Adding one more sensor cost nothing.

Well, you still have to pay someone to manually glue it to the heat sink and then wire it up to the PCB. Plus you have to sort out a comparator + thermal switch for the peltier. It all just seems like more hassle than it's worth IMHO.

Looking at Greg's simulations, the TEC power should be limited to about 1W by the TEC driver (which has user settable current and voltage limits for the Peltier). With a decent heatsink, that's not going to damage the TEC even if there isn't proper airflow (it's heatsunk to the PCB on one side and a heatsink on the other). So, I just don't see this ever leading to the TEC breaking so long as the temperature controller is configured properly.

a-shafir commented 6 years ago

Since we have a lot of options about the gateware having the heatsink on FPGA the must IMHO. As well as some thermal protection HW for the part that does not have it internally.

hartytp commented 6 years ago

I can't parse that sentence.

Look, let's keep this simple for the current version. If we have exploding TECs then we can add some extra protection.

In any case, how important is this? While we will probably want the TECs to get very good stability for Zotino, are other people (@jordens @dhslichter etc) also planning to use them? If this is something relatively niche that only we will use then I'm less concerned about making it indestructible.

a-shafir commented 6 years ago

"Well, you still have to pay someone to manually glue it to the heat sink and then wire it up to the PCB" for tracking the PCB temperature need a smd sensor on the PCB as I wrote initially. For TEC protection assuming we are not trying to lower the DAC temperature way below the PCB level.limiting the TEC power by 2w (for instance) shall be safe.

hartytp commented 6 years ago

What if we agree to just add a note on the schematic saying "2W max" by the IDC? Will that make everyone happy?

a-shafir commented 6 years ago

Note: "2W max" (and even 5W probably) will allow you to stabilize the DAC temperature assuming the rack temperature settled. But most likely it will be not enough to cool the DAC way below the board temperature because the major sources of hear around the DAC settled on the shared ground plane. So you still need yo know the board temperature to set the target for the regulator. So you need one more sensor on PCB. I2C sensor will work.

hartytp commented 6 years ago

Yes, one needs to know the ambient temperature, but one always needs to know that (it's generally not a good idea to pick a random temperature and rely of a lot of TEC power to reach it). However, that does not need a second sensor. The idea would be for the user to power the board with the TEC turned off, use the temperature controller (Thermistor) to measure the temperature and then use that as the set point.

Let's just leave the hardware as is and not bother with extra sensors.

a-shafir commented 6 years ago

Yep, with the i2c programmable TEC controller that allows to read the sensor it will work.

jordens commented 6 years ago

@gkasprow

@hartytp What stability and temperature coefficient do you expect with and without the TEC?

gkasprow commented 6 years ago

@jordens Yes, it fits in 4HP I already added LC filter at the DAC P3V3

hartytp commented 6 years ago

What stability and temperature coefficient do you expect with and without the TEC?

Target is <10ppm rms fluctuations (noise/drift) max over 24 hours (but ideally, more like a few ppm RMS) when used in a euro rack with few K fluctuations in temperature.

My memory of doing a detailed analysis of the stability of this board was that the stability is limited by the DAC (5ppm/K FSR typical)+ reference temp cos. Feeling was that it won't be quite good enough in a rack without some basic temperature control, but nothing particularly ambitious is needed.

Without the TEC, I'd expect something like 20ppm typical fluctuations with temperature (YMMV with conditions you mount the board in). With stabilisation, I expect few ppm stability easily (we've characterised a similar circuit based on these DACs before, and the stability was excellent once we added basic temperature stabilisation).

jordens commented 6 years ago

@hartytp In other words, temperature control gets you from 1 LSB stability to 0.1 LSB stability. I know where that's useful but the fact that quantization errors are now dominant by an order of magnitude definitely makes this a non-standard feature to me.

hartytp commented 6 years ago

@jordens yes. But, then so is the very low noise level that this board is targeting. It's also not that non-standard in the context of applying voltages to ion traps, where one often cares much more about stability than the exact value of the voltage.

Edit: in other words, I think the users are probably also non-standard (at least, the ones I've met are).

hartytp commented 6 years ago

@gkasprow did you manage to finish off the items at the top of this issue (can we close it)? In particular, did you zero-index the signals? The schematic can be done later if that helps, but it would be good to apply it to the silk + FP before manufacture?

gkasprow commented 6 years ago

In Altium you cannot count multi-channel designs from 0. So one bus is counted from 1, but all other things are zero-indexed. PCB marking is also 0-indexed. One can make Altum desing 0-indexed but then we would have to have 32 copies of the filter block on the schematic page

gkasprow commented 6 years ago

Yes, you can close it.