A battery-included library for writing on-chip protocols, such as AMBA AXI and Altera Avalon.
clash-protocols
exists to make it easy to develop and use on-chip communication protocols, with a focus on protocols in need of bidirectional communication, such as AMBA AXI. To familiarize yourself with clash-protocols
, read hackage.haskell.org/package/clash-protocols. To read the next section, read at least:
Protocols
Protocols.Df
The next section will guide you through the creation of a single Df
based circuit.
Df
Circuit
sThe basic handshaking of Df
is heavily inspired by AMBA AXI:
Df
circuits send data to their right hand sideDf
circuits receive data from their left hand side.Df
circuits send acknowledgments to their left hand sideDf
circuits receive acknowledgments from their right hand sideThe protocols Df
imposes a contract each component should follow. These are, where possible, checked by the various test harnesses in Protocols.Hedgehog
.
Fwd a cannot depend on the Bwd a. In other words, deciding whether or not to send data cannot depend on the acknowledgment of that same data.
A component may not assert an acknowledgment while its reset is asserted. Doing so can lead to data loss. For example, imagine two circuits A and B both driven by different resets and connected as follows:
Reset domain A Reset domain B
+----------------------+ +----------------------+
| | | |
| | | |
| +-----------+ | | +------------+ |
| | | | Fwd a | | | |
| +->+ +----------------------------->+ +--> |
| | | | | | | |
| | | | | | | |
| | | | | | | |
| | | | | | | |
| | | | Bwd a | | | |
| <--+ +<-----------------------------+ +<-+ |
| | | | | | | |
| +-----------+ | | +------------+ |
| | | |
| | | |
+----------------------+ +----------------------+
If:
..circuit A will consider its data send and will not try again on the next cycle. However, B's reset is asserted so it will most likely not process anything. Test harnesses test this by driving a circuit under test before deasserting its reset.
This invariant allows developers to insert arbitrary reset delays without worrying their design breaks. Caution should still be taken though, see Note [Deasserting resets].
When Fwd a does not contain data (i.e., is NoData
), its corresponding Bwd a may contain any value, including an error/bottom. When driving a bottom, a component should use errorX
to make sure it can be evaluated using seqX
. Test harnesses in Protocols.Hedgehog
occasionally drive errorX "No defined Ack"
when seeing NoData
to test this.
A circuit driving Data x
must keep driving the same value until it receives an acknowledgment. This is not yet checked by test harnesses.
Care should be taken when deasserting resets. Given the following circuit:
withReset rstA a
|> withReset rstB b
|> withReset rstC c
or schematically:
a > b > c
Component a
's reset should be deasserted first, then b
's, then c
s. More generally, a topological sort determines the order in which to deassert resets. For example:
a > b > c > d
^ v
f < e
should be deasserted as follows: a
, b,
c
, d
/e
, f
. Resets might also be deasserted simultaneously. For example, a
's and b
's reset might be deasserted at the same cycle.
This order is imposed by the fact that there is an invariant stating a component in reset must not acknowledge data while in reset, but there is - for performance reasons - no invariant stating a component must not send data while in reset.
catMaybes
At this point you should have familiarized with the basic structures of the Df
: its dataconstructors (Data
, NoData
, and Ack
) and its invariants, as well as the structure of a Circuit
itself. To quickly try things it's useful to keep a repl around. With stack
:
stack exec --package clash-protocols ghci
with cabal
, clone this project and run:
cabal update
cabal repl clash-protocols
Both should give you the same shell. Import the necessary modules:
>>> import qualified Clash.Prelude as C
>>> import qualified Protocols.Df as Df
You should now be able to query various things. For example:
>>> :t toSignals
toSignals :: Circuit a b -> (Fwd a, Bwd b) -> (Bwd a, Fwd b)
Similar to the console we start by importing all the necessary modules:
module CatMaybes where
import Protocols
import qualified Clash.Prelude as C
import qualified Protocols.Df as Df
Then, we define the type and name of the component we'd like to write:
catMaybes :: Circuit (Df dom (Maybe a)) (Df dom a)
I.e., a circuit that takes a Df
stream of Maybe a
on the left hand side (LHS) and produces a stream of a
on the right hand side (RHS). Note that the data carried on Df
s forward path very much looks like a Maybe
in the first place:
>>> :kind! Fwd (Df C.System Int)
..
= Signal "System" (Df.Data Int)
..because Data Int
itself has two constructors: Data Int
and NoData
. In effect, we'd like squash Data (Just a)
into Data a
, and Data Nothing
into NoData
. Not unlike the way join would work on two Maybe
s.
As the types of Circuit
s become quite verbose and complex quickly, I like to let GHC do the heavy lifting. For example, I would write:
catMaybes = Circuit go
At this point, GHC will tell us:
CatMaybes.hs:8:21: error:
Variable not in scope:
go
:: (C.Signal dom (Df.Data (Maybe a)), C.Signal dom (Df.Ack a))
-> (C.Signal dom (Df.Ack (Maybe a)), C.Signal dom (Df.Data a))
|
8 | catMaybes = Circuit go
| ^^
This is something we can work with. We need to accept:
and we need to return:
We can't really work on multiple signals at the same time, so we need to bundle them. Similarly, we unbundle the output of our function:
catMaybes = Circuit (C.unbundle . go . C.bundle)
Now GHC will tell us:
CatMaybes.hs:8:35: error:
Variable not in scope:
go
:: C.Signal dom (Df.Data (Maybe a), Df.Ack a)
-> C.Signal dom (Df.Ack (Maybe a), Df.Data a)
|
8 | catMaybes = Circuit (C.unbundle . go . C.bundle)
| ^^
Finally, we don't need any state for this function, so we might as well make our lives a little bit easier by using fmap
to "get rid of" the Signal
s:
catMaybes = Circuit (C.unbundle . fmap go . C.bundle)
after which GHC will tell us:
CatMaybes.hs:8:40: error:
Variable not in scope:
go
:: (Df.Data (Maybe a), Df.Ack a)
-> (Df.Ack (Maybe a), Df.Data a)
|
8 | catMaybes = Circuit (C.unbundle . fmap go . C.bundle)
| ^^
This is something we can write, surely! If the LHS does not send data, there's not much we can do. We send NoData
to the RHS and send a /nack/:
go (Df.NoData, _) = (Df.Ack False, Df.NoData)
If we do receive data from the LHS but it turns out to be Nothing, we'd like to acknowledge that we received the data and send NoData
to the RHS:
go (Df.Data Nothing, _) = (Df.Ack True, Df.NoData)
Finally, if the LHS sends data and it turns out to be a Just, we'd like to acknowledge that we received it and pass it onto the RHS. But we should be careful, we should only acknowledge it if our RHS received our data! In effect, we can just passthrough the ack:
go (Df.Data (Just d), Df.Ack ack) = (Df.Ack ack, Df.Data d)
We'll use Hedgehog
for testing our circuit. Conveniently, Protocols.Hedgehog
defines some pretty handy helpers! Let's import everything:
import qualified Protocols.Hedgehog as H
import qualified Hedgehog as H
import qualified Hedgehog.Gen as Gen
import qualified Hedgehog.Range as Range
Before we get to testing our circuit, we first need a Hedgehog generator that can generate input data for our circuit. Let's define it:
genCatMaybesInput :: H.Gen [Maybe Int]
genCatMaybesInput =
Gen.list (Range.linear 0 100) (genMaybe (genInt 10 20))
where
genMaybe genA = Gen.choice [Gen.constant Nothing, Just <$> genA]
genInt a b = Gen.integral (Range.linear a b)
The explanation for the definition is out of scope for this tutorial, but it basically says: this generator generates a list with 0 to 100 elements, each a Just
or a Nothing
. If it is a Just
it will contain an Int
between 10 and 20. If you'd like to learn more about Hedgehog head over to hackage.haskell.org/package/hedgehog.
For Df
circuits we can define a pretty strong property: a Circuit (Df dom a) (Df dom a)
is functionally the same as a function [a] -> [a]
if we strip all the backpressure and Signal
abstractions. Similarly, we for our Circuit (Df dom (Maybe a)) (Df dom a)
our pure model would be [Maybe a] -> [a]
, i.e. Data.catMaybes
!
The function Protocols.Hedgehog.idWithModel
takes advantage of exactly that fact. You tell it:
In code, this looks like:
import qualified Data.Maybe as Maybe
[..]
prop_catMaybes :: H.Property
prop_catMaybes =
H.idWithModel
H.defExpectOptions
genCatMaybesInput
Maybe.catMaybes
(catMaybes @C.System)
From that point on, it will do the rest. By driving the circuit with arbitrary input and backpressure (among other things), it effectively tests whether a circuit implements the invariants of the Df
protocol and whether it is (functionally) equivalent to its pure model. To actually run the tests we need some more boilerplate:
import Test.Tasty
import Test.Tasty.TH (testGroupGenerator)
import Test.Tasty.Hedgehog.Extra (testProperty)
[..]
main :: IO ()
main = defaultMain $(testGroupGenerator)
Once that is done, we can run our tests:
*CatMaybes> main
CatMaybes
prop_catMaybes: OK (0.06s)
✓ prop_catMaybes passed 100 tests.
All 1 tests passed (0.06s)
Yay, all done!
HEADS UP: Hedgehog expects to find source files locally in order to display pretty error messages. If you want pretty error messages in your package, please use this patched version of Hedgehog. When using cabal add the following to your cabal.project
:
source-repository-package
type: git
location: https://github.com/martijnbastiaan/haskell-hedgehog.git
tag: f7d25b0a1927b7c06d69535d5dcfcade560ec624
subdir: hedgehog
Stack users can add the following to stack.yaml
:
extra-deps:
- git: git@github.com:martijnbastiaan/haskell-hedgehog
commit: f7d25b0a1927b7c06d69535d5dcfcade560ec624
subdirs:
- hedgehog
We'll try and upstream these patches.
Writing a Df
component can be tricky business. Even for relatively simple circuits such as catMaybes
it's easy to send a wrong acknowledgment. The test harness is supposed to catch this, but its output isn't always easy to parse. We'll go over a few common mistakes.
Let's introduce one:
- go (Df.Data Nothing, _) = (Df.Ack True, Df.NoData)
+ go (Df.Data Nothing, _) = (Df.Ack False, Df.NoData)
Rerunning the tests will give us a big error, which starts out as:
CatMaybes
prop_catMaybes: FAIL (0.11s)
✗ prop_catMaybes failed at src/Protocols/Hedgehog/Internal.hs:167:7
after 9 tests and 3 shrinks.
This notes our test has failed after 9 tests. To produce a small example Hedgehog has tried to shrink the test to a minimal test case, reflected in its and 3 shrinks. The test fails at src/Protocols/Hedgehog/Internal.hs:167:7
. Usually, you'd see your own files here, but in our case we used idWithModel
- an externally defined property. Hedgehog will try and be helpful by printing the source code of the property interspersed with the data it generated.
So we get:
┏━━ src/Protocols/Hedgehog.hs ━━━
74 ┃ propWithModel ::
75 ┃ forall a b .
76 ┃ (Test a, Test b, HasCallStack) =>
77 ┃ -- | Options, see 'ExpectOptions'
78 ┃ ExpectOptions ->
79 ┃ -- | Test data generator
80 ┃ H.Gen (ExpectType a) ->
81 ┃ -- | Model
82 ┃ (ExpectType a -> ExpectType b) ->
83 ┃ -- | Implementation
84 ┃ Circuit a b ->
85 ┃ -- | Property to test for. Function is given the data produced by the model
86 ┃ -- as a first argument, and the sampled data as a second argument.
87 ┃ (ExpectType b -> ExpectType b -> H.PropertyT IO ()) ->
88 ┃ H.Property
89 ┃ propWithModel eOpts genData model prot prop = H.property $ do
90 ┃ dat <- H.forAll genData
┃ │ [ Nothing , Just 10 ]
propWithModel
is used internally by idWithModel
. In essence, propWithModel
is the generalized version of idWithModel
: it allows users to specify their own properties instead of a hardcoded equality test. Right at line 90 and the line below it, we can see something interesting happen:
90 ┃ dat <- H.forAll genData
┃ │ [ Nothing , Just 10 ]
At this point Hedgehog used our data generator to generate the input supplied to our circuit. Although it isn't perfect, Hedgehog tried to minimize the example so we can be pretty sure Nothing
then Just 10
means something. In other words, we can be reasonably sure that this failure wouldn't have happened with just Nothing
or just Just 10
. (Note that this is correct: our catMaybes
only gets stuck after having seen a Nothing
. However, the test harness can't see the difference between a filtered Nothing
and stuckness, hence the additional Just 10
.)
We move on.
91 ┃ let n = maximum (expectToLengths (Proxy @a) dat)
92 ┃
93 ┃ -- TODO: Different distributions?
94 ┃ let genStall = Gen.integral (Range.linear 0 10)
95 ┃
96 ┃ -- Generate stalls for LHS part of the protocol. The first line determines
97 ┃ -- whether to stall or not. The second determines how many cycles to stall
98 ┃ -- on each _valid_ cycle.
99 ┃ lhsStallModes <- H.forAll (sequenceA (C.repeat @(SimulateChannels a) genStallMode))
┃ │ <NoStall>
100 ┃ lhsStalls <- H.forAll (traverse (genStalls genStall n) lhsStallModes)
┃ │ <(StallWithNack,[])>
101 ┃
102 ┃ -- Generate stalls for RHS part of the protocol. The first line determines
103 ┃ -- whether to stall or not. The second determines how many cycles to stall
104 ┃ -- on each _valid_ cycle.
105 ┃ rhsStallModes <- H.forAll (sequenceA (C.repeat @(SimulateChannels b) genStallMode))
┃ │ <NoStall>
106 ┃ rhsStalls <- H.forAll (traverse (genStalls genStall n) rhsStallModes)
┃ │ <(StallWithNack,[])>
Again, the unnumbered lines are the most interesting:
99 ┃ lhsStallModes <- H.forAll (sequenceA (C.repeat @(SimulateChannels a) genStallMode))
┃ │ <NoStall>
100 ┃ lhsStalls <- H.forAll (traverse (genStalls genStall n) lhsStallModes)
┃ │ <(StallWithNack,[])>
This tells us that the test decided to not produce any stalls on the LHS. The next line says basically the same. We'll get back to that soon. This logic is repeated for stalling the RHS too, with the same results. At this point, we can be pretty sure it has nothing to do with stalls either.
The last interesting bit of the test report is:
Circuit did not produce enough output. Expected 1 more values. Sampled only 0:
[]
The test tells us that no output was sampled, even though it expected to sample a single value. At this point there is no structured way to actually spot the error, but by now it should be pretty clear.
Let's revert the "mistake" we made and make another:
- go (Df.Data (Just d), Df.Ack ack) = (Df.Ack ack, Df.Data d)
+ go (Df.Data (Just d), Df.Ack ack) = (Df.Ack True, Df.Data d)
Again, we get a pretty big error report. Let's skip right to the interesting bits:
90 ┃ dat <- H.forAll genData
┃ │ [ Just 10 ]
99 ┃ lhsStallModes <- H.forAll (sequenceA (C.repeat @(SimulateChannels a) genStallMode))
┃ │ <NoStall>
100 ┃ lhsStalls <- H.forAll (traverse (genStalls genStall n) lhsStallModes)
┃ │ <(StallWithNack,[])>
105 ┃ rhsStallModes <- H.forAll (sequenceA (C.repeat @(SimulateChannels b) genStallMode))
┃ │ <NoStall>
106 ┃ rhsStalls <- H.forAll (traverse (genStalls genStall n) rhsStallModes)
┃ │ <(StallWithNack,[])>
Circuit did not produce enough output. Expected 1 more values. Sampled only 0:
[]
In this case, Hedgehog pretty much constrained us to pretty much one case in our implementation: the one where it matches on Df.Data (Just d)
. Weirdly, no backpressure was needed to trigger this error, but we still see dropped values. This usually means we generated an ack while the reset was asserted. And sure enough, we don't check for this. (Note that the "right" implementation moved the responsibility of this problem to the component on the RHS, hence not failing.)
At this point it might be tempting to use Df.forceResetSanity
to force proper reset behavior. To do so, apply the patch:
- catMaybes :: Circuit (Df dom (Maybe a)) (Df dom a)
- catMaybes = Circuit (C.unbundle . fmap go . C.bundle
+ catMaybes :: C.HiddenClockResetEnable dom => Circuit (Df dom (Maybe a)) (Df dom a)
+ catMaybes = Df.forceResetSanity |> Circuit (C.unbundle . fmap go . C.bundle
Because our function is now stateful, we also need to change the test to:
prop_catMaybes :: H.Property
prop_catMaybes =
H.idWithModelSingleDomain
H.defExpectOptions
genCatMaybesInput
(\_ _ _ -> Maybe.catMaybes)
(C.exposeClockResetEnable (catMaybes @C.System))
Of course, the actual bug is still in there so we expect the test to fail still. And sure enough:
90 ┃ dat <- H.forAll genData
┃ │ [ Just 10 ]
99 ┃ lhsStallModes <- H.forAll (sequenceA (C.repeat @(SimulateChannels a) genStallMode))
┃ │ <NoStall>
100 ┃ lhsStalls <- H.forAll (traverse (genStalls genStall n) lhsStallModes)
┃ │ <(StallWithNack,[])>
105 ┃ rhsStallModes <- H.forAll (sequenceA (C.repeat @(SimulateChannels b) genStallMode))
┃ │ <Stall>
106 ┃ rhsStalls <- H.forAll (traverse (genStalls genStall n) rhsStallModes)
┃ │ <(StallWithNack,[1])>
Circuit did not produce enough output. Expected 1 more values. Sampled only 0:
[]
This time the LHS of the circuit was not stalled, but the RHS was. Let's bisect:
105 ┃ rhsStallModes <- H.forAll (sequenceA (C.repeat @(SimulateChannels b) genStallMode))
┃ │ <Stall>
At 105, Hedgehog decided to stall the RHS. Note that if we had multiple input channels, we would have seen multiple items in this vector. The next line decides how to stall:
106 ┃ rhsStalls <- H.forAll (traverse (genStalls genStall n) rhsStallModes)
┃ │ <(StallWithNack,[1])>
The first part of the tuple, StallWithNack
, indicates what the stall circuit does when it does not receive data from the circuit. While it will stall with nacks in this case, it could have stalled with acks or even undefineds too as the protocol doesn't restrict that. The second part of the tuple, [1]
, determines how many cycles whenever the circuit sends data. If it would have read:
[4,5,6]
instead, this would have mean that the circuit would be stalled for 4 cycles on its first valid data cycle, 5 on the next, and 6 on the next valid data cycle after that. Hedgehog only generated one member in our case, as it expects to sample just a single value too.
At this point we're forced to conclude that forceResetSanity
did not fix our woes and we should persue a proper fix.
Check out tests/Tests/Protocols/Plugin.hs for examples on how to use Protocols.Plugin
to wire up circuits using a convenient syntax.
Circuit
sCommunication bus protocols like AMBA AXI are different from circuits like those described above. These protocols are intended for communication between masters and slaves, hence useful data is going both in the forward and in the backward direction. What such protocols do have in common is that data is acknowledged. The part of the bus over which data goes in one direction and acknowledgements in the other are called channels, in the case of AXI. Therefore such a channel individually is similar to Df
.
clash-protocols
aims to provide classes and instances for popular communication bus protocols, including AXI. This section describes what parts of clash-protocols
are suitable for such protocols and which are not. We further illustrate how the nature of protocols like AXI influenced architectural decisions in clash-protocols
.
DfLike
instance for AXIAs mentioned, one channel in AXI is like Df
. For each channel individually it is indeed possible to define a DfLike
instance. Then, we might compose all five channels to obtain an AXI interface. This will however not result in a correct interface: DfLike
is defined such that the data type over the Fwd
channel is something with a Payload
, while the backward channel is an acknowledgement. Therefore when we compose the five AXI channels, the channels that send data from the slave to the master will be sending data in the same direction as the master to slave channels.
A further problem with DfLike
and AXI is that DfLike
requires some generic type a
in the type for which DfLike
is implemented. While AXI does specify "user-defined signaling", which can be anything, the specification also recommends not using such signals. So in general, an AXI channel is simply not as generic as a type for which DfLike
is implemented ought to be.
Drivable
instance for AXIDrivable
is a class providing convenient functions that can generate circuits that drive and sample another circuit. For example, the driveC
function yields a Circuit () a
circuit. Since this circuit has the ()
protocol on its left hand side it is trivially driveable. The sample function can drive such a circuit by applying ()
and in that way simulates the circuit of type Circuit a b
to which the driveC
circuit is connected.
To be able to generate a Circuit () a
, it must be possible to generate backpressure. For example, if the SimulationConfig defines that the circuit should first stall 100 cycles after reset, the acknowledge signal of the circuit that is sampled must be set to false for 100 cycles. If this acknowledge signal is not exactly a Bool
, it must be generated from a Bool
. This is what the Backpressure
instance is for. It supplies one function, boolsToBwd
, which converts a list of Booleans to Bwd a
(e.g. a Signal Ack
).
AXI has two channels that allow data to be sent from the slave to the master. Hence, on these channels there is meaningful data on the backward part and this data cannot in general be generated from a list of booleans. This inhibits a Drivable
instance for AXI.
Fwd
cannot be injectiveThe channels that communicate data from the slave to the master receive an acknowledgement (or ready) signal from the master. This is the signal that is on the Forward channel. Thus it can happen that we simply want to have Signal Ack
on the forward channel for several protocols. This means that Fwd
cannot be an injective type family anymore due to AXI like circuits.
This means that when we write functions such as:
catMaybes = Circuit (C.unbundle . go . C.bundle)
The type that can be inferred for go
by GHC is much less precise than when Fwd
(and Bwd
for that matter) are injective.
Simulate
instanceThe clash-protocols
features mentioned above are all not suitable to be used with communication bus protocols such as AXI. What is suitable is the Simulate
class. For a protocol a
, a Simulate
instance defines conversion functions from types that are easy to use in testcases and manual simulations (usually these are lists), from and to the types that are used by the protocol a
. Furthermore, a Simulate
instance provides an unsynthesizable stallC
function which generates a circuit that stalls the circuit according to a given list of stalls. This function can be used to test the circuit's behaviour under different stalls. It is most useful to define Hedgehog tests that stall the circuit arbitrarily.
AXI-like circuits contain a master and a slave. These can be modelled as Circuit m axi
and Circuit axi s
respectively, where axi
is the type for the AXI protocol whith specific settings, and m
and s
could be other protocols the master and slave use to communicate with I/O or other components (or just ()
). An n to m interconnect would thus be of the form:
interconnect :: (KnownNat n, KnownNat m) => Circuit (Vec n axi) (Vec m axi)
clash-protocols
is licensed under BSD2. See LICENSE.
Df
) and industry supported ones (e.g., AMBA AXI)This project does not aim to:
No formal guidelines yet, but feel free to open a PR!
0.1
fanin
, roundrobin
, ..DfLike
base implementation instead of Df
(performance / cleanliness)Protocols.Ack
circuit-notation
(where possible)circuit-notation
clash-protocols
simulateCircuit
function, currently it just ignores it.0.2
SimulateType
and ExpectType