Still unclear what exactly this fixes, I think mostly bugs in migen/LiteX. Not sure if it's synthesizing the memory elements for the sampler modules either.
with_wb = True overrides the rd_addr, which broke the test. Just had to disable that param and the test was correct again
