Kafka workload never finishes analyzing

[tdeebswihart]

Hello.

I'm attempting to vet my solution for Fly's distributed system challenge #5a but maelstrom seems stuck analyzing: it's been doing so for 45 minutes now and has produced 1.3GB of log output.

It's dumping what looks to be internal state relevant to plotting; you can see it at the tail end of the gist at https://gist.github.com/chronoslynx/6e8ac74b11159ab07d6ad7ca1304e5ef. The log was full of output like

INFO [2023-03-05 11:26:42,178] clojure-agent-send-off-pool-80 - jepsen.tests.kafka :row [:g [:title ok send by process 2
[[:send "9" [2 2]]]] [:text {:x 48, :y 14, :style background: #f4ce90;} 2]]

I've replicated the issue with:

• maelstrom's 0.2.2 release
• maelstrom's 0.2.3 release
• 0.2.3

I can reliably reproduce this issue with my code at https://github.com/chronoslynx/gossip-glomers/blob/main/kafka/main.go

[elh]

Not sure if this was your issue, but I was seeing long "Analyzing..." times and OOMs when I was using large offset numbers. I saw this issue and it made me realize there was this graphing working downstream. Maybe some of the visualization generation scales with these numbers. Changing my offset generation fixed it for me.

Not sure what your issue is but maybe that is relevant. Good luck.