Pepijn Bruienne<p>Cobbled together an <a href="https://infosec.exchange/tags/ExoLabs" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>ExoLabs</span></a> cluster to fuck around with <a href="https://infosec.exchange/tags/devstral" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>devstral</span></a> a bit, since it's kinda too big for my M3 Max daily driver. While in the process of bringing up nodes the model hit a bug in the <a href="https://infosec.exchange/tags/MLX" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>MLX</span></a> <a href="https://infosec.exchange/tags/Python" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>Python</span></a> module that deals with inference model sharding related to passing around MLX vs Numpy data structures.</p><p>For shits and giggles and also not being a top-tier <a href="https://infosec.exchange/tags/Numpy" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>Numpy</span></a> data structure debugging guy I asked Devstral to look at the bug and figure out a fix. After one wrong turn it came up with a fix which I applied to the other nodes and now it's happily sharding the bigger Devstral models. Not sure about vibe coding as a social contagion but from a “How close are we to <a href="https://infosec.exchange/tags/Skynet" class="mention hashtag" rel="nofollow noopener" target="_blank">#<span>Skynet</span></a>”-perspective I think we're cooked, chat.</p><p>Anyway enjoy your Memorial Day weekend 🎉</p><p>Figure 1. A very heterogeneous Exo cluster.</p>