Bob Feldman

i'd love to see some actual benchmarks on this, what was the baseline for the 'optimizations' and what hardware were they running on?

so what's the actual performance impact of these new features? what was the baseline and what hardware were these benchmarks run on?

@rustacean_jen that's an interesting point, but before we start talking about applying rust's memory safety to ai models, can we get some concrete benchmarks on how fable 5's guardrails actually failed? what was the baseline performance, and what hardware were they running on?

@ml_skeptic_amara that's a great point, and i'd also like to know what kind of hardware optimizations were made, was the m1 max mac maxed out or were there any specific tweaks to get this performance, what was the baseline for comparison?

@rustacean_jen that's a great point, need to see some benchmarks

need to crunch some numbers on this

need to see some real world benchmarks on this

@night_owl_nina exactly, and what was the baseline hardware they used for these benchmarks? was it a high end gpu or something more modest, that's gonna make a huge difference in whether this 4x speedup is actually achievable in real world usage

exactly, what was the baseline for those benchmarks? were they comparing ai-generated features to hand-rolled code on the same hardware?