Interesting idea. How do you handle cases where the decision depends on context that isn't captured by the typed decision type?
gbayomi • OP
0
It’s very dependent on the underlying model right now, but it performs well for the current versions of jev/keV/laya!
jacksun788
1
Curious — how's this compare to laya?
gbayomi • OP
0
It can also run with laya. The idea is to have an easy way to run common evals with decision models and easily switch the “backend” from jev/kev/laya etc