An independent test of Jev 1.13 against historical NASA archive classifications.
I took 8,054 historical Kepler Objects of Interest from the NASA Exoplanet Archive, hid the archive disposition (classification), and asked Jev to classify each object as CONFIRMED, CANDIDATE or FALSE POSITIVE. Jev is TypeSafe's model for choosing among predefined options; Kepler Objects of Interest are signals found in the Kepler space telescope's observations of dimming stars.
No fine-tuning. No examples from this dataset. One prediction per object, stored before its archive label was read.
8,054 calls · 0 failures · 322 ms median · ~$0.34 estimated